-- Logs begin at Tue 2022-08-30 14:00:21 UTC, end at Tue 2022-08-30 15:32:14 UTC. -- Aug 30 14:33:56.106763 dv-cinder-828806-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 14:33:56.120537 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 14:33:56.123397 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 14:33:56 2022] *** Aug 30 14:33:56.123397 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 14:33:56.123397 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 14:33:56.123397 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: nodename: dv-cinder-828806-5-iscsi Aug 30 14:33:56.123397 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: machine: x86_64 Aug 30 14:33:56.123397 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: clock source: unix Aug 30 14:33:56.123397 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: pcre jit disabled Aug 30 14:33:56.123397 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: detected number of CPU cores: 4 Aug 30 14:33:56.123397 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: current working directory: / Aug 30 14:33:56.123397 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: detected binary path: /usr/bin/uwsgi-core Aug 30 14:33:56.123397 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: your processes number limit is 47680 Aug 30 14:33:56.124087 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: your memory page size is 4096 bytes Aug 30 14:33:56.124087 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: detected max file descriptor number: 2048 Aug 30 14:33:56.124087 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: lock engine: pthread robust mutexes Aug 30 14:33:56.124087 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: thunder lock: enabled Aug 30 14:33:56.124087 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 14:33:56.124364 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 14:33:56.164249 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: Python main interpreter initialized at 0x55562c4e99c0 Aug 30 14:33:56.164249 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: python threads support enabled Aug 30 14:33:56.164249 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: your server socket listen backlog is limited to 100 connections Aug 30 14:33:56.164249 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: your mercy for graceful operations on workers is 90 seconds Aug 30 14:33:56.164621 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 14:33:56.164692 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: *** Operational MODE: preforking *** Aug 30 14:33:56.164950 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: *** uWSGI is running in multiple interpreter mode *** Aug 30 14:33:56.164950 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: spawned uWSGI master process (pid: 112096) Aug 30 14:33:56.165149 dv-cinder-828806-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 14:33:56.172993 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: spawned uWSGI worker 1 (pid: 112097, cores: 1) Aug 30 14:33:56.172993 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: spawned uWSGI worker 2 (pid: 112099, cores: 1) Aug 30 14:33:56.172993 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 14:33:56.835351 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 14:33:56.835956 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 14:33:57.936229 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:33:57.936229 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: from cryptography.utils import int_from_bytes Aug 30 14:33:57.936862 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:33:57.936862 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: from cryptography.utils import int_from_bytes Aug 30 14:33:57.939607 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:33:57.939607 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: from cryptography.utils import int_from_bytes Aug 30 14:33:57.940066 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:33:57.940066 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: from cryptography.utils import int_from_bytes Aug 30 14:34:00.432219 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 14:34:00.432766 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 14:34:00.432971 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 14:34:00.433325 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 14:34:00.433827 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 14:34:00.434209 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.434530 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.434845 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.435156 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.435474 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 14:34:00.435844 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.435945 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 14:34:00.436026 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.436103 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.436234 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 14:34:00.436403 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.436591 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 14:34:00.436723 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.436844 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 14:34:00.436977 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.437230 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.437327 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.437553 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.437640 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-5-iscsi {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.437872 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.437957 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.438171 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.438256 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.438474 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.438560 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.438785 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.438902 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.439087 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.439284 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.439489 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.440069 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.440258 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.440352 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.440522 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.440837 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.440933 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.441158 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-5-iscsi {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.441276 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.441478 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.441579 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.441783 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.441878 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.442091 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.442186 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.442411 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.442513 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.442712 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.442800 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.443043 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.443154 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.443359 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.443500 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.443696 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.443869 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.443978 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.444168 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.444378 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-5-iscsi {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.444471 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.444694 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.444853 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.445006 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.445129 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.445316 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.445418 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.445673 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.445773 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.445988 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.446080 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.446293 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.446385 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.446634 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.446729 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.446909 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.447008 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.447232 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.447338 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-5-iscsi {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.447551 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.447643 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.447863 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.447968 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.448174 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.448267 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.448484 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.448615 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.448773 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.448921 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.449073 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.449226 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.449373 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.449542 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.449682 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.449861 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.449961 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.450166 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.450263 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.450491 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.450599 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.450786 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.450882 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.451100 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.451197 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.451433 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.451534 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.451731 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.451824 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.451979 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.452064 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.452222 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.452318 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.452532 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.452630 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.452843 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.452929 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.453147 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.453242 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.453442 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.453526 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.453739 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.453830 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.454038 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.454128 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.454337 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.454430 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.454635 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.454724 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.454891 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.455029 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.455153 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.455354 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.455543 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.455671 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.455893 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.455980 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.456202 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.456287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.456509 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.456603 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.456814 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.456900 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.457120 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.457245 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.457423 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.457518 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.457726 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.457812 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.458029 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.458123 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.458333 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.458428 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.458646 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.458748 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.458956 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.459042 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.459294 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.459396 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.459639 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.459739 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.459897 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.459984 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.460198 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.460285 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.460514 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.460617 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.460817 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.460909 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.461125 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.461226 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.461373 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.461474 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.461664 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.461760 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.461961 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.462055 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.462273 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.462359 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.462573 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.462671 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.462872 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.462965 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.463176 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.463308 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.463494 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.463633 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.463795 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.463882 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.464094 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.464180 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.464370 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.464464 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.464669 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.464755 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.464969 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.465062 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.465265 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.465358 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.465566 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.465653 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.465864 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.465949 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.466162 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.466248 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.466455 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.466540 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.466760 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.466854 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.467064 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.467157 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.467389 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.467492 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.467689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.467782 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.467989 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.468077 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.468287 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.468371 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.468588 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.468681 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.468888 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.468982 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.469188 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.469273 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.469487 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.469582 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.469785 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.469873 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.470095 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.470180 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.470393 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.470479 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.471234 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.471337 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.471617 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.471720 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.471919 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.472021 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.472221 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.472310 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.472534 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.472620 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.472835 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.472921 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.473137 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.473225 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.473436 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.473522 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.473742 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.473845 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.474041 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.474127 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.474342 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.474436 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.474640 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.474776 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.474938 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.475025 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.475249 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.475383 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.475566 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.475668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.475869 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.475954 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.476172 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.476256 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.476471 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.476570 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.476771 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.476864 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.477072 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.477158 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.477375 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.477462 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.477675 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.477760 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.477976 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.478064 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.478274 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.478362 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.478587 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.478673 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.478905 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.478993 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.479244 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.479335 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.479536 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.479621 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.479839 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.479941 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.480156 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:34:00.480243 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.480471 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.480557 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.480784 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.480959 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.481090 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.481178 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.481407 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.481510 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.481721 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.481828 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.482046 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.482138 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.482360 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.482452 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.482667 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.482768 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.482976 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.483067 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.483303 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.483424 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.483621 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.483738 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.483930 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.484028 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.484243 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.484332 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.484546 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.484642 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.484863 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.484950 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.485188 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.485274 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.485499 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.485593 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.485811 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.485904 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.486124 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.486212 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.487097 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.487197 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.487433 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.487519 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.487742 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.487830 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.488061 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.488156 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.488387 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.488481 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.488696 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.488782 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.489011 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.489098 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.489318 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.489411 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.489635 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.489740 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.489944 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.490031 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.490250 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.490336 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.490597 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.490733 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.490936 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.491074 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.491159 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.491280 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.491506 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.491629 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.491817 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.491913 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.492132 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.492225 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.492440 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.492542 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.492745 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.492837 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.493056 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.493148 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.493361 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.493473 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.493667 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.493761 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.493971 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.494077 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.494268 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.494356 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.494566 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.494661 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.494864 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.494994 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.495168 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.495280 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.495492 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.495579 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.495807 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.495892 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.496118 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.496204 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.496754 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.496884 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.496884 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.497036 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.497114 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.497194 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.497305 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.497392 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.497607 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.497701 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.497908 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.498002 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.498203 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.498288 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.498503 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.498597 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.498805 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.498890 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.499103 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.499191 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.499440 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.499541 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.499743 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.499835 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.500044 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.500131 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.500358 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.500456 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.500655 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.500740 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.500958 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.501085 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.501262 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.501359 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.501632 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.501730 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.501871 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.501958 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.502210 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.502396 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.502522 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.502734 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.502842 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.503048 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.503143 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.503378 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.503487 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.503704 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.503825 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.504011 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.504172 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.504321 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.504439 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.504637 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.504757 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.504951 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.505079 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.505262 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.505374 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.505577 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.505664 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.505889 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.505977 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.506211 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.506297 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.506523 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.506609 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.506820 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.506913 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.507124 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.507229 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.507445 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.507532 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.507742 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.507830 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.508041 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.508127 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.508339 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.508435 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.508639 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.508725 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.508957 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.509042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.509261 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.509360 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.509561 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.509649 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.509859 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.509944 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.510157 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.510252 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.510462 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.510546 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.510764 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.510852 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.511070 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.511187 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.511403 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.511501 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.511712 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.511810 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.512015 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.512109 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.512334 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.512435 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.512647 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.512740 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.512950 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.513042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.513250 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.513341 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.513553 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.513645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.513854 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.513946 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.514243 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.514340 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.514473 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.514572 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.514785 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.514873 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.515089 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.515268 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.515431 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.515529 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.515735 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.515831 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.516046 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.516133 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.516343 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.516442 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.516649 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.516742 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.516959 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.517048 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.517269 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.517364 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.517655 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.517740 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.517979 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.518107 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.518288 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.518429 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.518599 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.518741 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.518908 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.519064 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.519236 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.519398 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.519541 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.519718 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.519845 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.520023 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.520158 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.520337 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.520462 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.520675 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.520760 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.521006 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.521101 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.521321 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.521411 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.521639 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.521726 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.521951 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.522058 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.522244 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.522330 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.522553 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.522640 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.522860 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.522954 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.523169 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.523278 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.523501 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.523589 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.523817 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.523904 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.524124 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.524216 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.524426 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.524511 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.524730 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.524824 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.525034 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.525128 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.525335 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.525421 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.525634 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.525721 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.525936 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.526028 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.526242 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.526333 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.526545 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.526633 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.526847 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.526934 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.527144 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.527274 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.527479 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.527567 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.527781 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.527867 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.528079 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.528172 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.528377 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.528474 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.528683 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.528782 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.528986 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.529085 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.529288 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.529374 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.529595 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.529680 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.529905 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.530001 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.530201 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.530300 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.530500 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.530588 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.530801 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.530896 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.531106 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.531192 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.531428 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.531519 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.531726 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.531814 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.532026 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.532125 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.532331 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.532416 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.532652 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.532749 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.532951 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.533049 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.533772 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.533864 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.534091 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.534178 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.534394 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.534529 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.534697 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.534831 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.535019 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.535138 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.535351 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.535472 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.535655 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.535789 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.535958 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.536098 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.536261 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.536404 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.536600 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.536699 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.536909 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.537003 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.537211 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.537297 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.537525 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.537620 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.537843 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.537938 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.538150 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.538235 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.538461 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.538560 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.538763 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.538849 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.539061 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.539159 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.539402 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.539490 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.539715 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.539809 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.540023 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.540299 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.540394 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.540623 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.540710 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.540924 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.541017 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.541229 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.541329 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.541541 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.541629 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.541848 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.541940 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.542158 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.542274 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.542465 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.542553 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.542767 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.542853 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.543079 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.543167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.543417 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.543504 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.543716 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.543978 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.544064 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.544310 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.544414 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.544607 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.544699 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.544904 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.544990 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.545202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.545289 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.545506 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.545592 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.545803 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.545903 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.546100 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.546196 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.546397 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.546506 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.546693 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.546812 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.546998 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.547124 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.547318 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.547453 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.547625 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.547758 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.547922 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.548070 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.548237 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.548376 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.548540 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.548679 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.549536 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.549652 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.549845 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.549932 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.550145 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.550232 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.550448 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.550535 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.550753 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.550839 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.551057 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.551144 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.551396 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.551486 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.551701 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.551796 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.552013 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.552099 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.552318 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.552417 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.552632 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.552718 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.552932 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.553018 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.553233 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.553320 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.553531 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.553616 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.553833 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.553932 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.554140 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.554226 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.554439 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.554567 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.554750 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.554850 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.555055 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.555142 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.555385 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.555486 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.555693 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.555792 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.555992 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.556079 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.556299 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.556386 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.556597 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.556693 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.556906 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.556993 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.557207 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.557300 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.557504 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.557593 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.557802 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.557898 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.558101 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.558187 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.558404 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.558500 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.558959 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.559053 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.559287 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.559376 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.559588 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.559675 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.559889 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.559983 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.560187 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.560280 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.560485 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.560572 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.560784 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.560870 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.561087 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.561182 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.561388 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.561476 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.561684 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.561769 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.561992 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.562086 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.562297 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.562438 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.562597 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.562689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.562894 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.562988 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.563198 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.563300 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.563525 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.563612 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.563822 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.563922 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.564124 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.564210 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.564449 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.564539 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.564759 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.564846 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.565060 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.565146 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.565358 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.565442 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.565653 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.565742 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.565949 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.566035 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.566246 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.566340 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.566548 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.566633 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.566841 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.566925 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.567137 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.567274 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.567464 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.567551 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.567760 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.567852 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.568055 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.568155 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.568371 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.568466 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.568671 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.568756 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.568965 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.569063 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.569263 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.569351 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.569558 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.569644 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.569856 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.569949 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.570162 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.570248 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.570461 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.570554 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.570760 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.570860 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.571058 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.571143 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.571382 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.571491 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.571682 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.571824 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.572000 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.572096 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.572306 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.572400 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.572607 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.572709 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.572914 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.573008 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.573215 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.573300 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.573542 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.573630 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.573841 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.573927 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.574139 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.574234 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.574455 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.574543 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.574759 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.574845 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.575063 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.575164 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.575398 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.575484 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.575709 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.575833 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.576020 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.576120 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.576315 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.576402 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.576617 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.576704 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.576920 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.577019 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.577222 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.577310 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.577521 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.577606 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.577822 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.577916 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.578126 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.578213 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.578431 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.578524 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.578731 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.578827 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.579035 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.579122 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.579363 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.579452 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.579663 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.579760 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.579968 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.580072 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.580332 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.580416 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.580644 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.580748 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.580947 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.581034 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.581253 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.581340 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.581562 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.581650 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.581869 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.581955 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.582168 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.582254 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.582474 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.582560 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.582770 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.582856 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.583080 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.583174 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.583408 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.583496 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.583716 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.583812 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.584028 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.584125 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.584335 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.584422 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.584656 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.584742 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.584962 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.585061 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.585263 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.585367 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.585561 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.585646 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.585859 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.586067 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.586154 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.586263 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.586452 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.586568 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.586871 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.586959 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.587167 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.587311 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.587488 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.587576 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.587791 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.587877 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.588099 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.588186 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.588394 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.588479 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.588692 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.588780 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.588991 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.589077 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.589295 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.589388 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.589590 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.589713 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.589905 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.590027 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.590311 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.590408 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.590615 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.590702 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.590911 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.590998 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.591229 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.591329 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.591539 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.591625 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.591863 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.591988 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.592166 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.592266 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.592471 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.592557 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.592778 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.592871 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.593098 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.593195 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.593399 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.593486 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.593700 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.593785 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.594015 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.594126 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.594330 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.594426 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.594638 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.594732 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.594945 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.595103 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.595262 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.595452 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.595581 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.596311 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.596454 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.596631 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.596795 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.596952 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.597113 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.597272 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.597519 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.597606 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.597838 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.597926 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.598143 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.598237 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.598454 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.598554 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.598772 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.598860 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.599072 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.599158 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.599396 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.599497 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.599698 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.599785 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.599995 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.600081 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.600294 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.600394 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.600612 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.600699 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.600909 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.600995 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.601212 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.601308 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.601515 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.601623 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.601818 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.601933 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.602116 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.602250 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.602414 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.602572 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.602727 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.602880 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.603026 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.603183 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.603375 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.603513 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.603684 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.603815 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.604000 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.604120 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.604318 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.604442 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.604619 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.604742 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.604934 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.605052 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.605236 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.605361 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.605534 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.605668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.605830 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.605968 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.606125 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.606268 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.606462 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.606586 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.606762 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.606888 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.607076 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.607241 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.607424 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.607523 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.607745 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.607832 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.608046 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.608137 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.608370 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.608472 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.608691 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.608777 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.609002 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.609097 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.609314 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.609401 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.609614 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.609708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.609915 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.610001 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.610213 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.610302 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.610517 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.610613 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.610816 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.610904 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.611113 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.611201 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.612027 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.612156 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.612360 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.612460 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.612660 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.612750 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.612958 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.613047 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.613257 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.613359 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.613573 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.613669 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.613872 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.613960 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.614188 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.614291 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.614498 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.614585 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.614793 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.614880 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.615092 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.615194 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.615417 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.615510 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.615720 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.615806 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.616028 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.616130 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.616328 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.616457 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.616628 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.616725 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.616928 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.617019 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.617239 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.617327 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.617538 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.617624 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.617845 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.617940 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.618148 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.618235 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.618449 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.618537 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.618751 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.618840 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.619050 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.619146 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.619378 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.619480 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.619691 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.619788 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.620002 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.620098 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.620307 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.620407 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.620626 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.620816 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.620942 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.621138 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.621257 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.621449 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.621570 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.621757 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.621882 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.622066 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.622195 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.622375 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.622508 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.622682 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.622826 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.622990 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.623136 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.623318 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.623484 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.623626 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.623795 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.623934 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.624110 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.624261 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.624578 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.624666 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.624898 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.624995 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.625225 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.625314 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.625534 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.625623 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.625840 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.625927 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.626148 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.626237 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.626454 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.626582 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.626762 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.626864 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.627118 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.627322 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.627451 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.627675 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.627777 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.627989 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.628128 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.628301 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.628390 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.628614 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.628716 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.628922 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.629010 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.629229 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.629330 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.629540 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.629637 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.629849 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.629938 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.630157 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.630247 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.630462 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.630568 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.630772 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.630861 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.631079 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.631167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.631433 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.631532 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.631748 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.631841 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.632060 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.632150 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.632366 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.632454 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.632673 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.632760 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.632981 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.633068 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.633290 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.633493 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.633589 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.633803 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.633890 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.634130 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.634219 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.634452 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.634580 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.634771 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.634858 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.635080 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.635169 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.635415 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.635515 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.635737 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.635824 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.636037 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.636126 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.636335 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.636422 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.636639 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.636907 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.636996 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.637221 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.637309 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.637536 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.637623 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.637843 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.637932 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.638141 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.638230 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.638455 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.638543 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.638759 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.638847 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.639079 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.639306 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.639420 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.639650 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.639756 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.639963 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.640052 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.640282 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.640370 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.640599 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.640695 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.640908 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.640995 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.641208 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.641296 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.641507 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.641594 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.641815 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.641903 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.642113 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.642201 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.642423 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.642687 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.642799 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.643034 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.643130 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.643379 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.643489 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.643687 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.643775 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.643993 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.644081 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.644299 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.644387 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.644605 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.644693 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.644904 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.644991 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.645215 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.645303 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.645513 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.645599 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.645811 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.645903 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.646109 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.646206 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.646409 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.646496 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.646704 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.646836 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.647001 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.647099 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.647322 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.647413 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.647621 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.647722 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.647926 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.648014 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.648225 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.648311 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.648529 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.648628 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.648828 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.648916 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.649127 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.649213 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.649422 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.649518 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.649727 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.649814 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.650030 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.650126 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.650329 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.650427 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.650630 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.650717 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.650928 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.651017 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.651261 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.651351 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.651566 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.651651 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.651875 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.651962 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.652176 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.652266 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.652479 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.652565 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.652783 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.652869 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.653090 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.653180 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.653446 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.653626 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.653770 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.653953 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.654074 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.654272 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.654361 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.654598 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.654686 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.654923 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.655014 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.655258 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.655365 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.655545 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.655636 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.655847 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.655937 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.656165 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.656253 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.656472 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.656568 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.656778 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.657043 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.657134 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.657373 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.657462 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.657676 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.657777 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.657981 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.658077 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.658809 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.658911 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.659116 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.659256 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.659444 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.659536 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.659747 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.659836 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.660050 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.660141 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.660353 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.660442 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.660655 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.660751 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.660957 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.661046 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.661264 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.661360 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.661598 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.661701 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.661910 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.661998 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.662218 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.662304 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.662526 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.662623 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.662833 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.662921 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.663132 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.663263 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.663463 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.663566 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.663768 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.663863 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.664070 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.664157 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.664376 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.664463 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.664689 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.664777 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.664995 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.665082 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.665294 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.665383 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.665628 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.665714 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.665940 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.666028 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.666254 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.666343 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.666562 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.666650 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.666869 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.667007 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.667177 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.667328 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.667506 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.667594 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.667812 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.667912 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.668129 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.668217 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.668434 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.668522 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.668735 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.668835 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.669072 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.669160 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.669393 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.669488 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.669709 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.669807 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.670010 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.670099 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.670308 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.670397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.670605 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.670694 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.670908 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.670996 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.671252 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.671343 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.671542 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.671631 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.671839 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.671927 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.672136 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.672223 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.672438 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.672528 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.672736 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.672823 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.673033 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.673130 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.673332 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.673420 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.673630 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.673726 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.674482 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.674652 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.674788 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.675085 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.675173 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.675407 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.675496 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.675706 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.675803 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.676002 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.676090 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.676297 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.676386 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.676600 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.676689 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.676898 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.676986 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.677195 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.677293 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.677490 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.677578 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.677785 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.677885 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.678079 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.678182 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.678381 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.678468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.678684 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.678779 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.678988 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.679090 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.679315 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.679407 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.679617 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.679705 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.679917 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.680007 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.680222 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.680310 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.680523 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.680619 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.680823 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.680920 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.681123 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.681218 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.681422 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.681510 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.681721 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.681810 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.682036 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.682122 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.682341 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.682428 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.682644 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.682733 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.682949 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.683036 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.683276 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.683379 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.683837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.683933 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.684156 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.684291 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.684471 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.684635 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.684777 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.684866 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.685089 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.685184 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.685399 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.685496 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.685715 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.685862 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.686023 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.686146 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.686328 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.686426 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.686636 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.686723 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.686944 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.687030 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.687270 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.687362 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.687582 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.687669 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.687886 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.687974 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.688193 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.688289 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.688501 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.688588 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.688807 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.688910 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.689113 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.689209 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.689482 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.689568 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.689853 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.690008 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.690181 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.690322 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.690506 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.690652 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.690816 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.690948 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.691140 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.691265 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.691489 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.691577 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.691830 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.691957 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.692140 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.692228 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.692477 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.692565 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.692788 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.692876 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.693098 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.693188 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.693402 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.693489 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.693707 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.693848 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.693938 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 14:34:00.694039 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.694364 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.694675 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.695000 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.695344 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.695690 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.696004 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.696344 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.696672 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.696984 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.697297 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.697601 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:34:00.697845 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112097) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 14:34:00.849496 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO dbcounter [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] Registered counter for database nova_api Aug 30 14:34:00.852814 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO dbcounter [None req-816254dd-9677-47e6-a688-42954a47453d None None] Registered counter for database nova_api Aug 30 14:34:00.869337 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG oslo_db.sqlalchemy.engines [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:34:00.871397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_db.sqlalchemy.engines [None req-816254dd-9677-47e6-a688-42954a47453d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:34:00.875830 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG dbcounter [-] [112099] Writer thread running {{(pid=112099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:34:00.877869 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG dbcounter [-] [112097] Writer thread running {{(pid=112097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:34:00.931786 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.context [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fe2fd645-a23d-4fcb-9457-49d884190a04(cell1) {{(pid=112099) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 14:34:00.934479 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.context [None req-816254dd-9677-47e6-a688-42954a47453d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fe2fd645-a23d-4fcb-9457-49d884190a04(cell1) {{(pid=112097) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 14:34:00.935896 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG oslo_concurrency.lockutils [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:34:00.936367 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG oslo_concurrency.lockutils [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:34:00.937895 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG oslo_concurrency.lockutils [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:34:00.938284 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-816254dd-9677-47e6-a688-42954a47453d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:34:00.938608 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG oslo_concurrency.lockutils [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:34:00.938756 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-816254dd-9677-47e6-a688-42954a47453d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:34:00.939051 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG oslo_concurrency.lockutils [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:34:00.940682 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-816254dd-9677-47e6-a688-42954a47453d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:34:00.941070 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG oslo_concurrency.lockutils [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:34:00.941416 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-816254dd-9677-47e6-a688-42954a47453d None None] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:34:00.941859 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-816254dd-9677-47e6-a688-42954a47453d None None] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:34:00.943011 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO dbcounter [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] Registered counter for database nova_cell0 Aug 30 14:34:00.943849 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-816254dd-9677-47e6-a688-42954a47453d None None] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:34:00.945803 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO dbcounter [None req-816254dd-9677-47e6-a688-42954a47453d None None] Registered counter for database nova_cell0 Aug 30 14:34:00.946978 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO dbcounter [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] Registered counter for database nova_cell1 Aug 30 14:34:00.949775 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO dbcounter [None req-816254dd-9677-47e6-a688-42954a47453d None None] Registered counter for database nova_cell1 Aug 30 14:34:00.956422 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG oslo_db.sqlalchemy.engines [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:34:00.958354 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG oslo_db.sqlalchemy.engines [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:34:00.958524 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_db.sqlalchemy.engines [None req-816254dd-9677-47e6-a688-42954a47453d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:34:00.961836 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_db.sqlalchemy.engines [None req-816254dd-9677-47e6-a688-42954a47453d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:34:00.964322 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG dbcounter [-] [112099] Writer thread running {{(pid=112099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:34:00.964706 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG dbcounter [-] [112097] Writer thread running {{(pid=112097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:34:00.966703 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG dbcounter [-] [112099] Writer thread running {{(pid=112099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:34:01.102743 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG dbcounter [-] [112097] Writer thread running {{(pid=112097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:34:01.109722 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO dbcounter [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] Registered counter for database nova_cell0 Aug 30 14:34:01.111379 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO dbcounter [None req-816254dd-9677-47e6-a688-42954a47453d None None] Registered counter for database nova_cell0 Aug 30 14:34:01.118815 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG oslo_db.sqlalchemy.engines [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:34:01.121737 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_db.sqlalchemy.engines [None req-816254dd-9677-47e6-a688-42954a47453d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112097) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:34:01.123271 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG dbcounter [-] [112099] Writer thread running {{(pid=112099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:34:01.126334 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG dbcounter [-] [112097] Writer thread running {{(pid=112097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:34:01.460372 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: WARNING keystonemiddleware.auth_token [None req-816254dd-9677-47e6-a688-42954a47453d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:34:01.461835 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: WARNING keystonemiddleware.auth_token [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:34:01.467554 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: WARNING keystonemiddleware.auth_token [None req-816254dd-9677-47e6-a688-42954a47453d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:34:01.469071 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: WARNING keystonemiddleware.auth_token [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:34:01.809026 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: WARNING keystonemiddleware.auth_token [None req-816254dd-9677-47e6-a688-42954a47453d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:34:01.813623 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: WARNING keystonemiddleware.auth_token [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:34:01.815011 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: WARNING keystonemiddleware.auth_token [None req-816254dd-9677-47e6-a688-42954a47453d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:34:01.819625 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: WARNING keystonemiddleware.auth_token [None req-4df1a80e-e149-46a1-a3c3-dc973c520701 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:34:01.820228 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55562c4e99c0 pid: 112097 (default app) Aug 30 14:34:01.822288 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-816254dd-9677-47e6-a688-42954a47453d None None] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:34:01.823493 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-816254dd-9677-47e6-a688-42954a47453d None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001740 Aug 30 14:34:01.823902 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Tue Aug 30 14:34:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:34:01.824872 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55562c4e99c0 pid: 112099 (default app) Aug 30 14:35:19.714292 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-816254dd-9677-47e6-a688-42954a47453d None None] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:35:19.715343 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-816254dd-9677-47e6-a688-42954a47453d None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 30 14:35:19.715733 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 14:35:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:35:19.727690 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG dbcounter [-] [112099] Writing DB stats nova_api:SELECT=3 {{(pid=112099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:19.728811 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG dbcounter [-] [112099] Writing DB stats nova_cell1:SELECT=3 {{(pid=112099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:19.729652 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG dbcounter [-] [112099] Writing DB stats nova_cell0:SELECT=3 {{(pid=112099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:19.730733 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG dbcounter [-] [112099] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:20.599599 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-02a832c8-77e2-43c8-bac0-cdae09ef3a02 admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:35:20.632854 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-02a832c8-77e2-43c8-bac0-cdae09ef3a02 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.910300 Aug 30 14:35:20.633755 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 30 14:35:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:35:23.003639 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-816254dd-9677-47e6-a688-42954a47453d None None] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:35:23.005623 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-816254dd-9677-47e6-a688-42954a47453d None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001826 Aug 30 14:35:23.006845 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 14:35:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:35:23.462267 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-62691e72-aae5-45b8-8a94-85c3976359f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:23.514779 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-62691e72-aae5-45b8-8a94-85c3976359f3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.502107 Aug 30 14:35:23.516499 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 14:35:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:35:23.756485 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-9936db4a-5426-4050-b1a7-8a02764abde8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:23.762840 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG dbcounter [-] [112097] Writing DB stats nova_api:SELECT=3 {{(pid=112097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:23.763715 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG dbcounter [-] [112097] Writing DB stats nova_cell0:SELECT=3 {{(pid=112097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:23.764607 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG dbcounter [-] [112097] Writing DB stats nova_cell1:SELECT=3 {{(pid=112097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:23.765925 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG dbcounter [-] [112097] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:23.831149 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-9936db4a-5426-4050-b1a7-8a02764abde8 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.306081 Aug 30 14:35:23.832035 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Aug 30 14:35:23 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:35:26.219697 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-62691e72-aae5-45b8-8a94-85c3976359f3 admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:35:26.221380 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-62691e72-aae5-45b8-8a94-85c3976359f3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002307 Aug 30 14:35:26.222295 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 14:35:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:35:26.873124 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-71d85fd9-9c7f-4b62-bf9f-9cb78367ab03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "id": "d1"}} {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:26.913070 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-71d85fd9-9c7f-4b62-bf9f-9cb78367ab03 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.683716 Aug 30 14:35:26.913643 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 14:35:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:35:26.925801 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-72fb2bee-2503-4b39-993a-55a2085b63cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:26.962964 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-72fb2bee-2503-4b39-993a-55a2085b63cc admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040887 Aug 30 14:35:26.963821 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Aug 30 14:35:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:35:29.330465 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-71d85fd9-9c7f-4b62-bf9f-9cb78367ab03 admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:35:29.331508 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-71d85fd9-9c7f-4b62-bf9f-9cb78367ab03 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 30 14:35:29.331912 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 14:35:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:35:29.738697 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-5843d2de-7f57-4c88-baf2-cf7f9ec21a57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "id": "d2", "os-flavor-access:is_public": true}} {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:29.758171 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-5843d2de-7f57-4c88-baf2-cf7f9ec21a57 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.419980 Aug 30 14:35:29.758637 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 14:35:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:35:29.771223 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-7d63eb4d-a9a1-460c-a408-fa6edf9a486c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:29.794711 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-7d63eb4d-a9a1-460c-a408-fa6edf9a486c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027255 Aug 30 14:35:29.795301 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Aug 30 14:35:29 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:35:32.145647 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-5843d2de-7f57-4c88-baf2-cf7f9ec21a57 admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:35:32.146666 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-5843d2de-7f57-4c88-baf2-cf7f9ec21a57 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 30 14:35:32.147066 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 14:35:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:35:32.612655 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-3e8fea22-3479-4275-b912-a9143a1b160b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "id": "d3", "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:32.635658 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-3e8fea22-3479-4275-b912-a9143a1b160b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482231 Aug 30 14:35:32.636473 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 14:35:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:35:32.648974 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-57fd2ce9-4ea0-4788-9bd4-c73cc3f350c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:32.674682 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-57fd2ce9-4ea0-4788-9bd4-c73cc3f350c5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029405 Aug 30 14:35:32.679137 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Aug 30 14:35:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:35:35.053483 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-3e8fea22-3479-4275-b912-a9143a1b160b admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:35:35.054450 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-3e8fea22-3479-4275-b912-a9143a1b160b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 30 14:35:35.054902 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 14:35:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:35:35.500120 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-2aa8e356-130c-4561-a725-86658a736334 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:35.520099 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-2aa8e356-130c-4561-a725-86658a736334 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457196 Aug 30 14:35:35.521392 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 14:35:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:35:35.533316 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-81e5261a-04d9-4722-b7fd-636173444b7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:35.559481 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-81e5261a-04d9-4722-b7fd-636173444b7b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029823 Aug 30 14:35:35.564988 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Aug 30 14:35:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:35:37.910726 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-2aa8e356-130c-4561-a725-86658a736334 admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:35:37.911791 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-2aa8e356-130c-4561-a725-86658a736334 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 30 14:35:37.912199 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 14:35:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:35:38.329423 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-5d49c68a-6ec6-4b3a-96d5-e4db11c528aa admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:35:38.356824 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-5d49c68a-6ec6-4b3a-96d5-e4db11c528aa admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.438489 Aug 30 14:35:38.357762 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 30 14:35:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:35:41.780289 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-2aa8e356-130c-4561-a725-86658a736334 admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:35:41.781518 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-2aa8e356-130c-4561-a725-86658a736334 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001818 Aug 30 14:35:41.782060 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 14:35:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:35:42.194849 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-4b908b54-afc3-4687-8fd9-3d426eac5f71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "vcpus": 1, "id": "1"}} {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:42.214382 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-4b908b54-afc3-4687-8fd9-3d426eac5f71 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.425920 Aug 30 14:35:42.214935 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 14:35:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:35:42.227572 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-59212198-f3ef-48c8-bde6-096b481ff7ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:42.251997 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-59212198-f3ef-48c8-bde6-096b481ff7ba admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028288 Aug 30 14:35:42.252581 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Aug 30 14:35:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:35:44.598994 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-4b908b54-afc3-4687-8fd9-3d426eac5f71 admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:35:44.600176 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-4b908b54-afc3-4687-8fd9-3d426eac5f71 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Aug 30 14:35:44.600655 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 14:35:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:35:44.970619 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-6fa3aad8-64de-4400-a735-b710907c3205 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "id": "2"}} {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:44.989701 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-6fa3aad8-64de-4400-a735-b710907c3205 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.382802 Aug 30 14:35:44.990245 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 14:35:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:35:45.002850 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-ced870cc-c890-4d2e-a94f-98fc72cc51bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:45.029489 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-ced870cc-c890-4d2e-a94f-98fc72cc51bb admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030478 Aug 30 14:35:45.031571 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Aug 30 14:35:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:35:47.436462 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-6fa3aad8-64de-4400-a735-b710907c3205 admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:35:47.438261 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-6fa3aad8-64de-4400-a735-b710907c3205 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002866 Aug 30 14:35:47.438671 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 14:35:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:35:47.885924 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-452ba296-19b5-4442-bc42-edd79a3d3c16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "id": "3", "disk": 40, "ram": 4096}} {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:47.906552 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-452ba296-19b5-4442-bc42-edd79a3d3c16 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.461608 Aug 30 14:35:47.907102 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 14:35:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:35:47.918950 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-2a674988-2aa1-478b-9fd4-18a0d23efa80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:47.944629 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-2a674988-2aa1-478b-9fd4-18a0d23efa80 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029272 Aug 30 14:35:47.945488 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Aug 30 14:35:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:35:50.329432 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-452ba296-19b5-4442-bc42-edd79a3d3c16 admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:35:50.331178 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-452ba296-19b5-4442-bc42-edd79a3d3c16 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002186 Aug 30 14:35:50.336972 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 14:35:50 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:35:50.808635 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-0b4d7e55-d282-4dc7-9272-27e50afcbd7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "id": "4", "vcpus": 4}} {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:50.815524 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG dbcounter [-] [112099] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:35:50.837315 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-0b4d7e55-d282-4dc7-9272-27e50afcbd7c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.498943 Aug 30 14:35:50.838334 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 14:35:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:35:50.850604 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-77f85bbc-56fa-46d7-b58b-decc149fdc52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:50.877414 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-77f85bbc-56fa-46d7-b58b-decc149fdc52 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030948 Aug 30 14:35:50.891240 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Aug 30 14:35:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:35:53.294085 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-0b4d7e55-d282-4dc7-9272-27e50afcbd7c admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:35:53.295340 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-0b4d7e55-d282-4dc7-9272-27e50afcbd7c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 30 14:35:53.295890 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 14:35:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:35:53.744074 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-0caa8c24-6916-4e37-b098-a61c839e602a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "ram": 16384, "swap": 0, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:53.766794 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-0caa8c24-6916-4e37-b098-a61c839e602a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.464325 Aug 30 14:35:53.767410 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 30 14:35:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:35:53.779423 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-e6ef43f2-bf6d-4ccd-a3d0-43285b733461 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:35:53.829588 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-e6ef43f2-bf6d-4ccd-a3d0-43285b733461 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053780 Aug 30 14:35:53.830410 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Aug 30 14:35:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:36:11.985858 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-0caa8c24-6916-4e37-b098-a61c839e602a admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:11.986869 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-0caa8c24-6916-4e37-b098-a61c839e602a admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 30 14:36:11.987292 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 14:36:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:36:11.997644 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG dbcounter [-] [112099] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:12.378150 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-df25c6b6-c958-47a3-8cb3-8733aa2d4e93 admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:12.397912 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-df25c6b6-c958-47a3-8cb3-8733aa2d4e93 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404609 Aug 30 14:36:12.398457 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 30 14:36:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:36:13.444566 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-0caa8c24-6916-4e37-b098-a61c839e602a admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:13.445569 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-0caa8c24-6916-4e37-b098-a61c839e602a admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 30 14:36:13.445965 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 14:36:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:36:13.965501 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-3ad767a6-437a-4780-b174-0cea19cec6d5 admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:13.971002 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.wsgi [None req-3ad767a6-437a-4780-b174-0cea19cec6d5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-3ad767a6-437a-4780-b174-0cea19cec6d5 admin admin] Request method failure captured: Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Accept: application/json Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Accept-Encoding: gzip, deflate Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Connection: keep-alive Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Content-Length: 0 Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Host: 10.222.0.30 Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Openstack-Api-Version: compute 2.90 Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Openstack-System-Scope: None Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: User-Agent: python-novaclient Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Auth-Token: gAAAAABjDiBd29cjAnF0T_GsGPXe37TpCtjQ4PtuIKEX-hcV_cRDUq8gVId91bFJtCOOCFJKUMaibsQuv8emFBEyrw6f8yU-ucdJY__6XBn5_Za_U4q397J_KJhmfuREgVZz_EJn9Mbeijnssfp3mAkZxC2AL_0fpW-5p5nIyRVaXKgQmORc1SU Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Domain-Id: None Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Domain-Name: None Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Identity-Status: Confirmed Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Is-Admin-Project: True Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Project-Domain-Id: default Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Project-Domain-Name: Default Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Project-Id: 2ac908dcbf994029b1c39e157d0de0cb Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Project-Name: admin Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Role: member,admin,reader Aug 30 14:36:13.974202 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Roles: member,admin,reader Aug 30 14:36:13.975882 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ac908dcbf994029b1c39e157d0de0cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:36:13.975882 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Tenant: admin Aug 30 14:36:13.975882 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Tenant-Id: 2ac908dcbf994029b1c39e157d0de0cb Aug 30 14:36:13.975882 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Tenant-Name: admin Aug 30 14:36:13.975882 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-User: admin Aug 30 14:36:13.975882 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-User-Domain-Id: default Aug 30 14:36:13.975882 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-User-Domain-Name: Default Aug 30 14:36:13.975882 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-User-Id: 4a989d2c0a4a49eb9303e4db6cc0b7e8 Aug 30 14:36:13.975882 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-User-Name: admin Aug 30 14:36:13.975882 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: method: > Aug 30 14:36:13.975882 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: exception: Flavor 42 could not be found. Aug 30 14:36:13.975882 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: action_args: {'id': '42'} Aug 30 14:36:13.975882 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:36:13.975882 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:36:13.977108 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Aug 30 14:36:13.978468 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-3ad767a6-437a-4780-b174-0cea19cec6d5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:36:13.979774 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-3ad767a6-437a-4780-b174-0cea19cec6d5 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.392669 Aug 30 14:36:13.979774 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Aug 30 14:36:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 14:36:13.985422 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-dcc94d97-bb55-4505-8832-688ba6919b93 admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:13.989546 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG dbcounter [-] [112097] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:36:14.009298 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-dcc94d97-bb55-4505-8832-688ba6919b93 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027648 Aug 30 14:36:14.009862 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 30 14:36:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:36:14.020275 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-0ff1b915-fd80-41b0-ad22-618b7681635b admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:14.042304 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-0ff1b915-fd80-41b0-ad22-618b7681635b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025561 Aug 30 14:36:14.042834 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 30 14:36:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:36:14.052680 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-362eefa7-828a-4802-a30a-4bb5af7eef60 admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:14.058600 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.wsgi [None req-362eefa7-828a-4802-a30a-4bb5af7eef60 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-362eefa7-828a-4802-a30a-4bb5af7eef60 admin admin] Request method failure captured: Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Accept: application/json Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Accept-Encoding: gzip, deflate Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Connection: keep-alive Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Content-Length: 0 Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Host: 10.222.0.30 Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Openstack-Api-Version: compute 2.90 Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Openstack-System-Scope: None Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: User-Agent: python-novaclient Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Auth-Token: gAAAAABjDiBd29cjAnF0T_GsGPXe37TpCtjQ4PtuIKEX-hcV_cRDUq8gVId91bFJtCOOCFJKUMaibsQuv8emFBEyrw6f8yU-ucdJY__6XBn5_Za_U4q397J_KJhmfuREgVZz_EJn9Mbeijnssfp3mAkZxC2AL_0fpW-5p5nIyRVaXKgQmORc1SU Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Domain-Id: None Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Domain-Name: None Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Identity-Status: Confirmed Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Is-Admin-Project: True Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Project-Domain-Id: default Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Project-Domain-Name: Default Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Project-Id: 2ac908dcbf994029b1c39e157d0de0cb Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Project-Name: admin Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Role: member,admin,reader Aug 30 14:36:14.062668 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Roles: member,admin,reader Aug 30 14:36:14.064224 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ac908dcbf994029b1c39e157d0de0cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:36:14.064224 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Tenant: admin Aug 30 14:36:14.064224 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Tenant-Id: 2ac908dcbf994029b1c39e157d0de0cb Aug 30 14:36:14.064224 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Tenant-Name: admin Aug 30 14:36:14.064224 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-User: admin Aug 30 14:36:14.064224 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-User-Domain-Id: default Aug 30 14:36:14.064224 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-User-Domain-Name: Default Aug 30 14:36:14.064224 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-User-Id: 4a989d2c0a4a49eb9303e4db6cc0b7e8 Aug 30 14:36:14.064224 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-User-Name: admin Aug 30 14:36:14.064224 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: method: > Aug 30 14:36:14.064224 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: exception: Flavor 42 could not be found. Aug 30 14:36:14.064224 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: action_args: {'id': '42'} Aug 30 14:36:14.064224 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:36:14.064224 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:36:14.065076 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Aug 30 14:36:14.066167 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-362eefa7-828a-4802-a30a-4bb5af7eef60 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:36:14.067161 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-362eefa7-828a-4802-a30a-4bb5af7eef60 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015284 Aug 30 14:36:14.067161 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Aug 30 14:36:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 14:36:15.036589 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-0ff1b915-fd80-41b0-ad22-618b7681635b admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:15.037592 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-0ff1b915-fd80-41b0-ad22-618b7681635b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 30 14:36:15.037981 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 14:36:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:36:15.562933 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-9b7eec8f-3605-411e-939c-38f9658f70f8 admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:15.568189 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.wsgi [None req-9b7eec8f-3605-411e-939c-38f9658f70f8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-9b7eec8f-3605-411e-939c-38f9658f70f8 admin admin] Request method failure captured: Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Accept: application/json Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Accept-Encoding: gzip, deflate Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Connection: keep-alive Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Content-Length: 0 Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Host: 10.222.0.30 Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Openstack-Api-Version: compute 2.90 Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Openstack-System-Scope: None Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: User-Agent: python-novaclient Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Auth-Token: gAAAAABjDiBewZPbJ3w3Vhl_x9P2-BruN9EejF6s7RtZ4EEErKwAIXIUlQMpxrwy89b0n7buzvjlV8QhVLEuD5adqtuMxiwcLO1i4SpFWEUSS6bmsVzRo1vZ6_gkeMzQf_lyMT0tIfgHCLl4BUo_Nv1s_hhNIEPH9kt6tqbgckMWl4HnO8rYqXs Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Domain-Id: None Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Domain-Name: None Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Identity-Status: Confirmed Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Is-Admin-Project: True Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Project-Domain-Id: default Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Project-Domain-Name: Default Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Project-Id: 2ac908dcbf994029b1c39e157d0de0cb Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Project-Name: admin Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Role: member,admin,reader Aug 30 14:36:15.569674 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Roles: member,admin,reader Aug 30 14:36:15.571165 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ac908dcbf994029b1c39e157d0de0cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:36:15.571165 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Tenant: admin Aug 30 14:36:15.571165 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Tenant-Id: 2ac908dcbf994029b1c39e157d0de0cb Aug 30 14:36:15.571165 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Tenant-Name: admin Aug 30 14:36:15.571165 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-User: admin Aug 30 14:36:15.571165 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-User-Domain-Id: default Aug 30 14:36:15.571165 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-User-Domain-Name: Default Aug 30 14:36:15.571165 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-User-Id: 4a989d2c0a4a49eb9303e4db6cc0b7e8 Aug 30 14:36:15.571165 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-User-Name: admin Aug 30 14:36:15.571165 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: method: > Aug 30 14:36:15.571165 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: exception: Flavor 84 could not be found. Aug 30 14:36:15.571165 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: action_args: {'id': '84'} Aug 30 14:36:15.571165 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:36:15.571165 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:36:15.572042 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Aug 30 14:36:15.573112 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-9b7eec8f-3605-411e-939c-38f9658f70f8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:36:15.574101 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-9b7eec8f-3605-411e-939c-38f9658f70f8 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394700 Aug 30 14:36:15.574101 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Aug 30 14:36:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 14:36:15.581394 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-942df866-494c-4331-9588-a9eba22531a8 admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:15.596424 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-942df866-494c-4331-9588-a9eba22531a8 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018658 Aug 30 14:36:15.596947 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 30 14:36:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:36:15.606297 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-e3dbcf6f-f53c-4752-b6d0-cdd0f9317327 admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:15.621771 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-e3dbcf6f-f53c-4752-b6d0-cdd0f9317327 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018970 Aug 30 14:36:15.622283 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 30 14:36:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:36:15.632305 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-3db16862-10a6-4c49-a6d1-0d2a2b03dc64 admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:15.637500 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.wsgi [None req-3db16862-10a6-4c49-a6d1-0d2a2b03dc64 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-3db16862-10a6-4c49-a6d1-0d2a2b03dc64 admin admin] Request method failure captured: Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Accept: application/json Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Accept-Encoding: gzip, deflate Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Connection: keep-alive Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Content-Length: 0 Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Host: 10.222.0.30 Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Openstack-Api-Version: compute 2.90 Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Openstack-System-Scope: None Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: User-Agent: python-novaclient Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Auth-Token: gAAAAABjDiBewZPbJ3w3Vhl_x9P2-BruN9EejF6s7RtZ4EEErKwAIXIUlQMpxrwy89b0n7buzvjlV8QhVLEuD5adqtuMxiwcLO1i4SpFWEUSS6bmsVzRo1vZ6_gkeMzQf_lyMT0tIfgHCLl4BUo_Nv1s_hhNIEPH9kt6tqbgckMWl4HnO8rYqXs Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Domain-Id: None Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Domain-Name: None Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Identity-Status: Confirmed Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Is-Admin-Project: True Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Project-Domain-Id: default Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Project-Domain-Name: Default Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Project-Id: 2ac908dcbf994029b1c39e157d0de0cb Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Project-Name: admin Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Role: member,admin,reader Aug 30 14:36:15.639645 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Roles: member,admin,reader Aug 30 14:36:15.641278 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ac908dcbf994029b1c39e157d0de0cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:36:15.641278 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Tenant: admin Aug 30 14:36:15.641278 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Tenant-Id: 2ac908dcbf994029b1c39e157d0de0cb Aug 30 14:36:15.641278 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Tenant-Name: admin Aug 30 14:36:15.641278 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-User: admin Aug 30 14:36:15.641278 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-User-Domain-Id: default Aug 30 14:36:15.641278 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-User-Domain-Name: Default Aug 30 14:36:15.641278 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-User-Id: 4a989d2c0a4a49eb9303e4db6cc0b7e8 Aug 30 14:36:15.641278 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-User-Name: admin Aug 30 14:36:15.641278 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: method: > Aug 30 14:36:15.641278 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: exception: Flavor 84 could not be found. Aug 30 14:36:15.641278 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: action_args: {'id': '84'} Aug 30 14:36:15.641278 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:36:15.641278 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:36:15.642287 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Aug 30 14:36:15.643708 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-3db16862-10a6-4c49-a6d1-0d2a2b03dc64 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:36:15.644907 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-3db16862-10a6-4c49-a6d1-0d2a2b03dc64 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012268 Aug 30 14:36:15.644907 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Aug 30 14:36:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 14:36:16.608923 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-e3dbcf6f-f53c-4752-b6d0-cdd0f9317327 admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:16.610101 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-e3dbcf6f-f53c-4752-b6d0-cdd0f9317327 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002507 Aug 30 14:36:16.610495 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 14:36:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:36:17.126936 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-044bdb0b-32b4-4660-8fa7-eef0412633fd admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:17.132727 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.wsgi [None req-044bdb0b-32b4-4660-8fa7-eef0412633fd admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-044bdb0b-32b4-4660-8fa7-eef0412633fd admin admin] Request method failure captured: Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Accept: application/json Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Accept-Encoding: gzip, deflate Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Connection: keep-alive Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Content-Length: 0 Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Host: 10.222.0.30 Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Openstack-Api-Version: compute 2.90 Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Openstack-System-Scope: None Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: User-Agent: python-novaclient Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Auth-Token: gAAAAABjDiBgpgg6e5X4h7H2_J-uj6EHpCymWT7_bCWkebAWixrWWrr_6vDQT2-RQfLs3HJR5tzKRi-TAFG5sVwjgRgu4640W0XKCO-VLovrVcd6iUzGHHk7togm612ABN_a6NAZyPahwHxwG4igH2-PYDsGmsx3cFStP-wfX7yyJfb4Zttyeug Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Domain-Id: None Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Domain-Name: None Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Identity-Status: Confirmed Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Is-Admin-Project: True Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Project-Domain-Id: default Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Project-Domain-Name: Default Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Project-Id: 2ac908dcbf994029b1c39e157d0de0cb Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Project-Name: admin Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Role: member,admin,reader Aug 30 14:36:17.134230 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Roles: member,admin,reader Aug 30 14:36:17.135789 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ac908dcbf994029b1c39e157d0de0cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:36:17.135789 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Tenant: admin Aug 30 14:36:17.135789 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Tenant-Id: 2ac908dcbf994029b1c39e157d0de0cb Aug 30 14:36:17.135789 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-Tenant-Name: admin Aug 30 14:36:17.135789 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-User: admin Aug 30 14:36:17.135789 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-User-Domain-Id: default Aug 30 14:36:17.135789 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-User-Domain-Name: Default Aug 30 14:36:17.135789 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-User-Id: 4a989d2c0a4a49eb9303e4db6cc0b7e8 Aug 30 14:36:17.135789 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: X-User-Name: admin Aug 30 14:36:17.135789 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: method: > Aug 30 14:36:17.135789 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: exception: Flavor 451 could not be found. Aug 30 14:36:17.135789 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: action_args: {'id': '451'} Aug 30 14:36:17.135789 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:36:17.135789 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:36:17.136689 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: ERROR nova.api.openstack.wsgi Aug 30 14:36:17.137837 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-044bdb0b-32b4-4660-8fa7-eef0412633fd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:36:17.139526 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-044bdb0b-32b4-4660-8fa7-eef0412633fd admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.388599 Aug 30 14:36:17.139526 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 30 14:36:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 14:36:17.145817 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-0faefdb3-8bb4-413e-ac1c-729dacf2c009 admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:17.161234 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-0faefdb3-8bb4-413e-ac1c-729dacf2c009 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018950 Aug 30 14:36:17.161747 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 30 14:36:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:36:17.171046 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-43d9c0d2-b9f1-4c98-adc7-3d637b68318f admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:17.186853 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-43d9c0d2-b9f1-4c98-adc7-3d637b68318f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019430 Aug 30 14:36:17.187436 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 30 14:36:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:36:17.196433 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-e281b195-cade-46a1-b5bd-2bcd2f9540ce admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:17.202302 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.wsgi [None req-e281b195-cade-46a1-b5bd-2bcd2f9540ce admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-e281b195-cade-46a1-b5bd-2bcd2f9540ce admin admin] Request method failure captured: Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Accept: application/json Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Accept-Encoding: gzip, deflate Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Connection: keep-alive Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Content-Length: 0 Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Host: 10.222.0.30 Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Openstack-Api-Version: compute 2.90 Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Openstack-System-Scope: None Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: User-Agent: python-novaclient Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Auth-Token: gAAAAABjDiBgpgg6e5X4h7H2_J-uj6EHpCymWT7_bCWkebAWixrWWrr_6vDQT2-RQfLs3HJR5tzKRi-TAFG5sVwjgRgu4640W0XKCO-VLovrVcd6iUzGHHk7togm612ABN_a6NAZyPahwHxwG4igH2-PYDsGmsx3cFStP-wfX7yyJfb4Zttyeug Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Domain-Id: None Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Domain-Name: None Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Identity-Status: Confirmed Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Is-Admin-Project: True Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Project-Domain-Id: default Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Project-Domain-Name: Default Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Project-Id: 2ac908dcbf994029b1c39e157d0de0cb Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Project-Name: admin Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Role: member,admin,reader Aug 30 14:36:17.203808 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Roles: member,admin,reader Aug 30 14:36:17.205397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2ac908dcbf994029b1c39e157d0de0cb", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2ac908dcbf994029b1c39e157d0de0cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:36:17.205397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Tenant: admin Aug 30 14:36:17.205397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Tenant-Id: 2ac908dcbf994029b1c39e157d0de0cb Aug 30 14:36:17.205397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-Tenant-Name: admin Aug 30 14:36:17.205397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-User: admin Aug 30 14:36:17.205397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-User-Domain-Id: default Aug 30 14:36:17.205397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-User-Domain-Name: Default Aug 30 14:36:17.205397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-User-Id: 4a989d2c0a4a49eb9303e4db6cc0b7e8 Aug 30 14:36:17.205397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: X-User-Name: admin Aug 30 14:36:17.205397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: method: > Aug 30 14:36:17.205397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: exception: Flavor 451 could not be found. Aug 30 14:36:17.205397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: action_args: {'id': '451'} Aug 30 14:36:17.205397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:36:17.205397 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:36:17.206238 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: ERROR nova.api.openstack.wsgi Aug 30 14:36:17.207377 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-e281b195-cade-46a1-b5bd-2bcd2f9540ce admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112097) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:36:17.208364 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-e281b195-cade-46a1-b5bd-2bcd2f9540ce admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012156 Aug 30 14:36:17.208571 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 30 14:36:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 14:36:18.166472 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-43d9c0d2-b9f1-4c98-adc7-3d637b68318f admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:18.167509 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-43d9c0d2-b9f1-4c98-adc7-3d637b68318f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 30 14:36:18.167909 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 14:36:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:36:18.700182 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-aa95b28a-cb85-41fb-8274-f5b10f372bc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:36:18.721486 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-aa95b28a-cb85-41fb-8274-f5b10f372bc0 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.415118 Aug 30 14:36:18.722037 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Aug 30 14:36:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:36:19.686411 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-43d9c0d2-b9f1-4c98-adc7-3d637b68318f admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:19.687581 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-43d9c0d2-b9f1-4c98-adc7-3d637b68318f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001898 Aug 30 14:36:19.688007 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 14:36:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:36:20.216574 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-44f54a8f-14de-4c0b-974e-a3ba52129818 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:36:20.234677 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-44f54a8f-14de-4c0b-974e-a3ba52129818 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.406456 Aug 30 14:36:20.235233 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Aug 30 14:36:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:36:21.202833 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-43d9c0d2-b9f1-4c98-adc7-3d637b68318f admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:21.203882 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-43d9c0d2-b9f1-4c98-adc7-3d637b68318f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 30 14:36:21.204281 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 14:36:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:36:21.728004 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-3c965aea-1352-4b1b-b957-c029ac408722 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:36:21.748427 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-3c965aea-1352-4b1b-b957-c029ac408722 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.406554 Aug 30 14:36:21.748979 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Aug 30 14:36:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:36:22.713286 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-43d9c0d2-b9f1-4c98-adc7-3d637b68318f admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:22.714293 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-43d9c0d2-b9f1-4c98-adc7-3d637b68318f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 30 14:36:22.714690 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 14:36:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:36:23.241956 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-915fb466-6874-45d4-89ca-ec03f1c774c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:36:23.260599 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-915fb466-6874-45d4-89ca-ec03f1c774c2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.406232 Aug 30 14:36:23.261121 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Aug 30 14:36:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:36:24.222335 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-43d9c0d2-b9f1-4c98-adc7-3d637b68318f admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:24.223365 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-43d9c0d2-b9f1-4c98-adc7-3d637b68318f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 30 14:36:24.223762 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 14:36:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:36:24.746750 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-e6f7e0c9-0002-4279-a0fd-81435acac44b admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:36:24.767514 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-e6f7e0c9-0002-4279-a0fd-81435acac44b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404347 Aug 30 14:36:24.768045 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Tue Aug 30 14:36:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:37:18.132201 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-43d9c0d2-b9f1-4c98-adc7-3d637b68318f admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:18.133214 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-43d9c0d2-b9f1-4c98-adc7-3d637b68318f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 30 14:37:18.133617 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 30 14:37:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:37:18.144100 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG dbcounter [-] [112097] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:18.524794 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-dd8128f1-7659-42d1-a51d-caea17960d5e admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:18.546346 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-dd8128f1-7659-42d1-a51d-caea17960d5e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406797 Aug 30 14:37:18.546880 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 30 14:37:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:37:18.567889 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG dbcounter [-] [112099] Writing DB stats nova_api:SELECT=14 {{(pid=112099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:37:18.571926 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-fd4f655c-6bc2-48bf-b132-b9bd4113a83e admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:18.579597 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-fd4f655c-6bc2-48bf-b132-b9bd4113a83e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013104 Aug 30 14:37:18.580106 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1283 bytes} [Tue Aug 30 14:37:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:18.592351 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-7c73a2d2-dbe8-474a-ac00-b9ae710f2d34 admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:18.600172 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-7c73a2d2-dbe8-474a-ac00-b9ae710f2d34 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011938 Aug 30 14:37:18.600681 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1286 bytes} [Tue Aug 30 14:37:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:18.612572 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-cee9198e-cc10-4efd-b1d4-17e4998b534b admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:18.620205 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-cee9198e-cc10-4efd-b1d4-17e4998b534b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011192 Aug 30 14:37:18.620715 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1286 bytes} [Tue Aug 30 14:37:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:37:18.632019 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-4286cba6-4275-4250-9151-e751391338ec admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:37:18.639509 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-4286cba6-4275-4250-9151-e751391338ec admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010886 Aug 30 14:37:18.640016 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1283 bytes} [Tue Aug 30 14:37:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:40:18.516007 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-cee9198e-cc10-4efd-b1d4-17e4998b534b admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:40:18.517104 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-cee9198e-cc10-4efd-b1d4-17e4998b534b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001634 Aug 30 14:40:18.517503 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 14:40:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:40:18.662838 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG dbcounter [-] [112097] Writing DB stats nova_api:SELECT=6 {{(pid=112097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:18.824887 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-88434ab5-c679-4b9a-abca-14b198b7d9cb admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:40:18.828519 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-88434ab5-c679-4b9a-abca-14b198b7d9cb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:40:18.829722 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-88434ab5-c679-4b9a-abca-14b198b7d9cb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:40:18.830302 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-88434ab5-c679-4b9a-abca-14b198b7d9cb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:40:18.831360 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-88434ab5-c679-4b9a-abca-14b198b7d9cb admin admin] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:40:18.831988 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-88434ab5-c679-4b9a-abca-14b198b7d9cb admin admin] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:40:18.832481 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-88434ab5-c679-4b9a-abca-14b198b7d9cb admin admin] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:40:18.867701 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-88434ab5-c679-4b9a-abca-14b198b7d9cb admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.206276 Aug 30 14:40:18.868447 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 30 14:40:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:40:19.694737 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-cee9198e-cc10-4efd-b1d4-17e4998b534b admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:40:19.695788 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-cee9198e-cc10-4efd-b1d4-17e4998b534b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 30 14:40:19.696181 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 14:40:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:40:19.888019 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-03c1d2e4-6265-4f0d-826d-0924e99d6f32 admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:40:19.892356 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-03c1d2e4-6265-4f0d-826d-0924e99d6f32 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:40:19.892850 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-03c1d2e4-6265-4f0d-826d-0924e99d6f32 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:40:19.893278 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-03c1d2e4-6265-4f0d-826d-0924e99d6f32 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:40:19.893980 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-03c1d2e4-6265-4f0d-826d-0924e99d6f32 admin admin] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:40:19.894420 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-03c1d2e4-6265-4f0d-826d-0924e99d6f32 admin admin] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:40:19.894835 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-03c1d2e4-6265-4f0d-826d-0924e99d6f32 admin admin] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:40:19.914844 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-03c1d2e4-6265-4f0d-826d-0924e99d6f32 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077745 Aug 30 14:40:19.915743 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 30 14:40:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:40:31.162545 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-cee9198e-cc10-4efd-b1d4-17e4998b534b admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:40:31.163657 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-cee9198e-cc10-4efd-b1d4-17e4998b534b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 30 14:40:31.164052 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 14:40:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:40:31.310274 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG dbcounter [-] [112097] Writing DB stats nova_cell0:SELECT=4 {{(pid=112097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:31.310998 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG dbcounter [-] [112097] Writing DB stats nova_cell1:SELECT=4 {{(pid=112097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:31.311621 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG dbcounter [-] [112097] Writing DB stats nova_api:SELECT=8 {{(pid=112097) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:40:31.361608 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-530b5467-36cf-4444-988b-1380e02b27d3 admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:40:31.364966 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-530b5467-36cf-4444-988b-1380e02b27d3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:40:31.365433 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-530b5467-36cf-4444-988b-1380e02b27d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:40:31.365852 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-530b5467-36cf-4444-988b-1380e02b27d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:40:31.366548 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-530b5467-36cf-4444-988b-1380e02b27d3 admin admin] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:40:31.366988 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-530b5467-36cf-4444-988b-1380e02b27d3 admin admin] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:40:31.367425 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-530b5467-36cf-4444-988b-1380e02b27d3 admin admin] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:40:31.392717 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-530b5467-36cf-4444-988b-1380e02b27d3 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086833 Aug 30 14:40:31.393257 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 30 14:40:31 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:40:32.221023 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: DEBUG nova.api.openstack.wsgi [None req-cee9198e-cc10-4efd-b1d4-17e4998b534b admin admin] Calling method '>' {{(pid=112099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:40:32.222037 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: INFO nova.api.openstack.requestlog [None req-cee9198e-cc10-4efd-b1d4-17e4998b534b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 30 14:40:32.222438 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: [pid: 112099|app: 0|req: 37/75] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 30 14:40:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:40:32.412188 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG nova.api.openstack.wsgi [None req-549d115a-c318-4fde-a0be-744c73d9302d admin admin] Calling method '>' {{(pid=112097) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:40:32.415669 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-549d115a-c318-4fde-a0be-744c73d9302d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:40:32.416148 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-549d115a-c318-4fde-a0be-744c73d9302d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:40:32.416579 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-549d115a-c318-4fde-a0be-744c73d9302d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:40:32.417325 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-549d115a-c318-4fde-a0be-744c73d9302d admin admin] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:40:32.417773 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-549d115a-c318-4fde-a0be-744c73d9302d admin admin] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:40:32.418191 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: DEBUG oslo_concurrency.lockutils [None req-549d115a-c318-4fde-a0be-744c73d9302d admin admin] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112097) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:40:32.440996 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: INFO nova.api.openstack.requestlog [None req-549d115a-c318-4fde-a0be-744c73d9302d admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079604 Aug 30 14:40:32.441481 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: [pid: 112097|app: 0|req: 39/76] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 30 14:40:32 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:41:28.981267 dv-cinder-828806-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 14:41:28.981845 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: Tue Aug 30 14:41:28 2022 - graceful shutdown triggered... Aug 30 14:41:28.982329 dv-cinder-828806-5-iscsi devstack@n-api.service[112097]: Gracefully killing worker 1 (pid: 112097)... Aug 30 14:41:28.983022 dv-cinder-828806-5-iscsi devstack@n-api.service[112099]: Gracefully killing worker 2 (pid: 112099)... Aug 30 14:41:29.982991 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: worker 1 buried after 1 seconds Aug 30 14:41:29.983589 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: worker 2 buried after 1 seconds Aug 30 14:41:29.983589 dv-cinder-828806-5-iscsi devstack@n-api.service[112096]: goodbye to uWSGI. Aug 30 14:41:29.985104 dv-cinder-828806-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 30 14:41:29.985696 dv-cinder-828806-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 14:41:29.988680 dv-cinder-828806-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 14:41:29.998514 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 14:41:30.002031 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 14:41:29 2022] *** Aug 30 14:41:30.002202 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 14:41:30.002337 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 14:41:30.002457 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: nodename: dv-cinder-828806-5-iscsi Aug 30 14:41:30.002582 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: machine: x86_64 Aug 30 14:41:30.002582 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: clock source: unix Aug 30 14:41:30.002582 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: pcre jit disabled Aug 30 14:41:30.002582 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: detected number of CPU cores: 4 Aug 30 14:41:30.002582 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: current working directory: / Aug 30 14:41:30.002582 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: detected binary path: /usr/bin/uwsgi-core Aug 30 14:41:30.002582 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: your processes number limit is 47680 Aug 30 14:41:30.002582 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: your memory page size is 4096 bytes Aug 30 14:41:30.002582 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: detected max file descriptor number: 2048 Aug 30 14:41:30.003179 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: lock engine: pthread robust mutexes Aug 30 14:41:30.003179 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: thunder lock: enabled Aug 30 14:41:30.003179 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 14:41:30.003179 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 14:41:30.041480 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: Python main interpreter initialized at 0x55b587c069c0 Aug 30 14:41:30.041480 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: python threads support enabled Aug 30 14:41:30.041480 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: your server socket listen backlog is limited to 100 connections Aug 30 14:41:30.041480 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: your mercy for graceful operations on workers is 90 seconds Aug 30 14:41:30.041911 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 14:41:30.041911 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: *** Operational MODE: preforking *** Aug 30 14:41:30.042168 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: *** uWSGI is running in multiple interpreter mode *** Aug 30 14:41:30.042168 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: spawned uWSGI master process (pid: 127076) Aug 30 14:41:30.042373 dv-cinder-828806-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 14:41:30.043623 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: spawned uWSGI worker 1 (pid: 127088, cores: 1) Aug 30 14:41:30.043623 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: spawned uWSGI worker 2 (pid: 127089, cores: 1) Aug 30 14:41:30.043623 dv-cinder-828806-5-iscsi devstack@n-api.service[127076]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 14:41:30.718043 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 14:41:30.732334 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 14:41:31.881928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:41:31.881928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: from cryptography.utils import int_from_bytes Aug 30 14:41:31.882573 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:41:31.882573 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: from cryptography.utils import int_from_bytes Aug 30 14:41:31.884427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:41:31.884427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: from cryptography.utils import int_from_bytes Aug 30 14:41:31.884855 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 14:41:31.884855 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: from cryptography.utils import int_from_bytes Aug 30 14:41:34.283683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 14:41:34.284465 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 14:41:34.284557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 14:41:34.284849 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 14:41:34.285110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 14:41:34.285505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.285831 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.286332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.286812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.287514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.287837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.288168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.288493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.288828 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.289096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.289417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.289748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-5-iscsi {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.290075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.290389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.290703 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.291027 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.291558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.291680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.292000 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.292516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.292965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.293442 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.293760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.294338 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.294892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.295235 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.295567 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.295879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.296289 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.297119 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.297689 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-5-iscsi {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.298177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.298506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.298818 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.299292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.299613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.299927 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.300252 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.300584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.300896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.301228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.301551 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.301873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.302196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.302502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.302813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.303147 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.303467 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.303784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.304090 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.304339 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.304651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.304975 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.305299 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.305624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.305874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.306124 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.306445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.306766 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.307093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.307412 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.307723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.308029 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.308332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.308636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.308940 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.309246 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.309566 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.309881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.310205 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.310510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.310830 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.311261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.311520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.311942 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.312289 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.312613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.312924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.313245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.313569 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.313883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.314190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.314497 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.315084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.315453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.315760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.316012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.316316 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.316623 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.316943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.317249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.317556 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.317867 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.318170 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.318477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.318782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.319087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.319419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.319726 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.320030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.320336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.320641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.320945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.321325 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.321593 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.321901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.322209 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.326146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.326146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.326146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.326146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.326146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.326146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.326146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.326146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.326725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.326725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.326725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.326725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.326725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.326725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.326725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.327441 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.327441 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.327636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.327962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.328367 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.328689 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.328998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.329299 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.329600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.329920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.330241 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.330549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.330853 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.331155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.331503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.331845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.332179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.332526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.332844 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.333176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.333509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.333833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.334148 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.334464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.334794 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.335106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.335445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.335760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.336080 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.336401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.336735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.337054 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.337370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.337690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.338001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.338319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.338651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.338973 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.339309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.339653 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.339998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.340313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.340641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.340966 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.341276 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.341586 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.341894 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.342212 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.342543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.342854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.343749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.344063 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.344386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.344697 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.345008 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.345318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.345628 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.345937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.346273 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.346585 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.346907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.347249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.347565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.347884 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.348194 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.348503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.348811 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.349116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.349421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.349730 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.350039 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.350346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.350669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.350998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.351336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.351675 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.351983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.352293 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.352603 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.352912 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.353218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.353437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 14:41:34.353875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.353955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 14:41:34.354033 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.354107 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.354308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 14:41:34.354556 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.354678 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 14:41:34.354821 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 14:41:34.354920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.355165 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.355351 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.355513 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.355598 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.355820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.355903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.356129 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.356227 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.356443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.356619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.356753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.356939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.357066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.357265 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.357377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.357587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.357684 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.357925 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.358026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.358188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.358298 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.358506 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.359487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.359610 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.359849 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.359967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-5-iscsi {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.360157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.360312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.360482 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.360633 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.360806 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.360953 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.361124 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.361277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.361428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.361591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.361737 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.361922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.362040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.362236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.362344 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.362646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.362758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.362955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.363076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.363281 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.363416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.363670 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.363810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.363903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.364192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.364297 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.364500 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.364646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.364746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.364833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.365150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.365312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.365540 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.365646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.365893 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.365988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.366208 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.366499 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.366718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.366813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-5-iscsi {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.367044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.367183 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.367476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.367578 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.367890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.367974 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.368221 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.368380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.368694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.368794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.369017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.369113 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.369339 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.369448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.369717 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.369802 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.369958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.370042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.370274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.370366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.370589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.370672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.370912 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.370994 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.371240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.371354 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.371566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.371668 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.371875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.371978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.372186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.372278 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.372505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.372597 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.372811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.372910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.373119 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.373220 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.373434 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.373647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.373779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.373969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.374116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.374513 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.374637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.374837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.375151 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.375302 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.375511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.375604 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.375791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.375951 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.376098 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.376264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.376418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.376576 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.376729 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.376873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.377025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.377169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.377314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.377466 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.377619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.377770 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.377920 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.378062 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.378231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.378376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.378520 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.378672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.378825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.378975 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.379133 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.379363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.379514 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.379687 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.380010 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.380157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.380330 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.380477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.380631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.380782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.380938 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.381089 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.381247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.381400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.381545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.381688 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.381840 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.382001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.382147 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.382301 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.382445 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.382589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.382739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.382892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.383043 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.383187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.383367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.383511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.383663 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.383816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.383959 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.384102 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.384254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.384404 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.384556 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.384709 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.384861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.385155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.385351 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.385517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.385679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.385827 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.385972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.386124 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.386854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.387030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.387187 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.387358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.387503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.387646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.387789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.387944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.388103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.388249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.388400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.388553 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.388697 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.388860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.389029 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.389174 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.389317 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.389467 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.389611 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.389761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.390712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.390896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.391046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.391198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.391407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.391570 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.391734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.391878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.392022 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.392172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.392172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.392172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.392602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.392755 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.392912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.393112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.393271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.393428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.393574 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.393735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.393879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.394036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.394195 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.394340 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.394483 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.394626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.394778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.394922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.395073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.395242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.395393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.395536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.395701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.395846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.395990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.396140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.396292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.396521 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.396669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.396812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.396955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.397106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.397260 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.397418 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.397562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.397727 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.397871 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.397871 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.398149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.398302 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.398447 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.398591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.398734 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.398877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.399045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.399401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.399575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.399732 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.399884 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.400036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.400193 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.400339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.400483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.400801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.400962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.401115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.401260 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.401403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.401556 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.401708 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.401885 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.402031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.402182 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.402326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.402470 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.402628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.402773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.402924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 14:41:34.403067 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.403237 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.403399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.403562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.403707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.403870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.404024 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.404176 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.404320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.404478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.404625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.404625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.404904 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.405046 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.405046 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.405335 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.405521 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.406201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.406349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.406493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.406647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.406801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.406954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.407098 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.407259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.407420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.407578 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.407578 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.407578 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.407990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.408145 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.408296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.408449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.408594 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.408744 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.408889 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.409052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.409211 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.409357 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.409510 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.409674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.409834 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.409998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.410169 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.410328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.410486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.410636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.410965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.411133 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.411514 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.411682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.411979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.412162 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.412316 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.412466 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.412637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.412796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.412947 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.413106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.413106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.413413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.413564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.413750 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.413909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.414070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.414227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.414386 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.414537 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.414698 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.414854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.415012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.415163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.415349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.415510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.415667 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.415837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.415990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.416149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.416309 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.416467 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.416617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.416776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.416926 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.417084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.417236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.417393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.417544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.417700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.417857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.418020 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.418171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.418330 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.418481 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.418630 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.418791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.418961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.418961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.419308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.419466 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.419624 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.419775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.419933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.420091 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.420241 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.420399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.420558 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.420719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.420896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.421230 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.421394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.421553 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.421711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.421875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.422026 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.422184 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.422342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.422502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.422652 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.422811 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.422973 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.423130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.423302 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.423457 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.423457 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.423758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.423917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.424150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.424343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.424499 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.424649 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.424809 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.424960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.424960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.425271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.425429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.425660 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.425820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.425978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.426136 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.426295 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.426473 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.426769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.426927 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.427085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.427309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.427487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.427649 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.427813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.427972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.428131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.428292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.428452 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.428602 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.428763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.428920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.429076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.429234 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.429393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.429568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.429727 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.429878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.430036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.430036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.430329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.430493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.430644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.430803 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.430983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.431162 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.431485 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.431670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.431822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.431974 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.432169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.432334 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.432536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.432536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.432832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.433002 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.433274 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.433433 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.433593 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.433754 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.433917 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.434069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.434220 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.434369 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.434534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.434694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.434854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.435007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.435167 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.435341 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.435510 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.435700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.435865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.436030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.436254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.436424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.436578 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.436729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.436880 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.437031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.437183 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.437393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.437579 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.437740 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.437901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.438051 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.438214 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.438374 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.438535 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.438686 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.438844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.439022 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.440100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.440297 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.440456 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.440608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.440769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.440930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.441103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.441256 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.441428 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.441757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.441757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.441757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.442206 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.442370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.442524 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.442675 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.442825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.442975 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.443136 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.443356 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.443512 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.443673 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.443832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.443983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.444144 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.444304 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.444466 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.444618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.444768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.444933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.445087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.445245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.445415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.445567 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.445717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.445877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.446035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.446035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.446331 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.446490 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.446642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.446642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.446946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.447098 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.447280 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.447449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.447610 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.447774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.447927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.448077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.448227 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.448378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.448528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.448689 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.448857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.449020 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.449172 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.449340 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.449502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.449654 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.449814 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.449965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.450116 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.450266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.450431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.450431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.450719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.450719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.451013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.451163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.451414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.451414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.451899 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.452069 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.452221 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.452888 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.453118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.453353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.453524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.453685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.453845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.454012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.454164 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.454326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.454475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.454633 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.454784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.454948 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.455100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.455281 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.455438 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.455596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.455746 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.455909 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.456069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.456228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.456398 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.456557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.456707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.456866 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.457018 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.457178 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.457328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.457485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.457646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.457798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.457947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.458105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.458277 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.458277 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.458578 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.458730 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.458899 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.459060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.459285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.459459 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.459670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.459834 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.459993 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.460145 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.460296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.460465 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.460700 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.460855 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.461014 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.461166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.461318 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.461477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.461636 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.461806 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.462138 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.462298 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.462449 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.462621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.462784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.462935 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.463086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.463333 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.463493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.463658 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.463811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.463962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.464121 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.464280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.464439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.464604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.464757 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.464922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.465074 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.465233 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.465397 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.465550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.465711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.465879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.466032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.466182 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.466341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.466494 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.466645 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.466804 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.466804 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.467100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.467295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.467454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.467454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.467739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.467889 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.468084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.468829 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.468986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.469138 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.469289 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.469450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.469616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.469769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.469928 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.470088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.470239 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.470398 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.470563 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.470716 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.470875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.471027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.471185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.471373 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.471550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.471712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.471870 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.472040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.472357 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.472523 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.472689 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.472842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.473001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.473001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.473632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.473803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.473965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.474128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.474280 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.474439 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.474591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.474755 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.474755 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.474755 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.475222 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.475384 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.475548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.475711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.475876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.476040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.476201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.476360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.476360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.476655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.476805 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.476964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.476964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.477266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.477417 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.477573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.477726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.477883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.478055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.478215 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.478367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.478524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.478682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.478844 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.479006 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.479166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.479377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.479538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.479690 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.479853 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.480013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.480183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.480344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.480502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.480502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.480802 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.480954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.481111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.481270 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.481422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.481572 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.481736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.481887 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.482036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.482036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.482524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.482683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.482844 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.483005 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.483156 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.483344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.483507 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.484295 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.484474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.484628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.484909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.485085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.485246 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.485495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.485666 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.485829 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.485981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.486131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.486281 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.486481 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.486646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.486800 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.486958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.487120 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.487356 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.487522 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.487681 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.487842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.488000 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.488151 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.488315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.488468 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.488627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.488785 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.488939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.489090 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.491688 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.491868 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.492029 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.492196 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.492349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.492709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.492873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.493028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.493178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.493339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.493491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.493657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.493824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.493824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.493824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.494263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.494430 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.494610 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.494765 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.494916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.495078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.495265 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.495424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.495585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.495744 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.495925 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.496078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.496239 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.496390 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.496550 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.496709 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.496863 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.497026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.497180 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.497338 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.497490 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.497649 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.497812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.497974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.498127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.498127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.498413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.498572 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.498731 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.498895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.499055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.499845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.500177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.500340 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.500492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.500675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.500836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.500988 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.501271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.501440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.501608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.501769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.501921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.502072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.502225 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.502419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.502602 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.502930 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.503111 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.503295 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.503493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.503650 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.503815 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.503976 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.504136 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.504297 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.504450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.504601 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.504766 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.504920 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.505078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.505251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.505251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.505549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.505711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.505711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.505998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.506150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.506300 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.506465 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.506616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.506778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.506931 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.507100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.507272 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.507442 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.507595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.507746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.507896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.508054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.508214 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.508381 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.508535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.508694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.508856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.509008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.509184 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.509338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.509497 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.509497 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.509793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.509952 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.510113 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.510219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.510219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.510219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.510219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.510219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.510678 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.510767 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.510852 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.510937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.511029 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.511198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.511399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.511523 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.511638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.511749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.511860 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.511980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.512146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.512298 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.512460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.512619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.512779 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.513120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.513280 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.513432 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.513591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.513751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.513903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.514064 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.514223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.514384 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.514547 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.514707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.514898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.515070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.515317 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.515478 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.515642 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.515796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.515947 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.516112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.516272 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.516423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.516581 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.516755 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.516922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.517075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.517783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.517948 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.518110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.518270 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.518432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.518593 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.518768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.518932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.519085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.519285 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.519471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.519624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.519776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.519776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.519776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.519776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.519776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.520485 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.520645 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.520805 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.520963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.520963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.521261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.521422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.521572 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.521724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.521874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.522035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.522187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.522187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.522489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.522641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.522792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.522952 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.523220 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.523394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.523546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.523707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.524019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.524019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.524421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.524421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.524749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.524908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.525070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.525224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.525376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.525541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.525541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.525852 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.526017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.526170 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.526321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.526486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.526639 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.526790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.526954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.527115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.527337 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.527505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.527676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.527843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.528004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.528163 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.528315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.528475 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.528625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.528795 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.528956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.529108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.529258 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.529410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.529568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.529741 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.529901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.530061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.530219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.530370 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.530562 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.530725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.530884 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.531044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.531202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.531380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.531617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.531617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.531919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.532077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.532237 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.532388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.532558 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.532710 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.532861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.533019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.533196 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.533434 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.533602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.533763 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.533926 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.534180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.534338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.534498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.534652 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.534803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.534961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.535120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.535304 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.535475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.535627 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.535779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.535937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.536107 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.536259 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.536424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.536577 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.536728 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.536879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.537028 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.537188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.537339 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.537497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.537657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.537817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.537978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.538144 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.538296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.538454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.538613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.538774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.538926 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.539162 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.539376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.539529 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.539690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.539850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.540001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.540001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.540001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.540450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.540609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.540767 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.540928 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.541087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.541238 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.541390 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.541541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.541698 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.541857 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.542010 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.542170 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.542321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.542478 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.542631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.542790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.542941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.543092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.543260 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.543534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.543711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.543944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.544108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.544369 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.544527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.544679 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.544844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.545004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.545157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.545308 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.545466 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.545617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.545777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.545929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.546668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.546936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.547228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.547489 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.547762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.548003 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.548164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.548318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.548469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.548627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.548792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.548992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.549157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.549319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.549471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.549642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.549803 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.549962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.550125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.550283 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.550442 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.550608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.550768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.550926 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.551078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.551259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.551419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.551594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.551754 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.551906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.552065 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.552215 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.552374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.552535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.552695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.552853 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.553006 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.553164 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.553329 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.553490 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.553763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.553920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.554078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.554229 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.554408 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.554654 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.554810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.554961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.555120 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.555302 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.555469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.555638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.555812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.555965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.556115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.556281 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.556435 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.556585 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.556737 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.556897 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.557057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.557218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.557370 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.557528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.557528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.557827 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.557988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.558148 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.558308 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.558459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.558621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.558782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.558933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.559092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.559302 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.559480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.559773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.559946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.560128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.560283 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.560433 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.560592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.560744 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.560896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.561056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.561208 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.561359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.561509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.561682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.562381 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.562558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 14:41:34.562712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.562712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.562712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.562712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.562712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.562712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.562712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.562712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.563972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.563972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.563972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.563972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.563972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.563972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.563972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.563972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.565495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.565495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.565495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.565495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.565495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.565495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.565495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.566495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.566495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.566495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.566495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.566495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.566495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.566495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.566495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.567689 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.567689 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.567689 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.567689 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.567689 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.567689 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.567689 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.567689 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.568861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.568861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.568861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.568861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.568861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.568861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.568861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.568861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.569969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.569969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.569969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.569969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.569969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.569969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.571553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.571553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.571553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.571553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.571553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.572642 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.572642 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.572949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.573268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.573596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.573928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.574261 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.574583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.574895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.575244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.575832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.576151 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.576473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.576789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.577098 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.578090 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.578429 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.578755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.579072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.579421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.579738 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.580073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.580390 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.580704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.581014 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.581331 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.581641 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.581952 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.582264 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.582574 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.582897 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.583226 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.583560 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.583873 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.584230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.584627 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.584949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.585331 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.585643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.585962 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.586418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.586788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.587126 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.587485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.587804 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.588122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.588482 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.588803 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.589374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.589715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.590040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.590383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.590720 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.591034 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.591379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.591693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.592023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.592340 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.592659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.592997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.593801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.594122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.594443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.594757 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.595073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.595431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.595749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.596063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.596376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.596690 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.597003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.597321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.597668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.597991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.598312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.598629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.598950 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.599287 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.599606 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.599921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.600233 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.600551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.600884 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.601205 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.601515 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.601950 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.602271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.602594 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.602924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.603265 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.603598 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.603926 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.604240 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.604565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.604878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.605211 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.605559 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.605894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.606223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.606533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.606842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.607150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.607488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.607813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.608258 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.609206 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.609648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.610001 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.610321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.610633 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.610950 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.611296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.611616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.611940 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.612237 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.612547 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.612859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.613178 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.613626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.613940 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.614249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.614560 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.614870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.615178 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.615514 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.615811 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO dbcounter [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] Registered counter for database nova_api Aug 30 14:41:34.616003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.616160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.616487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.616813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.617282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.617624 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.617936 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.618263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.618591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.618913 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.619252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.619595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.619911 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.620224 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.620539 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.620852 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.621166 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.621478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.621807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.622137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.622445 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.622777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.623105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.623456 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.623774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.624088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.625495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.625819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.626138 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.626456 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.626774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.627093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.627444 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.627761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.628078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.628399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.628718 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.629053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.629385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.629700 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.630030 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.630361 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.630710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.631027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.631775 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.631921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.632141 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.632464 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.632772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 14:41:34.633019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127089) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 14:41:34.637860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_db.sqlalchemy.engines [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:41:34.644813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writer thread running {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:41:34.697940 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO dbcounter [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] Registered counter for database nova_api Aug 30 14:41:34.703120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.context [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fe2fd645-a23d-4fcb-9457-49d884190a04(cell1) {{(pid=127088) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 14:41:34.707179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:41:34.707733 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:41:34.709262 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:41:34.709993 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:41:34.710441 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:41:34.712508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:41:34.714659 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO dbcounter [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] Registered counter for database nova_cell0 Aug 30 14:41:34.719527 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO dbcounter [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] Registered counter for database nova_cell1 Aug 30 14:41:34.719822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_db.sqlalchemy.engines [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127089) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:41:34.727540 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writer thread running {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:41:34.727747 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_db.sqlalchemy.engines [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:41:34.728203 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_db.sqlalchemy.engines [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:41:34.734072 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writer thread running {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:41:34.736753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writer thread running {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:41:34.785939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.context [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fe2fd645-a23d-4fcb-9457-49d884190a04(cell1) {{(pid=127089) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 14:41:34.789967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:41:34.790449 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:41:34.792020 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:41:34.792742 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:41:34.793181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:41:34.795145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:41:34.797795 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO dbcounter [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] Registered counter for database nova_cell0 Aug 30 14:41:34.801853 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO dbcounter [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] Registered counter for database nova_cell1 Aug 30 14:41:34.809041 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_db.sqlalchemy.engines [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127089) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:41:34.810888 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_db.sqlalchemy.engines [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127089) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:41:34.818300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writer thread running {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:41:34.819943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writer thread running {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:41:34.885308 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO dbcounter [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] Registered counter for database nova_cell0 Aug 30 14:41:34.892431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_db.sqlalchemy.engines [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:41:34.896815 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writer thread running {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:41:34.981647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO dbcounter [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] Registered counter for database nova_cell0 Aug 30 14:41:34.989235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_db.sqlalchemy.engines [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127089) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 14:41:34.993570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writer thread running {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 14:41:35.222807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: WARNING keystonemiddleware.auth_token [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:41:35.230399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: WARNING keystonemiddleware.auth_token [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:41:35.330650 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: WARNING keystonemiddleware.auth_token [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:41:35.338086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: WARNING keystonemiddleware.auth_token [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:41:35.588473 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: WARNING keystonemiddleware.auth_token [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:41:35.595642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: WARNING keystonemiddleware.auth_token [None req-b156b400-af78-4e8d-ba49-e2cb2fd64fec None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:41:35.601622 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b587c069c0 pid: 127088 (default app) Aug 30 14:41:35.712924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: WARNING keystonemiddleware.auth_token [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 14:41:35.720053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: WARNING keystonemiddleware.auth_token [None req-1eca97be-3427-4437-aaad-3cf8db05b7e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 14:41:35.725402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b587c069c0 pid: 127089 (default app) Aug 30 14:42:11.514572 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:11.515618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:11.516754 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:11.517526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:12.186011 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=3 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:12.187104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=3 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:12.188232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=3 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:12.188969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=3 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:13.252436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1e9a9d4c-59db-45f9-91a2-40e6d1f6b9d9 tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] Action: 'create', calling method: .version_select at 0x7f5cbb897e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1765984316", "metadata": {"Type": "work"}}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:13.591410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8e80df46-33fc-429b-90da-724f26c3a328 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Action: 'create', calling method: .version_select at 0x7f5cbb897e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-667930799", "metadata": {"Type": "work"}}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8e80df46-33fc-429b-90da-724f26c3a328 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Request method failure captured: Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 121 Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHEka6Vx0CehCTni7VFGn-FWu9mPGzFw-OTWHSPyLIyJyDSGA1JaSJgHvp2KxGb17zA40GVaWjQGtelMGzx84Cg2jGGQFgGqZyMLkKHwmCouzGLHD5DZXVlMd27lDpMYh71wxhcwut1FjdtWYeCrdTok7NeDs_h3CZ8AQ961rEdfeo Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: b6e19883ffdc44498f95e13a1338ed10 Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 14:42:13.606339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 14:42:13.608053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b6e19883ffdc44498f95e13a1338ed10", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:42:13.608053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:13.608053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: b6e19883ffdc44498f95e13a1338ed10 Aug 30 14:42:13.608053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:13.608053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-VolumesNegativeTest-234784434-project Aug 30 14:42:13.608053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 14:42:13.608053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 14:42:13.608053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: dd4c29b19bae4df9b88607c43aa17aa8 Aug 30 14:42:13.608053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-VolumesNegativeTest-234784434-project Aug 30 14:42:13.608053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Aug 30 14:42:13.608053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-667930799", "metadata": {"Type": "work"}}} Aug 30 14:42:13.608053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: Aug 30 14:42:13.608053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-667930799', 'metadata': {'Type': 'work'}}}} Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise error Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:42:13.609564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 14:42:13.611685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 14:42:13.613441 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 14:42:13.613441 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.622400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8e80df46-33fc-429b-90da-724f26c3a328 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:42:13.624414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8e80df46-33fc-429b-90da-724f26c3a328 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.443594 Aug 30 14:42:13.625488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Aug 30 14:42:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1446 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 14:42:13.637352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cd3d5ced-688b-4a49-aa26-3c36453ef776 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Action: 'create', calling method: .version_select at 0x7f5cbb7d9940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-588311893", "metadata": {"Type": "work"}}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cd3d5ced-688b-4a49-aa26-3c36453ef776 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Request method failure captured: Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 119 Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHEka6Vx0CehCTni7VFGn-FWu9mPGzFw-OTWHSPyLIyJyDSGA1JaSJgHvp2KxGb17zA40GVaWjQGtelMGzx84Cg2jGGQFgGqZyMLkKHwmCouzGLHD5DZXVlMd27lDpMYh71wxhcwut1FjdtWYeCrdTok7NeDs_h3CZ8AQ961rEdfeo Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: b6e19883ffdc44498f95e13a1338ed10 Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 14:42:13.643039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 14:42:13.644632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b6e19883ffdc44498f95e13a1338ed10", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:42:13.644632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:13.644632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: b6e19883ffdc44498f95e13a1338ed10 Aug 30 14:42:13.644632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:13.644632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-VolumesNegativeTest-234784434-project Aug 30 14:42:13.644632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 14:42:13.644632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 14:42:13.644632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: dd4c29b19bae4df9b88607c43aa17aa8 Aug 30 14:42:13.644632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-VolumesNegativeTest-234784434-project Aug 30 14:42:13.644632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Aug 30 14:42:13.644632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-588311893", "metadata": {"Type": "work"}}} Aug 30 14:42:13.644632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: Aug 30 14:42:13.644632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-588311893', 'metadata': {'Type': 'work'}}}} Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise error Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi '0' Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:42:13.645433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 14:42:13.646807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 14:42:13.648044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 14:42:13.648044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.650364 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cd3d5ced-688b-4a49-aa26-3c36453ef776 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:42:13.651469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cd3d5ced-688b-4a49-aa26-3c36453ef776 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019027 Aug 30 14:42:13.652265 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 2/2] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Aug 30 14:42:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 14:42:13.665487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-989ff5b3-3e3a-4fd3-ba3e-76e435a452bb tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Action: 'create', calling method: .version_select at 0x7f5cbb7419d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1751444863", "metadata": {"Type": "work"}}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-989ff5b3-3e3a-4fd3-ba3e-76e435a452bb tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Request method failure captured: Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 119 Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHEka6Vx0CehCTni7VFGn-FWu9mPGzFw-OTWHSPyLIyJyDSGA1JaSJgHvp2KxGb17zA40GVaWjQGtelMGzx84Cg2jGGQFgGqZyMLkKHwmCouzGLHD5DZXVlMd27lDpMYh71wxhcwut1FjdtWYeCrdTok7NeDs_h3CZ8AQ961rEdfeo Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: b6e19883ffdc44498f95e13a1338ed10 Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 14:42:13.669858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 14:42:13.671117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b6e19883ffdc44498f95e13a1338ed10", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:42:13.671117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:13.671117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: b6e19883ffdc44498f95e13a1338ed10 Aug 30 14:42:13.671117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:13.671117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-VolumesNegativeTest-234784434-project Aug 30 14:42:13.671117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 14:42:13.671117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 14:42:13.671117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: dd4c29b19bae4df9b88607c43aa17aa8 Aug 30 14:42:13.671117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-VolumesNegativeTest-234784434-project Aug 30 14:42:13.671117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Aug 30 14:42:13.671117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1751444863", "metadata": {"Type": "work"}}} Aug 30 14:42:13.671117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: Aug 30 14:42:13.671117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1751444863', 'metadata': {'Type': 'work'}}}} Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise error Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi '' Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:42:13.672094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 14:42:13.673366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 14:42:13.674626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 14:42:13.674626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.677343 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-989ff5b3-3e3a-4fd3-ba3e-76e435a452bb tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:42:13.678363 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-989ff5b3-3e3a-4fd3-ba3e-76e435a452bb tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017754 Aug 30 14:42:13.683730 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 3/3] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Aug 30 14:42:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 14:42:13.692352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e21c8b80-57a1-48c7-8a59-a10fca6e77d0 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Calling method '.version_select at 0x7f5cbb741700>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-e21c8b80-57a1-48c7-8a59-a10fca6e77d0 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] HTTP exception thrown: Volume tempest-invalid-1064121529 could not be found. Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e21c8b80-57a1-48c7-8a59-a10fca6e77d0 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Request method failure captured: Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1064121529 HTTP/1.1 Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHEka6Vx0CehCTni7VFGn-FWu9mPGzFw-OTWHSPyLIyJyDSGA1JaSJgHvp2KxGb17zA40GVaWjQGtelMGzx84Cg2jGGQFgGqZyMLkKHwmCouzGLHD5DZXVlMd27lDpMYh71wxhcwut1FjdtWYeCrdTok7NeDs_h3CZ8AQ961rEdfeo Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: b6e19883ffdc44498f95e13a1338ed10 Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 14:42:13.921221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 14:42:13.955616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b6e19883ffdc44498f95e13a1338ed10", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:42:13.955616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:13.955616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: b6e19883ffdc44498f95e13a1338ed10 Aug 30 14:42:13.955616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:13.955616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-VolumesNegativeTest-234784434-project Aug 30 14:42:13.955616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 14:42:13.955616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 14:42:13.955616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: dd4c29b19bae4df9b88607c43aa17aa8 Aug 30 14:42:13.955616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-VolumesNegativeTest-234784434-project Aug 30 14:42:13.955616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: Aug 30 14:42:13.955616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Volume tempest-invalid-1064121529 could not be found. Aug 30 14:42:13.955616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': 'tempest-invalid-1064121529'} Aug 30 14:42:13.955616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:42:13.955616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1064121529 could not be found. (HTTP 404) (Request-ID: req-c00caebc-87a9-4547-a536-9238ce1bfef8) Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.956638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 14:42:13.957964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1064121529 could not be found. Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1064121529 could not be found. Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.959250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:13.960462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.960462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:13.960462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:42:13.960462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:42:13.960462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:42:13.960462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:42:13.960462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1064121529 could not be found. Aug 30 14:42:13.960462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:13.960462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e21c8b80-57a1-48c7-8a59-a10fca6e77d0 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Returning 404 to user: Volume tempest-invalid-1064121529 could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:42:13.960462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e21c8b80-57a1-48c7-8a59-a10fca6e77d0 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1064121529" status: 404 len: 99 microversion: 2.1 time: 0.235958 Aug 30 14:42:13.960462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 4/4] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 14:42:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1064121529 => generated 99 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 14:42:13.960462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-41173af1-1cde-4611-92ed-2f747ff41f3f tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017627 Aug 30 14:42:13.961206 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 5/5] 10.222.0.30 () {58 vars in 1140 bytes} [Tue Aug 30 14:42:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 14:42:13.973251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-55ace50f-9563-4f69-84c5-082cd505808e tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008441 Aug 30 14:42:13.974546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 6/6] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 30 14:42:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 14:42:13.983623 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7fc52678-cf75-4209-9951-30ff3c6e572a tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Calling method '.version_select at 0x7f5cbb6a5ca0>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:14.045176 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-7fc52678-cf75-4209-9951-30ff3c6e572a tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] HTTP exception thrown: Volume 12b91ddb-2141-42c4-be0c-b8f16ac4d637 could not be found. Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7fc52678-cf75-4209-9951-30ff3c6e572a tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Request method failure captured: Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: DELETE /compute/v2.1/os-volumes/12b91ddb-2141-42c4-be0c-b8f16ac4d637 HTTP/1.1 Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHEka6Vx0CehCTni7VFGn-FWu9mPGzFw-OTWHSPyLIyJyDSGA1JaSJgHvp2KxGb17zA40GVaWjQGtelMGzx84Cg2jGGQFgGqZyMLkKHwmCouzGLHD5DZXVlMd27lDpMYh71wxhcwut1FjdtWYeCrdTok7NeDs_h3CZ8AQ961rEdfeo Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: b6e19883ffdc44498f95e13a1338ed10 Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 14:42:14.047749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 14:42:14.049088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b6e19883ffdc44498f95e13a1338ed10", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:42:14.049088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:14.049088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: b6e19883ffdc44498f95e13a1338ed10 Aug 30 14:42:14.049088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:14.049088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-VolumesNegativeTest-234784434-project Aug 30 14:42:14.049088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 14:42:14.049088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 14:42:14.049088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: dd4c29b19bae4df9b88607c43aa17aa8 Aug 30 14:42:14.049088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-VolumesNegativeTest-234784434-project Aug 30 14:42:14.049088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: Aug 30 14:42:14.049088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Volume 12b91ddb-2141-42c4-be0c-b8f16ac4d637 could not be found. Aug 30 14:42:14.049088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': '12b91ddb-2141-42c4-be0c-b8f16ac4d637'} Aug 30 14:42:14.049088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 12b91ddb-2141-42c4-be0c-b8f16ac4d637 could not be found. (HTTP 404) (Request-ID: req-ccafa290-b75f-4068-a942-4150129cf869) Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:14.049876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 14:42:14.051129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 12b91ddb-2141-42c4-be0c-b8f16ac4d637 could not be found. Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:42:14.055613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 12b91ddb-2141-42c4-be0c-b8f16ac4d637 could not be found. Aug 30 14:42:14.058130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:14.058130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:14.058130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:14.058130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:14.058130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:42:14.058130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:42:14.058130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:42:14.058130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:42:14.058130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 12b91ddb-2141-42c4-be0c-b8f16ac4d637 could not be found. Aug 30 14:42:14.058130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:14.058130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7fc52678-cf75-4209-9951-30ff3c6e572a tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Returning 404 to user: Volume 12b91ddb-2141-42c4-be0c-b8f16ac4d637 could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:42:14.058130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7fc52678-cf75-4209-9951-30ff3c6e572a tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/12b91ddb-2141-42c4-be0c-b8f16ac4d637" status: 404 len: 109 microversion: 2.1 time: 0.069382 Aug 30 14:42:14.058130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 7/7] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 14:42:13 2022] DELETE /compute/v2.1/os-volumes/12b91ddb-2141-42c4-be0c-b8f16ac4d637 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 14:42:14.060952 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-edaa49f7-374f-4136-bd24-1cca50de3473 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Calling method '.version_select at 0x7f5cbb6a5670>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:14.105632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-edaa49f7-374f-4136-bd24-1cca50de3473 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] HTTP exception thrown: Volume a1d16845-9cdd-46ef-a854-405d9dd7dca7 could not be found. Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-edaa49f7-374f-4136-bd24-1cca50de3473 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Request method failure captured: Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: GET /compute/v2.1/os-volumes/a1d16845-9cdd-46ef-a854-405d9dd7dca7 HTTP/1.1 Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHEka6Vx0CehCTni7VFGn-FWu9mPGzFw-OTWHSPyLIyJyDSGA1JaSJgHvp2KxGb17zA40GVaWjQGtelMGzx84Cg2jGGQFgGqZyMLkKHwmCouzGLHD5DZXVlMd27lDpMYh71wxhcwut1FjdtWYeCrdTok7NeDs_h3CZ8AQ961rEdfeo Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: b6e19883ffdc44498f95e13a1338ed10 Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 14:42:14.111657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 14:42:14.113548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b6e19883ffdc44498f95e13a1338ed10", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b6e19883ffdc44498f95e13a1338ed10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:42:14.113548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:14.113548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: b6e19883ffdc44498f95e13a1338ed10 Aug 30 14:42:14.113548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-VolumesNegativeTest-234784434 Aug 30 14:42:14.113548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-VolumesNegativeTest-234784434-project Aug 30 14:42:14.113548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 14:42:14.113548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 14:42:14.113548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: dd4c29b19bae4df9b88607c43aa17aa8 Aug 30 14:42:14.113548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-VolumesNegativeTest-234784434-project Aug 30 14:42:14.113548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: Aug 30 14:42:14.113548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Volume a1d16845-9cdd-46ef-a854-405d9dd7dca7 could not be found. Aug 30 14:42:14.113548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': 'a1d16845-9cdd-46ef-a854-405d9dd7dca7'} Aug 30 14:42:14.113548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a1d16845-9cdd-46ef-a854-405d9dd7dca7 could not be found. (HTTP 404) (Request-ID: req-674e7c1c-2383-4b0f-a4dd-06ced293a67a) Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:14.114518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 14:42:14.115921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a1d16845-9cdd-46ef-a854-405d9dd7dca7 could not be found. Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:42:14.117232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a1d16845-9cdd-46ef-a854-405d9dd7dca7 could not be found. Aug 30 14:42:14.118628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:14.118628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:14.118628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:14.118628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:14.118628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:42:14.118628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:42:14.118628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:42:14.118628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:42:14.118628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a1d16845-9cdd-46ef-a854-405d9dd7dca7 could not be found. Aug 30 14:42:14.118628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:14.120712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-edaa49f7-374f-4136-bd24-1cca50de3473 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] Returning 404 to user: Volume a1d16845-9cdd-46ef-a854-405d9dd7dca7 could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:42:14.121976 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-edaa49f7-374f-4136-bd24-1cca50de3473 tempest-VolumesNegativeTest-234784434 tempest-VolumesNegativeTest-234784434-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/a1d16845-9cdd-46ef-a854-405d9dd7dca7" status: 404 len: 109 microversion: 2.1 time: 0.066491 Aug 30 14:42:14.122534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 8/8] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 14:42:14 2022] GET /compute/v2.1/os-volumes/a1d16845-9cdd-46ef-a854-405d9dd7dca7 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:42:14.420553 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1e9a9d4c-59db-45f9-91a2-40e6d1f6b9d9 tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.917791 Aug 30 14:42:14.421990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1/9] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Aug 30 14:42:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2920 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 14:42:14.441075 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ce5ece0e-f0ef-4ca3-b6a4-7453be1831e3 tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] Calling method '.version_select at 0x7f5cbb6a5b80>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:14.547151 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ce5ece0e-f0ef-4ca3-b6a4-7453be1831e3 tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/9e66fcc8-01aa-44ca-8c40-001fd91afa4d" status: 200 len: 353 microversion: 2.1 time: 0.113342 Aug 30 14:42:14.554528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 9/10] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 14:42:14 2022] GET /compute/v2.1/os-volumes/9e66fcc8-01aa-44ca-8c40-001fd91afa4d => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:15.388843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a639e1a5-2c18-40de-902a-f318dff74d19 tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] Calling method '.version_select at 0x7f5cbb71bca0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:15.546686 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a639e1a5-2c18-40de-902a-f318dff74d19 tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/49f72e46-a0c5-4968-9aba-1c79af166dd4" status: 200 len: 351 microversion: 2.1 time: 0.167046 Aug 30 14:42:15.560005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 2/11] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 14:42:15 2022] GET /compute/v2.1/os-volumes/49f72e46-a0c5-4968-9aba-1c79af166dd4 => generated 351 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:15.562859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2e83c6f9-4f91-4e7b-8ca2-6e4c82e32950 tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] Calling method '.version_select at 0x7f5cbb6a53a0>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:15.849296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2e83c6f9-4f91-4e7b-8ca2-6e4c82e32950 tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/9e66fcc8-01aa-44ca-8c40-001fd91afa4d" status: 200 len: 354 microversion: 2.1 time: 0.290749 Aug 30 14:42:15.849869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 10/12] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 14:42:15 2022] GET /compute/v2.1/os-volumes/9e66fcc8-01aa-44ca-8c40-001fd91afa4d => generated 354 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:15.864459 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1336be9e-1511-4020-90fb-e74861df554c tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] Calling method '.version_select at 0x7f5cbb731430>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:15.986853 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1336be9e-1511-4020-90fb-e74861df554c tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/9e66fcc8-01aa-44ca-8c40-001fd91afa4d" status: 200 len: 354 microversion: 2.1 time: 0.126778 Aug 30 14:42:15.987895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 3/13] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 14:42:15 2022] GET /compute/v2.1/os-volumes/9e66fcc8-01aa-44ca-8c40-001fd91afa4d => generated 354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:16.007122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a8dd6ebf-7f49-403c-bbff-ef7d2aa4b670 tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] Calling method '.version_select at 0x7f5cbb63f430>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:16.197851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a8dd6ebf-7f49-403c-bbff-ef7d2aa4b670 tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/9e66fcc8-01aa-44ca-8c40-001fd91afa4d" status: 202 len: 0 microversion: 2.1 time: 0.194464 Aug 30 14:42:16.198406 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 11/14] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 14:42:16 2022] DELETE /compute/v2.1/os-volumes/9e66fcc8-01aa-44ca-8c40-001fd91afa4d => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:42:16.210158 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-96fdd932-c5dc-4201-b641-8abd6f36150c tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] Calling method '.version_select at 0x7f5cbb731af0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:16.326167 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-96fdd932-c5dc-4201-b641-8abd6f36150c tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/9e66fcc8-01aa-44ca-8c40-001fd91afa4d" status: 200 len: 353 microversion: 2.1 time: 0.123419 Aug 30 14:42:16.327023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 4/15] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 14:42:16 2022] GET /compute/v2.1/os-volumes/9e66fcc8-01aa-44ca-8c40-001fd91afa4d => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:17.340302 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0d02701d-418b-444c-80b3-884ee2f3a02e tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] Calling method '.version_select at 0x7f5cbb63f9d0>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:17.389744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-0d02701d-418b-444c-80b3-884ee2f3a02e tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] HTTP exception thrown: Volume 9e66fcc8-01aa-44ca-8c40-001fd91afa4d could not be found. Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0d02701d-418b-444c-80b3-884ee2f3a02e tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] Request method failure captured: Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: GET /compute/v2.1/os-volumes/9e66fcc8-01aa-44ca-8c40-001fd91afa4d HTTP/1.1 Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHDFvsAJivWWAwiUJcG95PzdYm5my0ReBQWp9Uqwyi1x47Ul2_J8h5wj_HrmcRkDEbvxuWgyF0X35wWwGB6W7LeplF5QG3xrK7eKPPRMKBXuxUtFJoZShqUC3yoXMtR77HlaorgnrDAEdQVy1t91FOl8pEFXjzIv4JQi6PeqV82mfw Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: 6e9991d4feb042f19745ffb1d9c8b0cf Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-VolumesGetTestJSON-1687545306 Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 14:42:17.391870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 14:42:17.393181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e9991d4feb042f19745ffb1d9c8b0cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6e9991d4feb042f19745ffb1d9c8b0cf", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6e9991d4feb042f19745ffb1d9c8b0cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6e9991d4feb042f19745ffb1d9c8b0cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:42:17.393181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-VolumesGetTestJSON-1687545306 Aug 30 14:42:17.393181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: 6e9991d4feb042f19745ffb1d9c8b0cf Aug 30 14:42:17.393181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-VolumesGetTestJSON-1687545306 Aug 30 14:42:17.393181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-VolumesGetTestJSON-1687545306-project Aug 30 14:42:17.393181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 14:42:17.393181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 14:42:17.393181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: 1754147b3a494d76be36555c7f9542db Aug 30 14:42:17.393181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-VolumesGetTestJSON-1687545306-project Aug 30 14:42:17.393181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: Aug 30 14:42:17.393181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Volume 9e66fcc8-01aa-44ca-8c40-001fd91afa4d could not be found. Aug 30 14:42:17.393181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': '9e66fcc8-01aa-44ca-8c40-001fd91afa4d'} Aug 30 14:42:17.393181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e66fcc8-01aa-44ca-8c40-001fd91afa4d could not be found. (HTTP 404) (Request-ID: req-2b6ab445-ec5a-4774-9651-546e0b77cc4a) Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:17.393955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 14:42:17.395160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e66fcc8-01aa-44ca-8c40-001fd91afa4d could not be found. Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:42:17.396308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9e66fcc8-01aa-44ca-8c40-001fd91afa4d could not be found. Aug 30 14:42:17.397450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:17.397450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:42:17.397450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:17.397450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:42:17.397450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:42:17.397450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:42:17.397450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:42:17.397450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:42:17.397450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e66fcc8-01aa-44ca-8c40-001fd91afa4d could not be found. Aug 30 14:42:17.397450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:42:17.397450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0d02701d-418b-444c-80b3-884ee2f3a02e tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] Returning 404 to user: Volume 9e66fcc8-01aa-44ca-8c40-001fd91afa4d could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:42:17.397450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0d02701d-418b-444c-80b3-884ee2f3a02e tempest-VolumesGetTestJSON-1687545306 tempest-VolumesGetTestJSON-1687545306-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/9e66fcc8-01aa-44ca-8c40-001fd91afa4d" status: 404 len: 109 microversion: 2.1 time: 0.059386 Aug 30 14:42:17.401055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 12/16] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 14:42:17 2022] GET /compute/v2.1/os-volumes/9e66fcc8-01aa-44ca-8c40-001fd91afa4d => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:42:17.613677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ecf85dbf-9c65-42a9-8429-56ea2d1e8967 tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] Calling method '.version_select at 0x7f5cbb71bca0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:17.736102 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ecf85dbf-9c65-42a9-8429-56ea2d1e8967 tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/3a4bee83-77bf-4789-8573-c3b9dbd484e6" status: 200 len: 351 microversion: 2.1 time: 0.127428 Aug 30 14:42:17.736818 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 5/17] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 14:42:17 2022] GET /compute/v2.1/os-volumes/3a4bee83-77bf-4789-8573-c3b9dbd484e6 => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:19.561761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-10315656-4998-4348-8e84-f0878ce20cbe tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] Calling method '.version_select at 0x7f5cbb6a5160>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:19.735946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-10315656-4998-4348-8e84-f0878ce20cbe tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/81c58d42-1cc6-41e6-a7ec-9a896f10e54d" status: 200 len: 351 microversion: 2.1 time: 0.179440 Aug 30 14:42:19.736882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 13/18] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 30 14:42:19 2022] GET /compute/v2.1/os-volumes/81c58d42-1cc6-41e6-a7ec-9a896f10e54d => generated 351 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:19.751235 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bb8afc03-dfd6-4cca-a879-c298f5675b77 tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] Calling method '.version_select at 0x7f5cbb731b80>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:19.998892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bb8afc03-dfd6-4cca-a879-c298f5675b77 tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.252276 Aug 30 14:42:20.000000 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 6/19] 10.222.0.30 () {58 vars in 1134 bytes} [Tue Aug 30 14:42:19 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:20.032849 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6c9bc398-ffab-4404-82c3-f7903f5ee1ac tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] Calling method '.version_select at 0x7f5cbb63fc10>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:20.270944 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6c9bc398-ffab-4404-82c3-f7903f5ee1ac tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.258585 Aug 30 14:42:20.271735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 14/20] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Aug 30 14:42:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:20.297199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2c5da614-1073-4952-94b2-5f81820efdcf tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] Calling method '.version_select at 0x7f5cbb6bc4c0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:20.519447 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2c5da614-1073-4952-94b2-5f81820efdcf tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.233125 Aug 30 14:42:20.520867 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 7/21] 10.222.0.30 () {58 vars in 1134 bytes} [Tue Aug 30 14:42:20 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:20.550603 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-14fab5be-3f5b-47e8-93df-27729c45d586 tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] Calling method '.version_select at 0x7f5cbb6a5b80>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:20.791361 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-14fab5be-3f5b-47e8-93df-27729c45d586 tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.259278 Aug 30 14:42:20.792336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 15/22] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Aug 30 14:42:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:20.826189 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6e4afd93-03a7-4163-a186-6f6fc3428fbf tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] Calling method '.version_select at 0x7f5cbb6bc940>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:21.157847 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6e4afd93-03a7-4163-a186-6f6fc3428fbf tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.341696 Aug 30 14:42:21.158444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 8/23] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Aug 30 14:42:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:21.172532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-174c5164-dbbe-4402-810c-3d8657ab85fd tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] Calling method '.version_select at 0x7f5cbb63f310>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:21.344320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-174c5164-dbbe-4402-810c-3d8657ab85fd tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.175843 Aug 30 14:42:21.345729 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 16/24] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 14:42:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:21.359259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-723a598c-cd38-4828-85a9-9a1421e381fd tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] Calling method '.version_select at 0x7f5cbb7311f0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:21.623128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-723a598c-cd38-4828-85a9-9a1421e381fd tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.267338 Aug 30 14:42:21.624259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 9/25] 10.222.0.30 () {58 vars in 1188 bytes} [Tue Aug 30 14:42:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:21.644016 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d3232b86-f82e-4828-a7a3-01da8423425f tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] Calling method '.version_select at 0x7f5cbb646790>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:21.846241 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d3232b86-f82e-4828-a7a3-01da8423425f tempest-VolumesTestJSON-1799246708 tempest-VolumesTestJSON-1799246708-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.206281 Aug 30 14:42:21.847780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 17/26] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 30 14:42:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:27.468336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1716614701", "imageRef": "fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b", "flavorRef": "452", "networks": [{"uuid": "aaaa6526-ac65-44e9-9005-2af53af595e2"}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:27.706126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] validate_networks() for [('aaaa6526-ac65-44e9-9005-2af53af595e2', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:42:30.570413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1043278363", "imageRef": "fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:30.823504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.network.neutron [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] validate_networks() for [('8fd5a316-a8cc-40db-9c3d-7092a23676cb', None, None, None, None, None)] {{(pid=127089) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:42:31.516644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:42:31.517170 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:42:31.517475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:42:31.517956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:42:31.518438 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:42:31.568018 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:31.571735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:31.580934 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:31.586450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:31.588677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:31.589319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:31.706329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Getting quotas for project 8aeffb40eafc44639c8e5032dce345aa. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:42:31.719657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Getting quotas for user 0642fa92a86c4e01a42bf087cd36cace and project 8aeffb40eafc44639c8e5032dce345aa. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:42:31.757456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:42:31.762842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:42:31.943453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0e700ed4-408c-4640-b5ea-94365fad7b34 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.794297 Aug 30 14:42:31.944439 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 10/27] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 14:42:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 4796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:42:32.456308 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0a029c92-23a7-4808-b4be-24ccd2b216e6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Action: 'create', calling method: .version_select at 0x7f5cbadcb3a0>, body: {"keypair": {"name": "tempest-keypair-867043046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxDzJvWmabNBi5t+CusQM0jU7hixPAaSBbmmjPnLYwi90kPW3n385FoGdlSwjYvBeHDA/s++Spw89ZR6gb6MhwWqQWX835IG3yh72JeaIBitNeA1zjA4gLJ/npgPt3dOw=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:32.581955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-0a029c92-23a7-4808-b4be-24ccd2b216e6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Getting quotas for project 04efb141e084405992bfc0418a74da2a. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:42:32.613116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-0a029c92-23a7-4808-b4be-24ccd2b216e6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Getting quotas for user ca9bafc5ff4e43719f37e62cad946cf7 and project 04efb141e084405992bfc0418a74da2a. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:42:32.754795 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0a029c92-23a7-4808-b4be-24ccd2b216e6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.803392 Aug 30 14:42:32.758050 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 11/28] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 14:42:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:32.779848 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8bd40f55-8f89-4c20-8325-86b07f56e7b4 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:32.780526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8bd40f55-8f89-4c20-8325-86b07f56e7b4 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:33.507311 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8bd40f55-8f89-4c20-8325-86b07f56e7b4 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:33.540821 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8bd40f55-8f89-4c20-8325-86b07f56e7b4 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1215 microversion: 2.1 time: 0.781352 Aug 30 14:42:33.541895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 12/29] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:32 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1215 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:34.562313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c58cbe09-76d8-41cb-a7a7-6651ca675ccf tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:34.562989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c58cbe09-76d8-41cb-a7a7-6651ca675ccf tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:34.581139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c58cbe09-76d8-41cb-a7a7-6651ca675ccf tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:34.581638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c58cbe09-76d8-41cb-a7a7-6651ca675ccf tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:34.582078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c58cbe09-76d8-41cb-a7a7-6651ca675ccf tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:34.582784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c58cbe09-76d8-41cb-a7a7-6651ca675ccf tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:34.584408 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c58cbe09-76d8-41cb-a7a7-6651ca675ccf tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:34.592401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c58cbe09-76d8-41cb-a7a7-6651ca675ccf tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:34.988232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c58cbe09-76d8-41cb-a7a7-6651ca675ccf tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:35.021321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c58cbe09-76d8-41cb-a7a7-6651ca675ccf tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1211 microversion: 2.1 time: 0.462798 Aug 30 14:42:35.021949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 13/30] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:34 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1211 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:42:35.388772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Flavor limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:42:35.389326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Image limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:42:35.390282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Flavor pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:42:35.390807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Image pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:42:35.391438 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:42:35.435505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:35.436014 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:35.436509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:35.441727 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:35.443305 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:35.445113 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:35.497349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Getting quotas for project 65bab38256b44ad6b4b573a2441eb6d3. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:42:35.512809 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Getting quotas for user 35f28006916040c3b988de6c15093166 and project 65bab38256b44ad6b4b573a2441eb6d3. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:42:35.556716 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Going to run 1 instances... {{(pid=127089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:42:35.560413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:42:35.645865 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-21167711-172c-4c6b-95ac-f1cce89dab89 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Action: 'create', calling method: .version_select at 0x7f5cbb71bd30>, body: {"keypair": {"name": "tempest-keypair-455122836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5za4JLtsnSPsnsyqI+Mou1+QDMkfeOKBFmQcZFxFuRCFinKIJCbPcho8C5Pc365TrP1rklFXmNhQh9KHFE6ARlPu4xS+hVRDmszlN5uqDqN5qZGj58OHjOzKcp0ySadA=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:35.726306 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-21167711-172c-4c6b-95ac-f1cce89dab89 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Getting quotas for project a8914c5bc86f4ee6a9797b05a6a7b12b. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:42:35.739267 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e232b8f9-8b09-43f8-a9b2-60d47bbaf035 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.835815 Aug 30 14:42:35.742581 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-21167711-172c-4c6b-95ac-f1cce89dab89 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Getting quotas for user 6270e19d6245453ab79555a79532faba and project a8914c5bc86f4ee6a9797b05a6a7b12b. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:42:35.747585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 18/31] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 14:42:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 5845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:42:35.771735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cc8249b2-a9c6-465b-9673-9171ff25e726 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:35.773943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cc8249b2-a9c6-465b-9673-9171ff25e726 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:35.847483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-21167711-172c-4c6b-95ac-f1cce89dab89 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.677316 Aug 30 14:42:35.848784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 14/32] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Aug 30 14:42:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 679 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 30 14:42:36.055851 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c5685084-29f3-49d7-87a7-2d82d4c5891f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:36.056877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c5685084-29f3-49d7-87a7-2d82d4c5891f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:36.076554 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c5685084-29f3-49d7-87a7-2d82d4c5891f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:36.078844 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c5685084-29f3-49d7-87a7-2d82d4c5891f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:36.080678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c5685084-29f3-49d7-87a7-2d82d4c5891f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:36.082834 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c5685084-29f3-49d7-87a7-2d82d4c5891f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:36.085503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c5685084-29f3-49d7-87a7-2d82d4c5891f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:36.086680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c5685084-29f3-49d7-87a7-2d82d4c5891f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:36.109784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cc8249b2-a9c6-465b-9673-9171ff25e726 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:36.144133 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cc8249b2-a9c6-465b-9673-9171ff25e726 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1222 microversion: 2.1 time: 0.390427 Aug 30 14:42:36.144783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 19/33] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:35 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1222 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:36.448625 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-842382082", "imageRef": "fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:36.590795 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.network.neutron [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] validate_networks() for [('8fd5a316-a8cc-40db-9c3d-7092a23676cb', None, None, None, None, None)] {{(pid=127089) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:42:36.792104 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c5685084-29f3-49d7-87a7-2d82d4c5891f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:36.801564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c5685084-29f3-49d7-87a7-2d82d4c5891f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1285 microversion: 2.1 time: 0.756771 Aug 30 14:42:36.813417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 15/34] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:36 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1285 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:37.637021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Flavor limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:42:37.638469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Image limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:42:37.644436 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Flavor pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:42:37.645510 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Image pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:42:37.646073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:42:37.667635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:37.668907 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:37.688681 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:37.689831 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:37.693597 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:37.715617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:37.792133 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Getting quotas for project 65bab38256b44ad6b4b573a2441eb6d3. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:42:37.804789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Getting quotas for user 35f28006916040c3b988de6c15093166 and project 65bab38256b44ad6b4b573a2441eb6d3. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:42:37.835775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-54c074a1-f3ad-46df-b649-85f8d88279d1 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:37.837014 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-54c074a1-f3ad-46df-b649-85f8d88279d1 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:37.863238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Going to run 1 instances... {{(pid=127089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:42:37.866069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54c074a1-f3ad-46df-b649-85f8d88279d1 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:37.866579 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54c074a1-f3ad-46df-b649-85f8d88279d1 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:37.867026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54c074a1-f3ad-46df-b649-85f8d88279d1 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:37.867784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54c074a1-f3ad-46df-b649-85f8d88279d1 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:37.868246 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54c074a1-f3ad-46df-b649-85f8d88279d1 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:37.868679 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54c074a1-f3ad-46df-b649-85f8d88279d1 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:37.871596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:42:38.016900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a5c6d472-c6f0-4b71-ad9f-4b5f7d65be6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.573174 Aug 30 14:42:38.020055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 20/35] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 14:42:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 14:42:38.036264 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a0402f0b-a473-4b44-a844-82740a10db3b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:38.036911 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a0402f0b-a473-4b44-a844-82740a10db3b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:38.188742 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-54c074a1-f3ad-46df-b649-85f8d88279d1 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:38.201738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-54c074a1-f3ad-46df-b649-85f8d88279d1 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1273 microversion: 2.1 time: 0.369560 Aug 30 14:42:38.204525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 16/36] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:37 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1273 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:42:38.243429 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a0402f0b-a473-4b44-a844-82740a10db3b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:38.253981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a0402f0b-a473-4b44-a844-82740a10db3b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1221 microversion: 2.1 time: 0.225590 Aug 30 14:42:38.257411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 21/37] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:38 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1221 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:38.823085 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1170471912", "imageRef": "fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32f975bc-8116-40a7-8ed9-ac5167528756"}], "security_groups": [{"name": "tempest-securitygroup--107139066"}], "key_name": "tempest-keypair-867043046", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:39.226318 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-75a4cba4-177f-4d72-8452-dfba5b9bc5c4 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:39.227061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-75a4cba4-177f-4d72-8452-dfba5b9bc5c4 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:39.242222 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75a4cba4-177f-4d72-8452-dfba5b9bc5c4 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:39.251785 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75a4cba4-177f-4d72-8452-dfba5b9bc5c4 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:39.253620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75a4cba4-177f-4d72-8452-dfba5b9bc5c4 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:39.256220 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75a4cba4-177f-4d72-8452-dfba5b9bc5c4 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:39.256960 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75a4cba4-177f-4d72-8452-dfba5b9bc5c4 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:39.258791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75a4cba4-177f-4d72-8452-dfba5b9bc5c4 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:40.013384 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] validate_networks() for [('32f975bc-8116-40a7-8ed9-ac5167528756', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:42:40.455729 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-75a4cba4-177f-4d72-8452-dfba5b9bc5c4 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:40.495544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-75a4cba4-177f-4d72-8452-dfba5b9bc5c4 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1273 microversion: 2.1 time: 1.274899 Aug 30 14:42:40.496130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 22/38] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:39 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1273 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:40.506233 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3d8bebe3-a6ef-4869-98b5-05fcc759e8e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:40.525490 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3d8bebe3-a6ef-4869-98b5-05fcc759e8e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:40.544280 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d8bebe3-a6ef-4869-98b5-05fcc759e8e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:40.551600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d8bebe3-a6ef-4869-98b5-05fcc759e8e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:40.554915 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d8bebe3-a6ef-4869-98b5-05fcc759e8e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:40.555847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d8bebe3-a6ef-4869-98b5-05fcc759e8e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:40.556358 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d8bebe3-a6ef-4869-98b5-05fcc759e8e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:40.556791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d8bebe3-a6ef-4869-98b5-05fcc759e8e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:41.403819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3d8bebe3-a6ef-4869-98b5-05fcc759e8e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:41.419990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3d8bebe3-a6ef-4869-98b5-05fcc759e8e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1273 microversion: 2.1 time: 0.914172 Aug 30 14:42:41.421469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 23/39] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:40 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1273 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:41.520149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3f58e061-e533-44cb-a6f3-48742a0218ad tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:41.521915 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3f58e061-e533-44cb-a6f3-48742a0218ad tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:41.551553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f58e061-e533-44cb-a6f3-48742a0218ad tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:41.554196 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f58e061-e533-44cb-a6f3-48742a0218ad tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:41.554840 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f58e061-e533-44cb-a6f3-48742a0218ad tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:41.559409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f58e061-e533-44cb-a6f3-48742a0218ad tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:41.561967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f58e061-e533-44cb-a6f3-48742a0218ad tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:41.569165 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f58e061-e533-44cb-a6f3-48742a0218ad tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:41.642979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:42.255578 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:42:42.256359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:42:42.257650 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:42:42.258395 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:42:42.259082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:42:42.300164 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:42.302743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:42.306740 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:42.310168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:42.312972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:42.317384 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:42.376415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Getting quotas for project 04efb141e084405992bfc0418a74da2a. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:42:42.381458 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Getting quotas for user ca9bafc5ff4e43719f37e62cad946cf7 and project 04efb141e084405992bfc0418a74da2a. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:42:42.421693 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:42:42.428547 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:42:42.554693 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-eb688b35-72e0-43ab-b71d-3e8289dbbe3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.737904 Aug 30 14:42:42.563328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 17/40] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 14:42:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 3747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 14:42:42.592769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-45cc07bf-dd87-4bd2-9e96-0d112b8795fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:42.599870 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-45cc07bf-dd87-4bd2-9e96-0d112b8795fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:42.630700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45cc07bf-dd87-4bd2-9e96-0d112b8795fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:42.634426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45cc07bf-dd87-4bd2-9e96-0d112b8795fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:42.634789 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45cc07bf-dd87-4bd2-9e96-0d112b8795fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:42.639601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45cc07bf-dd87-4bd2-9e96-0d112b8795fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:42.641100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45cc07bf-dd87-4bd2-9e96-0d112b8795fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:42.642159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45cc07bf-dd87-4bd2-9e96-0d112b8795fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:42.805244 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45cc07bf-dd87-4bd2-9e96-0d112b8795fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:42.827641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-45cc07bf-dd87-4bd2-9e96-0d112b8795fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1279 microversion: 2.1 time: 0.249092 Aug 30 14:42:42.846288 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 18/41] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:42 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1279 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:42.859112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9df5677b-dafd-466e-9b95-4406de07a9e7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:42.862949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9df5677b-dafd-466e-9b95-4406de07a9e7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:42.991922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9df5677b-dafd-466e-9b95-4406de07a9e7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:43.002841 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9df5677b-dafd-466e-9b95-4406de07a9e7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1237 microversion: 2.1 time: 0.154620 Aug 30 14:42:43.004378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 19/42] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:42 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1237 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:43.119069 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3f58e061-e533-44cb-a6f3-48742a0218ad tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:43.140988 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3f58e061-e533-44cb-a6f3-48742a0218ad tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 1.627430 Aug 30 14:42:43.147953 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 24/43] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:41 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:42:43.860562 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7c7786e7-c4c0-4baa-9a71-fc72fe74020f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:43.861810 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7c7786e7-c4c0-4baa-9a71-fc72fe74020f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:43.871494 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-718043833", "imageRef": "fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45f9aacb-1fd2-4ead-ac22-db45aa0f691f"}], "security_groups": [{"name": "tempest-securitygroup--1133396968"}], "key_name": "tempest-keypair-455122836", "user_data": "}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:43.875941 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c7786e7-c4c0-4baa-9a71-fc72fe74020f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:43.876568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c7786e7-c4c0-4baa-9a71-fc72fe74020f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:43.877155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c7786e7-c4c0-4baa-9a71-fc72fe74020f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:43.878146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c7786e7-c4c0-4baa-9a71-fc72fe74020f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:43.878844 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c7786e7-c4c0-4baa-9a71-fc72fe74020f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:43.879577 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c7786e7-c4c0-4baa-9a71-fc72fe74020f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:44.006542 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7c7786e7-c4c0-4baa-9a71-fc72fe74020f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:44.018740 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7c7786e7-c4c0-4baa-9a71-fc72fe74020f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1279 microversion: 2.1 time: 0.169044 Aug 30 14:42:44.030591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 20/44] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:43 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:44.037416 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-653f6e60-c55d-4641-8617-51a67c66ca62 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:44.038156 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-653f6e60-c55d-4641-8617-51a67c66ca62 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:44.038685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.network.neutron [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] validate_networks() for [('45f9aacb-1fd2-4ead-ac22-db45aa0f691f', None, None, None, None, None)] {{(pid=127089) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:42:44.046347 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-653f6e60-c55d-4641-8617-51a67c66ca62 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:44.047673 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-653f6e60-c55d-4641-8617-51a67c66ca62 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:44.048222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-653f6e60-c55d-4641-8617-51a67c66ca62 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:44.065715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-653f6e60-c55d-4641-8617-51a67c66ca62 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:44.068010 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-653f6e60-c55d-4641-8617-51a67c66ca62 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:44.069981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-653f6e60-c55d-4641-8617-51a67c66ca62 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:44.181475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-653f6e60-c55d-4641-8617-51a67c66ca62 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:44.197702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-653f6e60-c55d-4641-8617-51a67c66ca62 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1241 microversion: 2.1 time: 0.163005 Aug 30 14:42:44.199099 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 21/45] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:44 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1241 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:44.210819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2dbf9f9b-6bd4-4446-b075-536f17ea99e5 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:44.213636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2dbf9f9b-6bd4-4446-b075-536f17ea99e5 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:44.227936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dbf9f9b-6bd4-4446-b075-536f17ea99e5 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:44.228437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dbf9f9b-6bd4-4446-b075-536f17ea99e5 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:44.228887 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dbf9f9b-6bd4-4446-b075-536f17ea99e5 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:44.229591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dbf9f9b-6bd4-4446-b075-536f17ea99e5 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:44.230593 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dbf9f9b-6bd4-4446-b075-536f17ea99e5 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:44.231027 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dbf9f9b-6bd4-4446-b075-536f17ea99e5 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:44.426235 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2dbf9f9b-6bd4-4446-b075-536f17ea99e5 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:44.439965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2dbf9f9b-6bd4-4446-b075-536f17ea99e5 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.238621 Aug 30 14:42:44.441799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 22/46] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:44 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:44.607957 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Flavor limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:42:44.608478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Image limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:42:44.608965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Flavor pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:42:44.609411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Image pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:42:44.609832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:42:44.618424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:44.618909 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:44.619405 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:44.620135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:44.620596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:44.621024 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:44.643532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Getting quotas for project a8914c5bc86f4ee6a9797b05a6a7b12b. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:42:44.647436 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Getting quotas for user 6270e19d6245453ab79555a79532faba and project a8914c5bc86f4ee6a9797b05a6a7b12b. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:42:44.659063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Going to run 1 instances... {{(pid=127089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:42:44.661346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:42:44.727719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-36462110-f10b-478c-9af8-5e99f6c43256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.858410 Aug 30 14:42:44.729096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 25/47] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 14:42:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 14:42:44.739604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bdb03867-2905-4ef7-9c2e-28753817da10 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:44.740805 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bdb03867-2905-4ef7-9c2e-28753817da10 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:44.804594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bdb03867-2905-4ef7-9c2e-28753817da10 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:44.820839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bdb03867-2905-4ef7-9c2e-28753817da10 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:44.823181 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bdb03867-2905-4ef7-9c2e-28753817da10 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:44.824883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bdb03867-2905-4ef7-9c2e-28753817da10 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1280 microversion: 2.20 time: 0.089176 Aug 30 14:42:44.825959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 23/48] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:42:44 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:42:45.054292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5b767a71-d7a5-4e16-8ea1-a6f0810f7d45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:45.055264 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5b767a71-d7a5-4e16-8ea1-a6f0810f7d45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:45.089383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b767a71-d7a5-4e16-8ea1-a6f0810f7d45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:45.096728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b767a71-d7a5-4e16-8ea1-a6f0810f7d45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:45.099780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b767a71-d7a5-4e16-8ea1-a6f0810f7d45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:45.101614 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b767a71-d7a5-4e16-8ea1-a6f0810f7d45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:45.104114 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b767a71-d7a5-4e16-8ea1-a6f0810f7d45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:45.104397 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b767a71-d7a5-4e16-8ea1-a6f0810f7d45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:45.222166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6c477520-7df2-4cff-9ac9-a22576cef8b0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:45.246831 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6c477520-7df2-4cff-9ac9-a22576cef8b0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:45.259739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c477520-7df2-4cff-9ac9-a22576cef8b0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:45.260253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c477520-7df2-4cff-9ac9-a22576cef8b0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:45.260690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c477520-7df2-4cff-9ac9-a22576cef8b0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:45.261414 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c477520-7df2-4cff-9ac9-a22576cef8b0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:45.273531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c477520-7df2-4cff-9ac9-a22576cef8b0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:45.274287 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c477520-7df2-4cff-9ac9-a22576cef8b0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:45.305762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5b767a71-d7a5-4e16-8ea1-a6f0810f7d45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:45.325057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5b767a71-d7a5-4e16-8ea1-a6f0810f7d45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1279 microversion: 2.1 time: 0.284180 Aug 30 14:42:45.325669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 26/49] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:45 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1279 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:45.419655 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6c477520-7df2-4cff-9ac9-a22576cef8b0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:45.436861 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6c477520-7df2-4cff-9ac9-a22576cef8b0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1241 microversion: 2.1 time: 0.218776 Aug 30 14:42:45.441175 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 24/50] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:45 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1241 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:45.465130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3cd53224-7008-4805-aa93-ac66c19bab38 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:45.465801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3cd53224-7008-4805-aa93-ac66c19bab38 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:45.476244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3cd53224-7008-4805-aa93-ac66c19bab38 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:45.476760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3cd53224-7008-4805-aa93-ac66c19bab38 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:45.477557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3cd53224-7008-4805-aa93-ac66c19bab38 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:45.478515 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3cd53224-7008-4805-aa93-ac66c19bab38 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:45.478991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3cd53224-7008-4805-aa93-ac66c19bab38 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:45.479448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3cd53224-7008-4805-aa93-ac66c19bab38 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:45.667112 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3cd53224-7008-4805-aa93-ac66c19bab38 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:45.677317 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3cd53224-7008-4805-aa93-ac66c19bab38 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.218068 Aug 30 14:42:45.678250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 27/51] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:45 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:45.868093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-54b61aa1-12fc-4636-871e-e7545213b568 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:45.870349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-54b61aa1-12fc-4636-871e-e7545213b568 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:45.881919 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54b61aa1-12fc-4636-871e-e7545213b568 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:45.883471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54b61aa1-12fc-4636-871e-e7545213b568 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:45.885302 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54b61aa1-12fc-4636-871e-e7545213b568 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:45.886025 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54b61aa1-12fc-4636-871e-e7545213b568 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:45.886482 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54b61aa1-12fc-4636-871e-e7545213b568 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:45.886906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54b61aa1-12fc-4636-871e-e7545213b568 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:45.997173 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-54b61aa1-12fc-4636-871e-e7545213b568 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:46.015172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-54b61aa1-12fc-4636-871e-e7545213b568 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:46.015489 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-54b61aa1-12fc-4636-871e-e7545213b568 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:46.017984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-54b61aa1-12fc-4636-871e-e7545213b568 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1284 microversion: 2.20 time: 0.173437 Aug 30 14:42:46.020772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 25/52] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:42:45 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:42:46.353377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0be71835-aac3-4bc0-99e3-3610c205418c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:46.354666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0be71835-aac3-4bc0-99e3-3610c205418c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:46.367571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0be71835-aac3-4bc0-99e3-3610c205418c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:46.368602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0be71835-aac3-4bc0-99e3-3610c205418c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:46.370596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0be71835-aac3-4bc0-99e3-3610c205418c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:46.372001 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0be71835-aac3-4bc0-99e3-3610c205418c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:46.372450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0be71835-aac3-4bc0-99e3-3610c205418c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:46.372883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0be71835-aac3-4bc0-99e3-3610c205418c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:46.479168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-630403ac-50ed-4ac7-b3c3-2c3a929fc057 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:46.479837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-630403ac-50ed-4ac7-b3c3-2c3a929fc057 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:46.484828 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0be71835-aac3-4bc0-99e3-3610c205418c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:46.495004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630403ac-50ed-4ac7-b3c3-2c3a929fc057 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:46.495865 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630403ac-50ed-4ac7-b3c3-2c3a929fc057 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:46.497445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630403ac-50ed-4ac7-b3c3-2c3a929fc057 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:46.500392 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630403ac-50ed-4ac7-b3c3-2c3a929fc057 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:46.501040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630403ac-50ed-4ac7-b3c3-2c3a929fc057 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:46.501679 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630403ac-50ed-4ac7-b3c3-2c3a929fc057 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:46.531177 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0be71835-aac3-4bc0-99e3-3610c205418c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1279 microversion: 2.1 time: 0.185546 Aug 30 14:42:46.533566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 28/53] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:46 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1279 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:46.635291 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-630403ac-50ed-4ac7-b3c3-2c3a929fc057 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:46.646482 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-630403ac-50ed-4ac7-b3c3-2c3a929fc057 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1241 microversion: 2.1 time: 0.172096 Aug 30 14:42:46.648152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 26/54] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:46 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1241 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:46.714568 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9e1b03a8-4dd1-4406-8032-f3fc31f767cb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:46.716283 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9e1b03a8-4dd1-4406-8032-f3fc31f767cb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:46.726033 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9e1b03a8-4dd1-4406-8032-f3fc31f767cb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:46.731565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9e1b03a8-4dd1-4406-8032-f3fc31f767cb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:46.732017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9e1b03a8-4dd1-4406-8032-f3fc31f767cb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:46.733321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9e1b03a8-4dd1-4406-8032-f3fc31f767cb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:46.735982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9e1b03a8-4dd1-4406-8032-f3fc31f767cb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:46.736624 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9e1b03a8-4dd1-4406-8032-f3fc31f767cb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:46.958567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9e1b03a8-4dd1-4406-8032-f3fc31f767cb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:46.973994 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9e1b03a8-4dd1-4406-8032-f3fc31f767cb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.276414 Aug 30 14:42:46.975135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 29/55] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:46 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:47.044322 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9edfa058-0fc0-4f5f-a6a9-ba4adcf0c65e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:47.046011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9edfa058-0fc0-4f5f-a6a9-ba4adcf0c65e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:47.064464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9edfa058-0fc0-4f5f-a6a9-ba4adcf0c65e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:47.066526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9edfa058-0fc0-4f5f-a6a9-ba4adcf0c65e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:47.067142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9edfa058-0fc0-4f5f-a6a9-ba4adcf0c65e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:47.068549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9edfa058-0fc0-4f5f-a6a9-ba4adcf0c65e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:47.071535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9edfa058-0fc0-4f5f-a6a9-ba4adcf0c65e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:47.076660 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9edfa058-0fc0-4f5f-a6a9-ba4adcf0c65e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:47.256799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9edfa058-0fc0-4f5f-a6a9-ba4adcf0c65e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:47.277831 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9edfa058-0fc0-4f5f-a6a9-ba4adcf0c65e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:47.298129 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9edfa058-0fc0-4f5f-a6a9-ba4adcf0c65e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:47.308091 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9edfa058-0fc0-4f5f-a6a9-ba4adcf0c65e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1284 microversion: 2.20 time: 0.269938 Aug 30 14:42:47.331474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 27/56] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:42:47 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1284 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:42:47.564617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5cb5b13e-78c7-48b2-804d-1a17ebe8c6af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:47.565745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5cb5b13e-78c7-48b2-804d-1a17ebe8c6af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:47.576509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cb5b13e-78c7-48b2-804d-1a17ebe8c6af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:47.577099 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cb5b13e-78c7-48b2-804d-1a17ebe8c6af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:47.577797 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cb5b13e-78c7-48b2-804d-1a17ebe8c6af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:47.578929 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cb5b13e-78c7-48b2-804d-1a17ebe8c6af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:47.579693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cb5b13e-78c7-48b2-804d-1a17ebe8c6af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:47.580265 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cb5b13e-78c7-48b2-804d-1a17ebe8c6af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:47.671523 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8145977a-19cd-4f90-8443-cb1562052728 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:47.671523 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8145977a-19cd-4f90-8443-cb1562052728 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:47.691327 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8145977a-19cd-4f90-8443-cb1562052728 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:47.694393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5cb5b13e-78c7-48b2-804d-1a17ebe8c6af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:47.694956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8145977a-19cd-4f90-8443-cb1562052728 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:47.694956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8145977a-19cd-4f90-8443-cb1562052728 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:47.694956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8145977a-19cd-4f90-8443-cb1562052728 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:47.696694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8145977a-19cd-4f90-8443-cb1562052728 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:47.704962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8145977a-19cd-4f90-8443-cb1562052728 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:47.714885 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5cb5b13e-78c7-48b2-804d-1a17ebe8c6af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1279 microversion: 2.1 time: 0.166248 Aug 30 14:42:47.715871 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 30/57] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:47 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1279 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:47.874335 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8145977a-19cd-4f90-8443-cb1562052728 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:47.882401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8145977a-19cd-4f90-8443-cb1562052728 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1241 microversion: 2.1 time: 0.217084 Aug 30 14:42:47.887641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 28/58] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:47 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1241 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:42:48.010712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ba5f5cf9-20ab-40d7-aa3f-116fd4910404 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:48.011375 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ba5f5cf9-20ab-40d7-aa3f-116fd4910404 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:48.021646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba5f5cf9-20ab-40d7-aa3f-116fd4910404 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:48.024837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba5f5cf9-20ab-40d7-aa3f-116fd4910404 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:48.026363 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba5f5cf9-20ab-40d7-aa3f-116fd4910404 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:48.028249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba5f5cf9-20ab-40d7-aa3f-116fd4910404 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:48.030138 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba5f5cf9-20ab-40d7-aa3f-116fd4910404 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:48.032160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba5f5cf9-20ab-40d7-aa3f-116fd4910404 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:48.351060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9efd9173-0dc7-40c5-81aa-72f4eb305cc4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:48.354939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9efd9173-0dc7-40c5-81aa-72f4eb305cc4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:48.366527 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9efd9173-0dc7-40c5-81aa-72f4eb305cc4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:48.367310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9efd9173-0dc7-40c5-81aa-72f4eb305cc4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:48.367912 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9efd9173-0dc7-40c5-81aa-72f4eb305cc4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:48.371392 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9efd9173-0dc7-40c5-81aa-72f4eb305cc4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:48.372055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9efd9173-0dc7-40c5-81aa-72f4eb305cc4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:48.372642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9efd9173-0dc7-40c5-81aa-72f4eb305cc4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:48.586738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9efd9173-0dc7-40c5-81aa-72f4eb305cc4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:48.604904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9efd9173-0dc7-40c5-81aa-72f4eb305cc4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:48.607836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9efd9173-0dc7-40c5-81aa-72f4eb305cc4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:48.610685 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9efd9173-0dc7-40c5-81aa-72f4eb305cc4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1276 microversion: 2.20 time: 0.276313 Aug 30 14:42:48.624598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 29/59] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:42:48 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1276 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:42:48.737554 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f2065c0d-53b2-4c25-ae7d-fd55383c958a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:48.738294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f2065c0d-53b2-4c25-ae7d-fd55383c958a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:48.753090 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2065c0d-53b2-4c25-ae7d-fd55383c958a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:48.760227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2065c0d-53b2-4c25-ae7d-fd55383c958a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:48.761013 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2065c0d-53b2-4c25-ae7d-fd55383c958a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:48.762608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2065c0d-53b2-4c25-ae7d-fd55383c958a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:48.763251 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2065c0d-53b2-4c25-ae7d-fd55383c958a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:48.764880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2065c0d-53b2-4c25-ae7d-fd55383c958a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:48.852131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ba5f5cf9-20ab-40d7-aa3f-116fd4910404 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:48.892799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ba5f5cf9-20ab-40d7-aa3f-116fd4910404 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.896732 Aug 30 14:42:48.894612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 31/60] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:47 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:48.927635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-094720ff-7888-4920-8a7d-c127c139fd9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:48.928586 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-094720ff-7888-4920-8a7d-c127c139fd9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:48.942689 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-094720ff-7888-4920-8a7d-c127c139fd9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:48.944690 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-094720ff-7888-4920-8a7d-c127c139fd9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:48.946023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-094720ff-7888-4920-8a7d-c127c139fd9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:48.948107 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-094720ff-7888-4920-8a7d-c127c139fd9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:48.949378 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-094720ff-7888-4920-8a7d-c127c139fd9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:48.950206 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-094720ff-7888-4920-8a7d-c127c139fd9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:49.139528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-094720ff-7888-4920-8a7d-c127c139fd9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:49.162633 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f2065c0d-53b2-4c25-ae7d-fd55383c958a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:49.167079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-094720ff-7888-4920-8a7d-c127c139fd9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1289 microversion: 2.1 time: 0.242407 Aug 30 14:42:49.167821 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 32/61] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:48 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1289 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:49.187741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f2065c0d-53b2-4c25-ae7d-fd55383c958a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1279 microversion: 2.1 time: 0.454948 Aug 30 14:42:49.188991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 30/62] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:48 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1279 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:49.638491 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7e260487-b8c7-488e-bddb-85b9eb706e5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:49.639858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7e260487-b8c7-488e-bddb-85b9eb706e5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:49.657176 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7e260487-b8c7-488e-bddb-85b9eb706e5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:49.657844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7e260487-b8c7-488e-bddb-85b9eb706e5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:49.666303 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7e260487-b8c7-488e-bddb-85b9eb706e5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:49.671779 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7e260487-b8c7-488e-bddb-85b9eb706e5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:49.674371 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7e260487-b8c7-488e-bddb-85b9eb706e5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:49.674825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7e260487-b8c7-488e-bddb-85b9eb706e5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:49.924556 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-01366aa1-8473-475d-9c8d-5e2fb7a61ef8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:49.926188 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-01366aa1-8473-475d-9c8d-5e2fb7a61ef8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:49.929853 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:49.941486 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01366aa1-8473-475d-9c8d-5e2fb7a61ef8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:49.942238 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01366aa1-8473-475d-9c8d-5e2fb7a61ef8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:49.943800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01366aa1-8473-475d-9c8d-5e2fb7a61ef8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:49.945381 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01366aa1-8473-475d-9c8d-5e2fb7a61ef8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:49.949379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01366aa1-8473-475d-9c8d-5e2fb7a61ef8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:49.950140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01366aa1-8473-475d-9c8d-5e2fb7a61ef8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:50.013037 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7e260487-b8c7-488e-bddb-85b9eb706e5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:50.041027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7e260487-b8c7-488e-bddb-85b9eb706e5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:50.044058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7e260487-b8c7-488e-bddb-85b9eb706e5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:50.053057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7e260487-b8c7-488e-bddb-85b9eb706e5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1332 microversion: 2.20 time: 0.414671 Aug 30 14:42:50.068721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 33/63] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:42:49 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1332 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:42:50.202036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-51fd8559-e088-402a-9787-3b58910aa659 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:50.202036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-51fd8559-e088-402a-9787-3b58910aa659 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:50.229414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-51fd8559-e088-402a-9787-3b58910aa659 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:50.231417 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-51fd8559-e088-402a-9787-3b58910aa659 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:50.231861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-51fd8559-e088-402a-9787-3b58910aa659 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:50.232605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-51fd8559-e088-402a-9787-3b58910aa659 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:50.241131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-51fd8559-e088-402a-9787-3b58910aa659 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:50.241789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-51fd8559-e088-402a-9787-3b58910aa659 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:50.362359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-01366aa1-8473-475d-9c8d-5e2fb7a61ef8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:50.377723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-01366aa1-8473-475d-9c8d-5e2fb7a61ef8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.456001 Aug 30 14:42:50.381205 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 31/64] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:49 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:50.391516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-122cfc27-3a4a-443f-94a1-a131b3bf595b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:50.393824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-122cfc27-3a4a-443f-94a1-a131b3bf595b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:50.409812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-122cfc27-3a4a-443f-94a1-a131b3bf595b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:50.410541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-122cfc27-3a4a-443f-94a1-a131b3bf595b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:50.412457 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-122cfc27-3a4a-443f-94a1-a131b3bf595b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:50.414050 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-122cfc27-3a4a-443f-94a1-a131b3bf595b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:50.415046 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-122cfc27-3a4a-443f-94a1-a131b3bf595b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:50.415519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-122cfc27-3a4a-443f-94a1-a131b3bf595b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:50.725696 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-51fd8559-e088-402a-9787-3b58910aa659 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:50.746845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-51fd8559-e088-402a-9787-3b58910aa659 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1289 microversion: 2.1 time: 0.552124 Aug 30 14:42:50.748624 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 34/65] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:50 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1289 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:42:51.097782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9cd1642b-1be4-4bc1-89fd-89b82c9a1352 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:51.099341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9cd1642b-1be4-4bc1-89fd-89b82c9a1352 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:51.112538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9cd1642b-1be4-4bc1-89fd-89b82c9a1352 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:51.113214 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9cd1642b-1be4-4bc1-89fd-89b82c9a1352 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:51.113658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9cd1642b-1be4-4bc1-89fd-89b82c9a1352 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:51.116521 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9cd1642b-1be4-4bc1-89fd-89b82c9a1352 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:51.118275 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9cd1642b-1be4-4bc1-89fd-89b82c9a1352 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:51.120562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9cd1642b-1be4-4bc1-89fd-89b82c9a1352 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:51.441491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-122cfc27-3a4a-443f-94a1-a131b3bf595b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:51.450032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:51.459336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-122cfc27-3a4a-443f-94a1-a131b3bf595b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1321 microversion: 2.1 time: 1.076747 Aug 30 14:42:51.469885 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 32/66] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:50 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1321 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:51.478121 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5c023949-4a62-4400-baad-e468073018f2 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:51.488030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5c023949-4a62-4400-baad-e468073018f2 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:51.492791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9cd1642b-1be4-4bc1-89fd-89b82c9a1352 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:51.496769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c023949-4a62-4400-baad-e468073018f2 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:51.497265 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c023949-4a62-4400-baad-e468073018f2 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:51.497704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c023949-4a62-4400-baad-e468073018f2 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:51.502748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c023949-4a62-4400-baad-e468073018f2 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:51.504296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c023949-4a62-4400-baad-e468073018f2 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:51.504745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c023949-4a62-4400-baad-e468073018f2 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:51.510729 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9cd1642b-1be4-4bc1-89fd-89b82c9a1352 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:51.513286 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9cd1642b-1be4-4bc1-89fd-89b82c9a1352 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:51.520225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9cd1642b-1be4-4bc1-89fd-89b82c9a1352 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1338 microversion: 2.20 time: 0.425898 Aug 30 14:42:51.524266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 35/67] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:42:51 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1338 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:42:51.773116 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f8d1bc46-a71f-4cec-9637-f0b22f88a891 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:51.774084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f8d1bc46-a71f-4cec-9637-f0b22f88a891 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:51.797216 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8d1bc46-a71f-4cec-9637-f0b22f88a891 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:51.800083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8d1bc46-a71f-4cec-9637-f0b22f88a891 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:51.801123 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8d1bc46-a71f-4cec-9637-f0b22f88a891 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:51.804549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8d1bc46-a71f-4cec-9637-f0b22f88a891 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:51.805544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8d1bc46-a71f-4cec-9637-f0b22f88a891 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:51.808410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8d1bc46-a71f-4cec-9637-f0b22f88a891 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:52.171085 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5c023949-4a62-4400-baad-e468073018f2 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:52.181704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5c023949-4a62-4400-baad-e468073018f2 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.708014 Aug 30 14:42:52.200081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 33/68] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:51 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:52.274602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f8d1bc46-a71f-4cec-9637-f0b22f88a891 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:52.289621 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f8d1bc46-a71f-4cec-9637-f0b22f88a891 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1295 microversion: 2.1 time: 0.520733 Aug 30 14:42:52.291636 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 36/69] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:51 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1295 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:52.352540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:52.492091 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-20622def-f114-4354-ae33-2f281848e51d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:52.493275 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-20622def-f114-4354-ae33-2f281848e51d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:52.506171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20622def-f114-4354-ae33-2f281848e51d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:52.513638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20622def-f114-4354-ae33-2f281848e51d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:52.518637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20622def-f114-4354-ae33-2f281848e51d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:52.520908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20622def-f114-4354-ae33-2f281848e51d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:52.522836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20622def-f114-4354-ae33-2f281848e51d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:52.524638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20622def-f114-4354-ae33-2f281848e51d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:52.617472 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-83be1e17-73a3-4c33-8e84-d6290117f69a req-1e83aada-1114-4f34-8dc9-28fc17194099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee44201c-2900-4495-9e36-6dc27160909b", "tag": "a69483c2-5658-4efb-85f1-64bbe1596652"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:52.654858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-83be1e17-73a3-4c33-8e84-d6290117f69a req-1e83aada-1114-4f34-8dc9-28fc17194099 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:52.655380 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-83be1e17-73a3-4c33-8e84-d6290117f69a req-1e83aada-1114-4f34-8dc9-28fc17194099 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:52.655812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-83be1e17-73a3-4c33-8e84-d6290117f69a req-1e83aada-1114-4f34-8dc9-28fc17194099 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:52.719616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-83be1e17-73a3-4c33-8e84-d6290117f69a req-1e83aada-1114-4f34-8dc9-28fc17194099 service nova] Creating event network-changed:a69483c2-5658-4efb-85f1-64bbe1596652 for instance ee44201c-2900-4495-9e36-6dc27160909b on hv-cinder-82880 Aug 30 14:42:52.723617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-83be1e17-73a3-4c33-8e84-d6290117f69a req-1e83aada-1114-4f34-8dc9-28fc17194099 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127088) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 14:42:52.724182 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-83be1e17-73a3-4c33-8e84-d6290117f69a req-1e83aada-1114-4f34-8dc9-28fc17194099 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127088) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 14:42:52.725532 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa0b6246-1a3a-4235-aea8-1f78b5303afd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:52.726247 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa0b6246-1a3a-4235-aea8-1f78b5303afd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:52.726902 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa0b6246-1a3a-4235-aea8-1f78b5303afd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:52.734588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa0b6246-1a3a-4235-aea8-1f78b5303afd None None] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:52.735549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa0b6246-1a3a-4235-aea8-1f78b5303afd None None] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:52.736199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa0b6246-1a3a-4235-aea8-1f78b5303afd None None] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:52.755861 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.compute.rpcapi [None req-fa0b6246-1a3a-4235-aea8-1f78b5303afd None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 14:42:52.757128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa0b6246-1a3a-4235-aea8-1f78b5303afd None None] Releasing lock "compute-rpcapi-router" {{(pid=127088) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 14:42:52.806803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fa0b6246-1a3a-4235-aea8-1f78b5303afd None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.601373 Aug 30 14:42:52.809869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 34/70] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:52.831189 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-10d2604c-4d00-4df7-8de2-654050068ad4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:52.836773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-10d2604c-4d00-4df7-8de2-654050068ad4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:52.868278 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10d2604c-4d00-4df7-8de2-654050068ad4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:52.877846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10d2604c-4d00-4df7-8de2-654050068ad4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:52.879088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10d2604c-4d00-4df7-8de2-654050068ad4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:52.881089 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10d2604c-4d00-4df7-8de2-654050068ad4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:52.883675 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10d2604c-4d00-4df7-8de2-654050068ad4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:52.884922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10d2604c-4d00-4df7-8de2-654050068ad4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:53.564584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-20622def-f114-4354-ae33-2f281848e51d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:53.567903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-10d2604c-4d00-4df7-8de2-654050068ad4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:53.576613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-20622def-f114-4354-ae33-2f281848e51d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1321 microversion: 2.1 time: 1.088377 Aug 30 14:42:53.579914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 37/71] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:52 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1321 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:53.585165 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-10d2604c-4d00-4df7-8de2-654050068ad4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:53.586705 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-10d2604c-4d00-4df7-8de2-654050068ad4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:53.590256 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-10d2604c-4d00-4df7-8de2-654050068ad4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1338 microversion: 2.20 time: 0.778680 Aug 30 14:42:53.592399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 35/72] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:42:52 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1338 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:42:53.609379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ca5a9d92-a1f8-4b07-aace-001ad7e9a8e3 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:53.610004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ca5a9d92-a1f8-4b07-aace-001ad7e9a8e3 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:53.618282 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c213a20d-ebb8-43a1-ac9b-ccff1d5ddb29 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:53.618913 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c213a20d-ebb8-43a1-ac9b-ccff1d5ddb29 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:53.625536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca5a9d92-a1f8-4b07-aace-001ad7e9a8e3 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:53.626388 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca5a9d92-a1f8-4b07-aace-001ad7e9a8e3 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:53.628709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca5a9d92-a1f8-4b07-aace-001ad7e9a8e3 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:53.630241 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca5a9d92-a1f8-4b07-aace-001ad7e9a8e3 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:53.631753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca5a9d92-a1f8-4b07-aace-001ad7e9a8e3 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:53.633621 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca5a9d92-a1f8-4b07-aace-001ad7e9a8e3 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:53.636363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c213a20d-ebb8-43a1-ac9b-ccff1d5ddb29 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:53.637689 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c213a20d-ebb8-43a1-ac9b-ccff1d5ddb29 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:53.638299 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c213a20d-ebb8-43a1-ac9b-ccff1d5ddb29 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:53.639865 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c213a20d-ebb8-43a1-ac9b-ccff1d5ddb29 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:53.641483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c213a20d-ebb8-43a1-ac9b-ccff1d5ddb29 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:53.642082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c213a20d-ebb8-43a1-ac9b-ccff1d5ddb29 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:53.671635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:53.835332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c213a20d-ebb8-43a1-ac9b-ccff1d5ddb29 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:53.846383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c213a20d-ebb8-43a1-ac9b-ccff1d5ddb29 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1295 microversion: 2.1 time: 0.252454 Aug 30 14:42:53.851520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 36/73] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:53 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1295 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:54.127485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ca5a9d92-a1f8-4b07-aace-001ad7e9a8e3 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:54.139424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ca5a9d92-a1f8-4b07-aace-001ad7e9a8e3 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.541820 Aug 30 14:42:54.140570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 38/74] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:53 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:54.249211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-0eaba31e-069c-43f3-81ff-104e78bb0e02 req-12e8ecac-db8f-4120-8c13-184b6de4621d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6", "tag": "a7d69bde-3345-496f-9c80-be4cf35b221d"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:54.271849 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-0eaba31e-069c-43f3-81ff-104e78bb0e02 req-12e8ecac-db8f-4120-8c13-184b6de4621d service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:54.273703 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-0eaba31e-069c-43f3-81ff-104e78bb0e02 req-12e8ecac-db8f-4120-8c13-184b6de4621d service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:54.274668 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-0eaba31e-069c-43f3-81ff-104e78bb0e02 req-12e8ecac-db8f-4120-8c13-184b6de4621d service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:54.325645 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-0eaba31e-069c-43f3-81ff-104e78bb0e02 req-12e8ecac-db8f-4120-8c13-184b6de4621d service nova] Creating event network-changed:a7d69bde-3345-496f-9c80-be4cf35b221d for instance d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 on hv-cinder-82880 Aug 30 14:42:54.344337 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-0eaba31e-069c-43f3-81ff-104e78bb0e02 req-12e8ecac-db8f-4120-8c13-184b6de4621d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.491322 Aug 30 14:42:54.346434 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 37/75] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:54.603794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0e754454-189c-4fce-8945-37282939c7f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:54.606745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0e754454-189c-4fce-8945-37282939c7f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:54.629347 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-395d8483-670e-423e-974a-8f233bd29f90 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:54.632471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-395d8483-670e-423e-974a-8f233bd29f90 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:54.646104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=6 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:54.653317 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-395d8483-670e-423e-974a-8f233bd29f90 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:54.654343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-395d8483-670e-423e-974a-8f233bd29f90 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:54.655640 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-395d8483-670e-423e-974a-8f233bd29f90 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:54.656227 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=22 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:54.657114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-395d8483-670e-423e-974a-8f233bd29f90 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:54.658047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-395d8483-670e-423e-974a-8f233bd29f90 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:54.658991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-395d8483-670e-423e-974a-8f233bd29f90 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:54.660329 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e754454-189c-4fce-8945-37282939c7f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:54.661672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e754454-189c-4fce-8945-37282939c7f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:54.662131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e754454-189c-4fce-8945-37282939c7f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:54.664257 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e754454-189c-4fce-8945-37282939c7f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:54.667943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e754454-189c-4fce-8945-37282939c7f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:54.668554 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e754454-189c-4fce-8945-37282939c7f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:54.809563 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=26 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:54.883719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-395d8483-670e-423e-974a-8f233bd29f90 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:54.901778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-395d8483-670e-423e-974a-8f233bd29f90 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:54.903967 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-395d8483-670e-423e-974a-8f233bd29f90 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:54.906183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-395d8483-670e-423e-974a-8f233bd29f90 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1338 microversion: 2.20 time: 0.293319 Aug 30 14:42:54.907665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 38/76] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:42:54 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1338 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:42:54.917888 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1774a354-304e-406b-a3b9-653a3a242f1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:54.921830 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1774a354-304e-406b-a3b9-653a3a242f1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:54.932393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1774a354-304e-406b-a3b9-653a3a242f1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:54.934213 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1774a354-304e-406b-a3b9-653a3a242f1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:54.936543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1774a354-304e-406b-a3b9-653a3a242f1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:54.938765 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1774a354-304e-406b-a3b9-653a3a242f1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:54.941362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1774a354-304e-406b-a3b9-653a3a242f1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:54.942256 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1774a354-304e-406b-a3b9-653a3a242f1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:55.036310 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0e754454-189c-4fce-8945-37282939c7f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:55.048001 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0e754454-189c-4fce-8945-37282939c7f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1321 microversion: 2.1 time: 0.449833 Aug 30 14:42:55.062923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 39/77] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:54 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1321 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:55.168384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4702e571-f38d-45b4-a187-cfb86b4e876f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:55.169397 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4702e571-f38d-45b4-a187-cfb86b4e876f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:55.187649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4702e571-f38d-45b4-a187-cfb86b4e876f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:55.188309 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4702e571-f38d-45b4-a187-cfb86b4e876f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:55.188903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4702e571-f38d-45b4-a187-cfb86b4e876f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:55.191502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4702e571-f38d-45b4-a187-cfb86b4e876f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:55.191984 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4702e571-f38d-45b4-a187-cfb86b4e876f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:55.192414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4702e571-f38d-45b4-a187-cfb86b4e876f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:55.390182 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1774a354-304e-406b-a3b9-653a3a242f1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:55.408118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1774a354-304e-406b-a3b9-653a3a242f1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1362 microversion: 2.1 time: 0.498970 Aug 30 14:42:55.408903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 39/78] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:54 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1362 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:55.500513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4702e571-f38d-45b4-a187-cfb86b4e876f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:55.521118 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4702e571-f38d-45b4-a187-cfb86b4e876f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.355111 Aug 30 14:42:55.532774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 40/79] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:55 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:42:55.931602 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-82bf8569-b6e9-4da2-8b56-39e50a8795c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:55.932222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-82bf8569-b6e9-4da2-8b56-39e50a8795c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:55.950769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82bf8569-b6e9-4da2-8b56-39e50a8795c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:55.956362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82bf8569-b6e9-4da2-8b56-39e50a8795c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:55.957032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82bf8569-b6e9-4da2-8b56-39e50a8795c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:55.958024 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82bf8569-b6e9-4da2-8b56-39e50a8795c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:55.961572 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82bf8569-b6e9-4da2-8b56-39e50a8795c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:55.962730 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82bf8569-b6e9-4da2-8b56-39e50a8795c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:56.069700 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-547886b7-6cac-4b10-9fd9-399ac799de75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:56.070313 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-547886b7-6cac-4b10-9fd9-399ac799de75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:56.089020 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-547886b7-6cac-4b10-9fd9-399ac799de75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:56.089525 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-547886b7-6cac-4b10-9fd9-399ac799de75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:56.090046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-547886b7-6cac-4b10-9fd9-399ac799de75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:56.090665 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-547886b7-6cac-4b10-9fd9-399ac799de75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:56.091100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-547886b7-6cac-4b10-9fd9-399ac799de75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:56.091637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-547886b7-6cac-4b10-9fd9-399ac799de75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:56.462759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-547886b7-6cac-4b10-9fd9-399ac799de75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:56.481523 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-547886b7-6cac-4b10-9fd9-399ac799de75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1321 microversion: 2.1 time: 0.415874 Aug 30 14:42:56.483370 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 41/80] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:56 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1321 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:56.488560 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-09c382ed-71e3-4354-af9f-fa16c2d0d8f9 req-354fa067-608c-4253-95cd-418e9aa758e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bf1e549-0324-4db6-a4c7-3921ff741e3c", "tag": "1d53322c-4273-4da0-9fbb-eddde20eee0f"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:56.521717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-09c382ed-71e3-4354-af9f-fa16c2d0d8f9 req-354fa067-608c-4253-95cd-418e9aa758e3 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:56.522895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-09c382ed-71e3-4354-af9f-fa16c2d0d8f9 req-354fa067-608c-4253-95cd-418e9aa758e3 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:56.523421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-09c382ed-71e3-4354-af9f-fa16c2d0d8f9 req-354fa067-608c-4253-95cd-418e9aa758e3 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:56.544345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-09c382ed-71e3-4354-af9f-fa16c2d0d8f9 req-354fa067-608c-4253-95cd-418e9aa758e3 service nova] Creating event network-changed:1d53322c-4273-4da0-9fbb-eddde20eee0f for instance 1bf1e549-0324-4db6-a4c7-3921ff741e3c on hv-cinder-82880 Aug 30 14:42:56.544965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-09c382ed-71e3-4354-af9f-fa16c2d0d8f9 req-354fa067-608c-4253-95cd-418e9aa758e3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127089) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 14:42:56.546184 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-09c382ed-71e3-4354-af9f-fa16c2d0d8f9 req-354fa067-608c-4253-95cd-418e9aa758e3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127089) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 14:42:56.547635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86d8535b-6a96-456f-964f-5e176871d913 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:56.548281 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86d8535b-6a96-456f-964f-5e176871d913 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:56.548910 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86d8535b-6a96-456f-964f-5e176871d913 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:56.549815 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86d8535b-6a96-456f-964f-5e176871d913 None None] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:56.550482 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86d8535b-6a96-456f-964f-5e176871d913 None None] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:56.550982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86d8535b-6a96-456f-964f-5e176871d913 None None] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:56.560558 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.compute.rpcapi [None req-86d8535b-6a96-456f-964f-5e176871d913 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 14:42:56.561891 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86d8535b-6a96-456f-964f-5e176871d913 None None] Releasing lock "compute-rpcapi-router" {{(pid=127089) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 14:42:56.580365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-86d8535b-6a96-456f-964f-5e176871d913 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095326 Aug 30 14:42:56.581578 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 42/81] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:56.589939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f83e84eb-7dc2-41a3-9182-004fc5016a3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:56.593688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f83e84eb-7dc2-41a3-9182-004fc5016a3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:56.602591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:42:56.610629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f83e84eb-7dc2-41a3-9182-004fc5016a3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:56.611827 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f83e84eb-7dc2-41a3-9182-004fc5016a3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:56.612285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f83e84eb-7dc2-41a3-9182-004fc5016a3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:56.618944 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f83e84eb-7dc2-41a3-9182-004fc5016a3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:56.619801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f83e84eb-7dc2-41a3-9182-004fc5016a3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:56.620216 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f83e84eb-7dc2-41a3-9182-004fc5016a3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:56.873319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-82bf8569-b6e9-4da2-8b56-39e50a8795c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:56.882664 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-82bf8569-b6e9-4da2-8b56-39e50a8795c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:56.888272 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-82bf8569-b6e9-4da2-8b56-39e50a8795c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:56.891035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-82bf8569-b6e9-4da2-8b56-39e50a8795c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1406 microversion: 2.20 time: 0.964710 Aug 30 14:42:56.894009 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 40/82] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:42:55 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1406 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:42:56.905299 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6f7218bb-d25b-4493-a249-f5781e9fadbd tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:56.906481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6f7218bb-d25b-4493-a249-f5781e9fadbd tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:56.920094 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f7218bb-d25b-4493-a249-f5781e9fadbd tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:56.923016 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f7218bb-d25b-4493-a249-f5781e9fadbd tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:56.923779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f7218bb-d25b-4493-a249-f5781e9fadbd tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:56.927608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f7218bb-d25b-4493-a249-f5781e9fadbd tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:56.928266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f7218bb-d25b-4493-a249-f5781e9fadbd tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:56.928888 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f7218bb-d25b-4493-a249-f5781e9fadbd tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:56.947141 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f83e84eb-7dc2-41a3-9182-004fc5016a3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:56.957598 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f83e84eb-7dc2-41a3-9182-004fc5016a3b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1362 microversion: 2.1 time: 0.373269 Aug 30 14:42:56.959185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 43/83] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:56 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:57.225220 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-70ad3c33-9794-482f-b62b-2a017bdbdcd2 req-ea3ab299-6bca-4ec9-9fc4-4c4b7ffcbc7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9dfd407-56eb-4670-8ee7-5e0cabe294e3", "tag": "5494fd19-6c12-4b87-9225-d31bc888c0bc"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:57.255824 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-70ad3c33-9794-482f-b62b-2a017bdbdcd2 req-ea3ab299-6bca-4ec9-9fc4-4c4b7ffcbc7b service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:57.257278 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-70ad3c33-9794-482f-b62b-2a017bdbdcd2 req-ea3ab299-6bca-4ec9-9fc4-4c4b7ffcbc7b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:57.258775 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-70ad3c33-9794-482f-b62b-2a017bdbdcd2 req-ea3ab299-6bca-4ec9-9fc4-4c4b7ffcbc7b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:57.302991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-70ad3c33-9794-482f-b62b-2a017bdbdcd2 req-ea3ab299-6bca-4ec9-9fc4-4c4b7ffcbc7b service nova] Creating event network-changed:5494fd19-6c12-4b87-9225-d31bc888c0bc for instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 on hv-cinder-82880 Aug 30 14:42:57.322190 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-70ad3c33-9794-482f-b62b-2a017bdbdcd2 req-ea3ab299-6bca-4ec9-9fc4-4c4b7ffcbc7b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103519 Aug 30 14:42:57.325429 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 44/84] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:57.500848 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6f7218bb-d25b-4493-a249-f5781e9fadbd tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:57.506714 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-aba27475-97e5-45d5-9641-03e51fc48798 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:57.507461 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-aba27475-97e5-45d5-9641-03e51fc48798 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:57.516842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6f7218bb-d25b-4493-a249-f5781e9fadbd tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.620446 Aug 30 14:42:57.517692 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 41/85] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:56 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:57.541049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aba27475-97e5-45d5-9641-03e51fc48798 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:57.547704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aba27475-97e5-45d5-9641-03e51fc48798 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:57.548771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aba27475-97e5-45d5-9641-03e51fc48798 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:57.549519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aba27475-97e5-45d5-9641-03e51fc48798 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:57.554973 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aba27475-97e5-45d5-9641-03e51fc48798 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:57.555440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aba27475-97e5-45d5-9641-03e51fc48798 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:57.919580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-32726e46-adb3-4152-9cef-97a7b816ead0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:57.920472 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-32726e46-adb3-4152-9cef-97a7b816ead0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:57.929245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-32726e46-adb3-4152-9cef-97a7b816ead0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:57.935547 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-32726e46-adb3-4152-9cef-97a7b816ead0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:57.936328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-32726e46-adb3-4152-9cef-97a7b816ead0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:57.937340 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-32726e46-adb3-4152-9cef-97a7b816ead0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:57.938014 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-32726e46-adb3-4152-9cef-97a7b816ead0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:57.938620 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-32726e46-adb3-4152-9cef-97a7b816ead0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:58.098302 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-aba27475-97e5-45d5-9641-03e51fc48798 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:58.110310 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-aba27475-97e5-45d5-9641-03e51fc48798 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1321 microversion: 2.1 time: 0.608946 Aug 30 14:42:58.114612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 45/86] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:57 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1321 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:58.134057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a7985397-6021-4828-a035-76eb8acc5dac tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:58.134676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a7985397-6021-4828-a035-76eb8acc5dac tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:58.157990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7985397-6021-4828-a035-76eb8acc5dac tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:58.158486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7985397-6021-4828-a035-76eb8acc5dac tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:58.159189 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7985397-6021-4828-a035-76eb8acc5dac tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:58.160099 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7985397-6021-4828-a035-76eb8acc5dac tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:58.160884 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7985397-6021-4828-a035-76eb8acc5dac tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:58.161314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7985397-6021-4828-a035-76eb8acc5dac tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:58.332553 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-32726e46-adb3-4152-9cef-97a7b816ead0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:58.344998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-32726e46-adb3-4152-9cef-97a7b816ead0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:58.348287 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-32726e46-adb3-4152-9cef-97a7b816ead0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:58.350803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-32726e46-adb3-4152-9cef-97a7b816ead0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1406 microversion: 2.20 time: 0.435980 Aug 30 14:42:58.353348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 42/87] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:42:57 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:42:58.409935 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a7985397-6021-4828-a035-76eb8acc5dac tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:58.421817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a7985397-6021-4828-a035-76eb8acc5dac tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1362 microversion: 2.1 time: 0.304979 Aug 30 14:42:58.425675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 46/88] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:58 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:58.538628 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-41bd4657-56ab-4a72-b287-9d6ba1472c86 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:58.539303 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-41bd4657-56ab-4a72-b287-9d6ba1472c86 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:58.546147 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41bd4657-56ab-4a72-b287-9d6ba1472c86 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:58.546649 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41bd4657-56ab-4a72-b287-9d6ba1472c86 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:58.547924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41bd4657-56ab-4a72-b287-9d6ba1472c86 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:58.548646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41bd4657-56ab-4a72-b287-9d6ba1472c86 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:58.549100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41bd4657-56ab-4a72-b287-9d6ba1472c86 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:58.550123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41bd4657-56ab-4a72-b287-9d6ba1472c86 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:58.733013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-db7bb6f5-0a2e-4615-b5d5-b6460ff6e415 req-a50b9405-9d3a-4bb4-8d20-6fd6d68ed755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df823286-f7fd-4dbf-acb5-7cd297f48da0", "tag": "356c248c-dbd2-4ea8-93cc-dd834560932d"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:42:58.746047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-db7bb6f5-0a2e-4615-b5d5-b6460ff6e415 req-a50b9405-9d3a-4bb4-8d20-6fd6d68ed755 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:58.746546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-db7bb6f5-0a2e-4615-b5d5-b6460ff6e415 req-a50b9405-9d3a-4bb4-8d20-6fd6d68ed755 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:58.746978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-db7bb6f5-0a2e-4615-b5d5-b6460ff6e415 req-a50b9405-9d3a-4bb4-8d20-6fd6d68ed755 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:58.770168 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-db7bb6f5-0a2e-4615-b5d5-b6460ff6e415 req-a50b9405-9d3a-4bb4-8d20-6fd6d68ed755 service nova] Creating event network-changed:356c248c-dbd2-4ea8-93cc-dd834560932d for instance df823286-f7fd-4dbf-acb5-7cd297f48da0 on hv-cinder-82880 Aug 30 14:42:58.774088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-41bd4657-56ab-4a72-b287-9d6ba1472c86 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:58.777993 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-db7bb6f5-0a2e-4615-b5d5-b6460ff6e415 req-a50b9405-9d3a-4bb4-8d20-6fd6d68ed755 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048905 Aug 30 14:42:58.778632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 47/89] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:42:58.783175 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-41bd4657-56ab-4a72-b287-9d6ba1472c86 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.248702 Aug 30 14:42:58.783785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 43/90] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:58 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:59.131643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b0036321-8eed-4d0f-b3bb-b1956a3e43b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:59.132347 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b0036321-8eed-4d0f-b3bb-b1956a3e43b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:59.148056 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b0036321-8eed-4d0f-b3bb-b1956a3e43b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:59.148734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b0036321-8eed-4d0f-b3bb-b1956a3e43b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:59.149191 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b0036321-8eed-4d0f-b3bb-b1956a3e43b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:59.149923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b0036321-8eed-4d0f-b3bb-b1956a3e43b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:59.150553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b0036321-8eed-4d0f-b3bb-b1956a3e43b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:59.151737 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b0036321-8eed-4d0f-b3bb-b1956a3e43b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:59.377636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4437ed84-37f3-4f12-8041-11a50f933b28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:59.378249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4437ed84-37f3-4f12-8041-11a50f933b28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:59.384542 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4437ed84-37f3-4f12-8041-11a50f933b28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:59.385026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4437ed84-37f3-4f12-8041-11a50f933b28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:59.385455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4437ed84-37f3-4f12-8041-11a50f933b28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:59.386162 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4437ed84-37f3-4f12-8041-11a50f933b28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:59.397975 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4437ed84-37f3-4f12-8041-11a50f933b28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:59.398470 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4437ed84-37f3-4f12-8041-11a50f933b28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:59.494338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b0036321-8eed-4d0f-b3bb-b1956a3e43b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:59.507632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b0036321-8eed-4d0f-b3bb-b1956a3e43b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1321 microversion: 2.1 time: 0.380471 Aug 30 14:42:59.508405 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 48/91] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:59 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:59.517420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f5926f4b-c836-416c-9c4a-ff01100682b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:59.518834 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f5926f4b-c836-416c-9c4a-ff01100682b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:59.539432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5926f4b-c836-416c-9c4a-ff01100682b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:59.541914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5926f4b-c836-416c-9c4a-ff01100682b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:59.543911 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5926f4b-c836-416c-9c4a-ff01100682b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:59.546286 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5926f4b-c836-416c-9c4a-ff01100682b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:59.548882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5926f4b-c836-416c-9c4a-ff01100682b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:59.549966 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5926f4b-c836-416c-9c4a-ff01100682b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:59.799109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f5926f4b-c836-416c-9c4a-ff01100682b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:42:59.811441 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f5926f4b-c836-416c-9c4a-ff01100682b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1362 microversion: 2.1 time: 0.300430 Aug 30 14:42:59.816034 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 49/92] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:59 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:42:59.821489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a8a1194f-c7d5-42d4-b302-f1fd3230f11d tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:42:59.822319 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a8a1194f-c7d5-42d4-b302-f1fd3230f11d tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:42:59.842559 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a8a1194f-c7d5-42d4-b302-f1fd3230f11d tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:59.843943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a8a1194f-c7d5-42d4-b302-f1fd3230f11d tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:59.844759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a8a1194f-c7d5-42d4-b302-f1fd3230f11d tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:42:59.847042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a8a1194f-c7d5-42d4-b302-f1fd3230f11d tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:42:59.848224 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a8a1194f-c7d5-42d4-b302-f1fd3230f11d tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:42:59.849264 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a8a1194f-c7d5-42d4-b302-f1fd3230f11d tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:00.083611 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a8a1194f-c7d5-42d4-b302-f1fd3230f11d tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:00.097822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a8a1194f-c7d5-42d4-b302-f1fd3230f11d tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.280506 Aug 30 14:43:00.099302 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 50/93] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:42:59 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:00.119876 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4437ed84-37f3-4f12-8041-11a50f933b28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:00.130676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4437ed84-37f3-4f12-8041-11a50f933b28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:00.132232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4437ed84-37f3-4f12-8041-11a50f933b28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:00.133345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4437ed84-37f3-4f12-8041-11a50f933b28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1406 microversion: 2.20 time: 0.760973 Aug 30 14:43:00.134074 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 44/94] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:42:59 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1406 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:43:00.528184 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8b56db93-30e4-4e98-af7e-032e70c57488 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:00.529483 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8b56db93-30e4-4e98-af7e-032e70c57488 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:00.535931 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b56db93-30e4-4e98-af7e-032e70c57488 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:00.536536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b56db93-30e4-4e98-af7e-032e70c57488 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:00.537183 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b56db93-30e4-4e98-af7e-032e70c57488 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:00.537948 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b56db93-30e4-4e98-af7e-032e70c57488 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:00.538401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b56db93-30e4-4e98-af7e-032e70c57488 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:00.538823 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b56db93-30e4-4e98-af7e-032e70c57488 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:00.689715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8b56db93-30e4-4e98-af7e-032e70c57488 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:00.699923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8b56db93-30e4-4e98-af7e-032e70c57488 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1321 microversion: 2.1 time: 0.175672 Aug 30 14:43:00.714267 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 51/95] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:00 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:00.837450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dd63ced7-a598-4e8f-a625-6ebf62fb7bbe tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:00.840502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dd63ced7-a598-4e8f-a625-6ebf62fb7bbe tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:00.859181 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd63ced7-a598-4e8f-a625-6ebf62fb7bbe tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:00.861181 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd63ced7-a598-4e8f-a625-6ebf62fb7bbe tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:00.861998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd63ced7-a598-4e8f-a625-6ebf62fb7bbe tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:00.863474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd63ced7-a598-4e8f-a625-6ebf62fb7bbe tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:00.865227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd63ced7-a598-4e8f-a625-6ebf62fb7bbe tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:00.865936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd63ced7-a598-4e8f-a625-6ebf62fb7bbe tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:01.119793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-383d781c-e244-4616-8dc0-50b9a5de3c64 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:01.120504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-383d781c-e244-4616-8dc0-50b9a5de3c64 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:01.128568 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-383d781c-e244-4616-8dc0-50b9a5de3c64 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:01.129045 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-383d781c-e244-4616-8dc0-50b9a5de3c64 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:01.129529 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-383d781c-e244-4616-8dc0-50b9a5de3c64 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:01.130245 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-383d781c-e244-4616-8dc0-50b9a5de3c64 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:01.130708 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-383d781c-e244-4616-8dc0-50b9a5de3c64 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:01.131123 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-383d781c-e244-4616-8dc0-50b9a5de3c64 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:01.340963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-383d781c-e244-4616-8dc0-50b9a5de3c64 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:01.350085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-383d781c-e244-4616-8dc0-50b9a5de3c64 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.234105 Aug 30 14:43:01.354565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 52/96] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:01 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:43:01.360393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5915d4cc-71d8-4eb7-bda9-fc27ff69bd16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:01.361064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5915d4cc-71d8-4eb7-bda9-fc27ff69bd16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:01.377904 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5915d4cc-71d8-4eb7-bda9-fc27ff69bd16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:01.383479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5915d4cc-71d8-4eb7-bda9-fc27ff69bd16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:01.384129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5915d4cc-71d8-4eb7-bda9-fc27ff69bd16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:01.385004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5915d4cc-71d8-4eb7-bda9-fc27ff69bd16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:01.385600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5915d4cc-71d8-4eb7-bda9-fc27ff69bd16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:01.386177 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5915d4cc-71d8-4eb7-bda9-fc27ff69bd16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:01.441386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-dd63ced7-a598-4e8f-a625-6ebf62fb7bbe tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:01.452570 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dd63ced7-a598-4e8f-a625-6ebf62fb7bbe tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1362 microversion: 2.1 time: 0.620321 Aug 30 14:43:01.464280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 45/97] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:00 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1362 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:01.700625 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5915d4cc-71d8-4eb7-bda9-fc27ff69bd16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:01.717648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5915d4cc-71d8-4eb7-bda9-fc27ff69bd16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:01.724505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5915d4cc-71d8-4eb7-bda9-fc27ff69bd16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:01.725315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-64b330b5-3d74-4d76-ac9d-8a37254dcde6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:01.726179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-64b330b5-3d74-4d76-ac9d-8a37254dcde6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:01.729030 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5915d4cc-71d8-4eb7-bda9-fc27ff69bd16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1406 microversion: 2.20 time: 0.373461 Aug 30 14:43:01.733678 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 53/98] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:43:01 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1406 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:43:01.742211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64b330b5-3d74-4d76-ac9d-8a37254dcde6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:01.747522 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64b330b5-3d74-4d76-ac9d-8a37254dcde6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:01.749643 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64b330b5-3d74-4d76-ac9d-8a37254dcde6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:01.750623 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64b330b5-3d74-4d76-ac9d-8a37254dcde6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:01.751089 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64b330b5-3d74-4d76-ac9d-8a37254dcde6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:01.751550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64b330b5-3d74-4d76-ac9d-8a37254dcde6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:02.325435 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-64b330b5-3d74-4d76-ac9d-8a37254dcde6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:02.336669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-64b330b5-3d74-4d76-ac9d-8a37254dcde6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1321 microversion: 2.1 time: 0.615937 Aug 30 14:43:02.337680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 46/99] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:01 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1321 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:43:02.380138 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f77dafb4-0615-4fa4-b4fc-1151e4e1e09f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:02.380828 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f77dafb4-0615-4fa4-b4fc-1151e4e1e09f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:02.405336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f77dafb4-0615-4fa4-b4fc-1151e4e1e09f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:02.410184 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f77dafb4-0615-4fa4-b4fc-1151e4e1e09f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:02.414939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f77dafb4-0615-4fa4-b4fc-1151e4e1e09f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:02.415951 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f77dafb4-0615-4fa4-b4fc-1151e4e1e09f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:02.417657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f77dafb4-0615-4fa4-b4fc-1151e4e1e09f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:02.418275 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f77dafb4-0615-4fa4-b4fc-1151e4e1e09f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:02.587555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-bae02a0a-07c6-45c4-a62e-120d9d06d37d req-81ea8aaa-e880-4135-8c61-21df2a31f27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6", "name": "network-vif-plugged", "status": "completed", "tag": "a7d69bde-3345-496f-9c80-be4cf35b221d"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:43:02.600175 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bae02a0a-07c6-45c4-a62e-120d9d06d37d req-81ea8aaa-e880-4135-8c61-21df2a31f27a service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:02.600643 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bae02a0a-07c6-45c4-a62e-120d9d06d37d req-81ea8aaa-e880-4135-8c61-21df2a31f27a service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:02.601065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bae02a0a-07c6-45c4-a62e-120d9d06d37d req-81ea8aaa-e880-4135-8c61-21df2a31f27a service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:02.628378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-bae02a0a-07c6-45c4-a62e-120d9d06d37d req-81ea8aaa-e880-4135-8c61-21df2a31f27a service nova] Creating event network-vif-plugged:a7d69bde-3345-496f-9c80-be4cf35b221d for instance d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 on hv-cinder-82880 Aug 30 14:43:02.636117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-bae02a0a-07c6-45c4-a62e-120d9d06d37d req-81ea8aaa-e880-4135-8c61-21df2a31f27a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163269 Aug 30 14:43:02.637749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 47/100] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:43:02.644009 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-53910291-b6e7-496b-9a0c-efc61115e205 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:02.644713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-53910291-b6e7-496b-9a0c-efc61115e205 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:02.653422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53910291-b6e7-496b-9a0c-efc61115e205 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:02.654106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53910291-b6e7-496b-9a0c-efc61115e205 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:02.655301 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53910291-b6e7-496b-9a0c-efc61115e205 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:02.656493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53910291-b6e7-496b-9a0c-efc61115e205 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:02.657979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53910291-b6e7-496b-9a0c-efc61115e205 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:02.658712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53910291-b6e7-496b-9a0c-efc61115e205 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:02.672799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f77dafb4-0615-4fa4-b4fc-1151e4e1e09f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:02.683433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f77dafb4-0615-4fa4-b4fc-1151e4e1e09f tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.307396 Aug 30 14:43:02.697097 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 54/101] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:02 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:02.757897 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6203da9a-ac4e-4cdb-9eee-c547b027ed3f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:02.758641 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6203da9a-ac4e-4cdb-9eee-c547b027ed3f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:02.760689 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:02.766516 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6203da9a-ac4e-4cdb-9eee-c547b027ed3f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:02.767104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6203da9a-ac4e-4cdb-9eee-c547b027ed3f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:02.767538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6203da9a-ac4e-4cdb-9eee-c547b027ed3f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:02.768234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6203da9a-ac4e-4cdb-9eee-c547b027ed3f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:02.768874 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6203da9a-ac4e-4cdb-9eee-c547b027ed3f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:02.769324 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6203da9a-ac4e-4cdb-9eee-c547b027ed3f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:02.871983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-53910291-b6e7-496b-9a0c-efc61115e205 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:02.883781 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-53910291-b6e7-496b-9a0c-efc61115e205 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1362 microversion: 2.1 time: 0.244352 Aug 30 14:43:02.895815 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 48/102] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:02 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:02.972578 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6203da9a-ac4e-4cdb-9eee-c547b027ed3f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:02.981842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6203da9a-ac4e-4cdb-9eee-c547b027ed3f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:02.984234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6203da9a-ac4e-4cdb-9eee-c547b027ed3f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:02.985537 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6203da9a-ac4e-4cdb-9eee-c547b027ed3f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1406 microversion: 2.20 time: 0.231799 Aug 30 14:43:02.986181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 55/103] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:43:02 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:43:03.360353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4ac478b2-8ed4-4f7d-b000-4fa474869eac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:03.361028 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4ac478b2-8ed4-4f7d-b000-4fa474869eac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:03.368783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ac478b2-8ed4-4f7d-b000-4fa474869eac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:03.369271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ac478b2-8ed4-4f7d-b000-4fa474869eac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:03.369697 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ac478b2-8ed4-4f7d-b000-4fa474869eac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:03.370381 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ac478b2-8ed4-4f7d-b000-4fa474869eac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:03.370821 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ac478b2-8ed4-4f7d-b000-4fa474869eac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:03.371257 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ac478b2-8ed4-4f7d-b000-4fa474869eac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:03.708583 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4ac478b2-8ed4-4f7d-b000-4fa474869eac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:03.714833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-211fe8cf-37a3-4ea9-9c47-b9c261cf7d24 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:03.715493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-211fe8cf-37a3-4ea9-9c47-b9c261cf7d24 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:03.739051 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-211fe8cf-37a3-4ea9-9c47-b9c261cf7d24 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:03.739607 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-211fe8cf-37a3-4ea9-9c47-b9c261cf7d24 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:03.743597 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4ac478b2-8ed4-4f7d-b000-4fa474869eac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1321 microversion: 2.1 time: 0.380298 Aug 30 14:43:03.763503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 49/104] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:03 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:03.764633 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-211fe8cf-37a3-4ea9-9c47-b9c261cf7d24 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:03.766134 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-211fe8cf-37a3-4ea9-9c47-b9c261cf7d24 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:03.766766 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-211fe8cf-37a3-4ea9-9c47-b9c261cf7d24 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:03.767245 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-211fe8cf-37a3-4ea9-9c47-b9c261cf7d24 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:03.908055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-91b8895c-36dd-4078-a2c1-168f988f7583 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:03.908682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-91b8895c-36dd-4078-a2c1-168f988f7583 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:03.922323 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91b8895c-36dd-4078-a2c1-168f988f7583 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:03.923265 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91b8895c-36dd-4078-a2c1-168f988f7583 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:03.925418 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91b8895c-36dd-4078-a2c1-168f988f7583 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:03.926518 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91b8895c-36dd-4078-a2c1-168f988f7583 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:03.928284 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91b8895c-36dd-4078-a2c1-168f988f7583 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:03.928738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91b8895c-36dd-4078-a2c1-168f988f7583 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:04.161810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-211fe8cf-37a3-4ea9-9c47-b9c261cf7d24 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:04.165313 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:04.175372 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-211fe8cf-37a3-4ea9-9c47-b9c261cf7d24 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.470098 Aug 30 14:43:04.179880 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 56/105] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:03 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:04.191311 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b71d94c9-238a-4adf-b6e9-773a8e9c5a9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:04.193178 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b71d94c9-238a-4adf-b6e9-773a8e9c5a9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:04.199022 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-91b8895c-36dd-4078-a2c1-168f988f7583 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:04.206059 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b71d94c9-238a-4adf-b6e9-773a8e9c5a9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:04.208274 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b71d94c9-238a-4adf-b6e9-773a8e9c5a9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:04.211123 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b71d94c9-238a-4adf-b6e9-773a8e9c5a9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:04.212121 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b71d94c9-238a-4adf-b6e9-773a8e9c5a9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:04.213717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b71d94c9-238a-4adf-b6e9-773a8e9c5a9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:04.214266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-91b8895c-36dd-4078-a2c1-168f988f7583 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1362 microversion: 2.1 time: 0.311993 Aug 30 14:43:04.215440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 50/106] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:03 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:04.215987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b71d94c9-238a-4adf-b6e9-773a8e9c5a9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:04.455871 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b71d94c9-238a-4adf-b6e9-773a8e9c5a9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:04.465804 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b71d94c9-238a-4adf-b6e9-773a8e9c5a9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:04.469167 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b71d94c9-238a-4adf-b6e9-773a8e9c5a9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:04.470857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b71d94c9-238a-4adf-b6e9-773a8e9c5a9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1406 microversion: 2.20 time: 0.288568 Aug 30 14:43:04.472040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 57/107] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:43:04 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:43:04.661289 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-9e5351f2-afb9-4ebe-9b91-2dd5bf17befa req-54cd5cd4-8860-4a71-bdb5-9ccf5265f82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee44201c-2900-4495-9e36-6dc27160909b", "name": "network-vif-plugged", "status": "completed", "tag": "a69483c2-5658-4efb-85f1-64bbe1596652"}, {"server_uuid": "1bf1e549-0324-4db6-a4c7-3921ff741e3c", "name": "network-vif-plugged", "status": "completed", "tag": "1d53322c-4273-4da0-9fbb-eddde20eee0f"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:43:04.676117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-9e5351f2-afb9-4ebe-9b91-2dd5bf17befa req-54cd5cd4-8860-4a71-bdb5-9ccf5265f82e service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:04.676920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-9e5351f2-afb9-4ebe-9b91-2dd5bf17befa req-54cd5cd4-8860-4a71-bdb5-9ccf5265f82e service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:04.677759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-9e5351f2-afb9-4ebe-9b91-2dd5bf17befa req-54cd5cd4-8860-4a71-bdb5-9ccf5265f82e service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:04.683526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:04.695727 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-9e5351f2-afb9-4ebe-9b91-2dd5bf17befa req-54cd5cd4-8860-4a71-bdb5-9ccf5265f82e service nova] Creating event network-vif-plugged:a69483c2-5658-4efb-85f1-64bbe1596652 for instance ee44201c-2900-4495-9e36-6dc27160909b on hv-cinder-82880 Aug 30 14:43:04.696468 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-9e5351f2-afb9-4ebe-9b91-2dd5bf17befa req-54cd5cd4-8860-4a71-bdb5-9ccf5265f82e service nova] Creating event network-vif-plugged:1d53322c-4273-4da0-9fbb-eddde20eee0f for instance 1bf1e549-0324-4db6-a4c7-3921ff741e3c on hv-cinder-82880 Aug 30 14:43:04.706634 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-9e5351f2-afb9-4ebe-9b91-2dd5bf17befa req-54cd5cd4-8860-4a71-bdb5-9ccf5265f82e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050131 Aug 30 14:43:04.712202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 51/108] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:43:04.770584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1cf4ea9d-57d5-4d1e-b760-ca660be24875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:04.771117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1cf4ea9d-57d5-4d1e-b760-ca660be24875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:04.777272 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cf4ea9d-57d5-4d1e-b760-ca660be24875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:04.778024 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cf4ea9d-57d5-4d1e-b760-ca660be24875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:04.778641 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cf4ea9d-57d5-4d1e-b760-ca660be24875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:04.779792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cf4ea9d-57d5-4d1e-b760-ca660be24875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:04.780673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cf4ea9d-57d5-4d1e-b760-ca660be24875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:04.781378 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cf4ea9d-57d5-4d1e-b760-ca660be24875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:05.026930 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1cf4ea9d-57d5-4d1e-b760-ca660be24875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:05.036877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1cf4ea9d-57d5-4d1e-b760-ca660be24875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1321 microversion: 2.1 time: 0.270136 Aug 30 14:43:05.038037 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 58/109] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:04 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:05.200009 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1b19f7ff-4af6-4ca9-8f41-d9bf80eeceab tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:05.200702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1b19f7ff-4af6-4ca9-8f41-d9bf80eeceab tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:05.211335 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b19f7ff-4af6-4ca9-8f41-d9bf80eeceab tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:05.211836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b19f7ff-4af6-4ca9-8f41-d9bf80eeceab tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:05.212301 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b19f7ff-4af6-4ca9-8f41-d9bf80eeceab tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:05.212955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b19f7ff-4af6-4ca9-8f41-d9bf80eeceab tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:05.213783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b19f7ff-4af6-4ca9-8f41-d9bf80eeceab tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:05.213783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b19f7ff-4af6-4ca9-8f41-d9bf80eeceab tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:05.236857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9351feb3-0433-4209-8fa9-82eb1fc7b3ad tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:05.237868 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9351feb3-0433-4209-8fa9-82eb1fc7b3ad tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:05.250713 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9351feb3-0433-4209-8fa9-82eb1fc7b3ad tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:05.251883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9351feb3-0433-4209-8fa9-82eb1fc7b3ad tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:05.252325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9351feb3-0433-4209-8fa9-82eb1fc7b3ad tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:05.253036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9351feb3-0433-4209-8fa9-82eb1fc7b3ad tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:05.257670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9351feb3-0433-4209-8fa9-82eb1fc7b3ad tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:05.257670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9351feb3-0433-4209-8fa9-82eb1fc7b3ad tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:05.515328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9351feb3-0433-4209-8fa9-82eb1fc7b3ad tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:05.537583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9351feb3-0433-4209-8fa9-82eb1fc7b3ad tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1362 microversion: 2.1 time: 0.304693 Aug 30 14:43:05.538649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 59/110] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:05 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:43:05.577757 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c9664ead-3019-4ba3-881e-da4a02e54280 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:05.579915 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c9664ead-3019-4ba3-881e-da4a02e54280 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:05.599760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c9664ead-3019-4ba3-881e-da4a02e54280 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:05.601428 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c9664ead-3019-4ba3-881e-da4a02e54280 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:05.602132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c9664ead-3019-4ba3-881e-da4a02e54280 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:05.603054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c9664ead-3019-4ba3-881e-da4a02e54280 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:05.603731 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c9664ead-3019-4ba3-881e-da4a02e54280 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:05.604535 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c9664ead-3019-4ba3-881e-da4a02e54280 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:05.630027 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1b19f7ff-4af6-4ca9-8f41-d9bf80eeceab tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:05.640763 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1b19f7ff-4af6-4ca9-8f41-d9bf80eeceab tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.444916 Aug 30 14:43:05.653948 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 52/111] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:05 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:05.880753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c9664ead-3019-4ba3-881e-da4a02e54280 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:05.907181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c9664ead-3019-4ba3-881e-da4a02e54280 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:05.908995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c9664ead-3019-4ba3-881e-da4a02e54280 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:05.910248 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c9664ead-3019-4ba3-881e-da4a02e54280 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1406 microversion: 2.20 time: 0.359722 Aug 30 14:43:05.911058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 60/112] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:43:05 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1406 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:43:06.058591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8a1571a2-964b-4f82-99bb-039023ffaba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:06.059298 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8a1571a2-964b-4f82-99bb-039023ffaba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:06.071833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a1571a2-964b-4f82-99bb-039023ffaba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:06.072950 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a1571a2-964b-4f82-99bb-039023ffaba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:06.073718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a1571a2-964b-4f82-99bb-039023ffaba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:06.074840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a1571a2-964b-4f82-99bb-039023ffaba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:06.075555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a1571a2-964b-4f82-99bb-039023ffaba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:06.076574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a1571a2-964b-4f82-99bb-039023ffaba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:06.318881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8a1571a2-964b-4f82-99bb-039023ffaba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:06.331781 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8a1571a2-964b-4f82-99bb-039023ffaba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1321 microversion: 2.1 time: 0.277884 Aug 30 14:43:06.332685 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 53/113] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:06 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:06.567190 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-809022e7-3a95-4930-80f9-2caee93036b2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:06.567829 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-809022e7-3a95-4930-80f9-2caee93036b2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:06.570351 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:06.580459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-809022e7-3a95-4930-80f9-2caee93036b2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:06.583541 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-809022e7-3a95-4930-80f9-2caee93036b2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:06.584728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-809022e7-3a95-4930-80f9-2caee93036b2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:06.585850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-809022e7-3a95-4930-80f9-2caee93036b2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:06.586655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-809022e7-3a95-4930-80f9-2caee93036b2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:06.587851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-809022e7-3a95-4930-80f9-2caee93036b2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:06.661782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bf7caf9c-f742-42a0-8d8b-424107ed707b tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:06.662671 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bf7caf9c-f742-42a0-8d8b-424107ed707b tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:06.673035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf7caf9c-f742-42a0-8d8b-424107ed707b tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:06.674559 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf7caf9c-f742-42a0-8d8b-424107ed707b tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:06.675410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf7caf9c-f742-42a0-8d8b-424107ed707b tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:06.677147 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf7caf9c-f742-42a0-8d8b-424107ed707b tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:06.678364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf7caf9c-f742-42a0-8d8b-424107ed707b tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:06.687562 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf7caf9c-f742-42a0-8d8b-424107ed707b tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:06.892843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bf7caf9c-f742-42a0-8d8b-424107ed707b tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:06.901889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bf7caf9c-f742-42a0-8d8b-424107ed707b tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.244119 Aug 30 14:43:06.903549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 54/114] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:06 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:43:06.908845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-a9e9c66b-2c28-4d7d-b3e2-4f47b719f29b req-04c52711-f193-4fc5-bcd2-a6bbc279714b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9dfd407-56eb-4670-8ee7-5e0cabe294e3", "name": "network-vif-plugged", "status": "completed", "tag": "5494fd19-6c12-4b87-9225-d31bc888c0bc"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:43:06.918642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a9e9c66b-2c28-4d7d-b3e2-4f47b719f29b req-04c52711-f193-4fc5-bcd2-a6bbc279714b service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:06.919109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a9e9c66b-2c28-4d7d-b3e2-4f47b719f29b req-04c52711-f193-4fc5-bcd2-a6bbc279714b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:06.919550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a9e9c66b-2c28-4d7d-b3e2-4f47b719f29b req-04c52711-f193-4fc5-bcd2-a6bbc279714b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:06.932105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-809022e7-3a95-4930-80f9-2caee93036b2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:06.933955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-a9e9c66b-2c28-4d7d-b3e2-4f47b719f29b req-04c52711-f193-4fc5-bcd2-a6bbc279714b service nova] Creating event network-vif-plugged:5494fd19-6c12-4b87-9225-d31bc888c0bc for instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 on hv-cinder-82880 Aug 30 14:43:06.941197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-a9e9c66b-2c28-4d7d-b3e2-4f47b719f29b req-04c52711-f193-4fc5-bcd2-a6bbc279714b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035690 Aug 30 14:43:06.943362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-809022e7-3a95-4930-80f9-2caee93036b2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1362 microversion: 2.1 time: 0.380308 Aug 30 14:43:06.945319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 55/115] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:43:06.950749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-774e054d-f349-4b3c-aa09-b58cff51db01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:06.951543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-774e054d-f349-4b3c-aa09-b58cff51db01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:06.957989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-774e054d-f349-4b3c-aa09-b58cff51db01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:06.958475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-774e054d-f349-4b3c-aa09-b58cff51db01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:06.958909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-774e054d-f349-4b3c-aa09-b58cff51db01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:06.959018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 61/116] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:06 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1362 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:06.959636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-774e054d-f349-4b3c-aa09-b58cff51db01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:06.960091 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-774e054d-f349-4b3c-aa09-b58cff51db01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:06.960515 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-774e054d-f349-4b3c-aa09-b58cff51db01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:07.153316 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-774e054d-f349-4b3c-aa09-b58cff51db01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:07.163588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-774e054d-f349-4b3c-aa09-b58cff51db01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:07.165386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-774e054d-f349-4b3c-aa09-b58cff51db01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:07.167164 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-774e054d-f349-4b3c-aa09-b58cff51db01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1406 microversion: 2.20 time: 0.220681 Aug 30 14:43:07.171269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 56/117] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:43:06 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:43:07.353528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-94570983-0c5b-4335-9e45-4d89bafae126 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:07.354272 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-94570983-0c5b-4335-9e45-4d89bafae126 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:07.362374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-94570983-0c5b-4335-9e45-4d89bafae126 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:07.362872 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-94570983-0c5b-4335-9e45-4d89bafae126 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:07.363334 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-94570983-0c5b-4335-9e45-4d89bafae126 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:07.364064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-94570983-0c5b-4335-9e45-4d89bafae126 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:07.364664 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-94570983-0c5b-4335-9e45-4d89bafae126 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:07.365088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-94570983-0c5b-4335-9e45-4d89bafae126 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:07.623976 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-94570983-0c5b-4335-9e45-4d89bafae126 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:07.640969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-94570983-0c5b-4335-9e45-4d89bafae126 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1321 microversion: 2.1 time: 0.291248 Aug 30 14:43:07.641865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 62/118] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:07 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:43:07.924329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a0bc8529-f05b-4884-b99f-2eb023a46fcc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:07.925071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a0bc8529-f05b-4884-b99f-2eb023a46fcc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:07.932860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0bc8529-f05b-4884-b99f-2eb023a46fcc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:07.933329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0bc8529-f05b-4884-b99f-2eb023a46fcc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:07.936570 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0bc8529-f05b-4884-b99f-2eb023a46fcc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:07.937270 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0bc8529-f05b-4884-b99f-2eb023a46fcc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:07.940764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0bc8529-f05b-4884-b99f-2eb023a46fcc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:07.941290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0bc8529-f05b-4884-b99f-2eb023a46fcc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:07.968329 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-670101f4-8406-4594-aeb8-a709a7426c51 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:07.969535 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-670101f4-8406-4594-aeb8-a709a7426c51 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:07.977131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-670101f4-8406-4594-aeb8-a709a7426c51 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:07.977679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-670101f4-8406-4594-aeb8-a709a7426c51 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:07.978102 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-670101f4-8406-4594-aeb8-a709a7426c51 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:07.978805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-670101f4-8406-4594-aeb8-a709a7426c51 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:07.979285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-670101f4-8406-4594-aeb8-a709a7426c51 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:07.979932 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-670101f4-8406-4594-aeb8-a709a7426c51 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:08.158427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-670101f4-8406-4594-aeb8-a709a7426c51 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:08.160151 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a0bc8529-f05b-4884-b99f-2eb023a46fcc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:08.168464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a0bc8529-f05b-4884-b99f-2eb023a46fcc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1315 microversion: 2.1 time: 0.248471 Aug 30 14:43:08.170365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-670101f4-8406-4594-aeb8-a709a7426c51 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1362 microversion: 2.1 time: 0.208040 Aug 30 14:43:08.183393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 57/119] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:07 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:08.184987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 63/120] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:07 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:43:08.190197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0595ae8f-f6fc-4109-8244-23e220cfe9c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:08.191122 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0595ae8f-f6fc-4109-8244-23e220cfe9c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:08.198619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0595ae8f-f6fc-4109-8244-23e220cfe9c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:08.199079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0595ae8f-f6fc-4109-8244-23e220cfe9c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:08.199534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0595ae8f-f6fc-4109-8244-23e220cfe9c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:08.200377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0595ae8f-f6fc-4109-8244-23e220cfe9c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:08.201547 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0595ae8f-f6fc-4109-8244-23e220cfe9c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:08.202205 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0595ae8f-f6fc-4109-8244-23e220cfe9c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:08.367364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0595ae8f-f6fc-4109-8244-23e220cfe9c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:08.376160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0595ae8f-f6fc-4109-8244-23e220cfe9c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:08.377633 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0595ae8f-f6fc-4109-8244-23e220cfe9c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:08.378803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0595ae8f-f6fc-4109-8244-23e220cfe9c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1406 microversion: 2.20 time: 0.192634 Aug 30 14:43:08.380450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 58/121] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:43:08 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:43:08.661210 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9a43b4be-c869-4381-a70b-6b78c566fae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:08.661825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9a43b4be-c869-4381-a70b-6b78c566fae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:08.668763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a43b4be-c869-4381-a70b-6b78c566fae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:08.669245 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a43b4be-c869-4381-a70b-6b78c566fae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:08.669672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a43b4be-c869-4381-a70b-6b78c566fae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:08.670570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a43b4be-c869-4381-a70b-6b78c566fae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:08.674591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a43b4be-c869-4381-a70b-6b78c566fae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:08.674863 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a43b4be-c869-4381-a70b-6b78c566fae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:08.846414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9a43b4be-c869-4381-a70b-6b78c566fae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:08.854747 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9a43b4be-c869-4381-a70b-6b78c566fae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1515 microversion: 2.1 time: 0.197192 Aug 30 14:43:08.856409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 64/122] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:08 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:08.878049 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d4b1559a-bf4b-4a86-aaf5-23f268945334 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:43:08.880339 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d4b1559a-bf4b-4a86-aaf5-23f268945334 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:08.890410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4b1559a-bf4b-4a86-aaf5-23f268945334 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:08.890961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4b1559a-bf4b-4a86-aaf5-23f268945334 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:08.891624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4b1559a-bf4b-4a86-aaf5-23f268945334 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:08.892354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4b1559a-bf4b-4a86-aaf5-23f268945334 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:08.893070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4b1559a-bf4b-4a86-aaf5-23f268945334 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:08.893856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4b1559a-bf4b-4a86-aaf5-23f268945334 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:08.967293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-38f572e6-da74-4ef0-9964-ac911f6fbe56 req-6b753445-80c9-4ee0-871d-290c8dd2ee59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df823286-f7fd-4dbf-acb5-7cd297f48da0", "name": "network-vif-plugged", "status": "completed", "tag": "356c248c-dbd2-4ea8-93cc-dd834560932d"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:43:08.993182 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-d4b1559a-bf4b-4a86-aaf5-23f268945334 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lazy-loading 'flavor' on Instance uuid 1bf1e549-0324-4db6-a4c7-3921ff741e3c {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:43:08.997567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-38f572e6-da74-4ef0-9964-ac911f6fbe56 req-6b753445-80c9-4ee0-871d-290c8dd2ee59 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:08.998438 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-38f572e6-da74-4ef0-9964-ac911f6fbe56 req-6b753445-80c9-4ee0-871d-290c8dd2ee59 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:08.998970 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-38f572e6-da74-4ef0-9964-ac911f6fbe56 req-6b753445-80c9-4ee0-871d-290c8dd2ee59 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:09.015447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-38f572e6-da74-4ef0-9964-ac911f6fbe56 req-6b753445-80c9-4ee0-871d-290c8dd2ee59 service nova] Creating event network-vif-plugged:356c248c-dbd2-4ea8-93cc-dd834560932d for instance df823286-f7fd-4dbf-acb5-7cd297f48da0 on hv-cinder-82880 Aug 30 14:43:09.025875 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-38f572e6-da74-4ef0-9964-ac911f6fbe56 req-6b753445-80c9-4ee0-871d-290c8dd2ee59 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069657 Aug 30 14:43:09.030747 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 65/123] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:43:09.194816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e3f58a17-08fe-4989-8125-412f4cd477aa tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:09.195555 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e3f58a17-08fe-4989-8125-412f4cd477aa tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:09.211742 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d4b1559a-bf4b-4a86-aaf5-23f268945334 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "POST /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c/action" status: 200 len: 32 microversion: 2.1 time: 0.337056 Aug 30 14:43:09.214733 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 59/124] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 14:43:08 2022] POST /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c/action => generated 32 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 14:43:09.219104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3f58a17-08fe-4989-8125-412f4cd477aa tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:09.222301 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3f58a17-08fe-4989-8125-412f4cd477aa tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:09.223075 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3f58a17-08fe-4989-8125-412f4cd477aa tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:09.224046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3f58a17-08fe-4989-8125-412f4cd477aa tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:09.225124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3f58a17-08fe-4989-8125-412f4cd477aa tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:09.225751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f95f3f18-ec36-4f00-a5d3-fe8cec65f885 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:09.226968 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3f58a17-08fe-4989-8125-412f4cd477aa tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:09.235656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f95f3f18-ec36-4f00-a5d3-fe8cec65f885 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:09.250589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f95f3f18-ec36-4f00-a5d3-fe8cec65f885 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:09.251099 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f95f3f18-ec36-4f00-a5d3-fe8cec65f885 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:09.251575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f95f3f18-ec36-4f00-a5d3-fe8cec65f885 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:09.252293 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f95f3f18-ec36-4f00-a5d3-fe8cec65f885 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:09.252750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f95f3f18-ec36-4f00-a5d3-fe8cec65f885 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:09.253309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f95f3f18-ec36-4f00-a5d3-fe8cec65f885 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:09.477565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f95f3f18-ec36-4f00-a5d3-fe8cec65f885 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:09.494992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e3f58a17-08fe-4989-8125-412f4cd477aa tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:09.535563 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e3f58a17-08fe-4989-8125-412f4cd477aa tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1502 microversion: 2.1 time: 0.342968 Aug 30 14:43:09.535563 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 66/125] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:09 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1502 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:43:09.535714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f95f3f18-ec36-4f00-a5d3-fe8cec65f885 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1362 microversion: 2.1 time: 0.309012 Aug 30 14:43:09.535714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 60/126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:09 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:09.541355 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-050038c8-bd94-4290-9cb8-84c0aa7b709d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:09.541975 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-050038c8-bd94-4290-9cb8-84c0aa7b709d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:09.546274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-089af24a-ebe9-4cd5-998b-f1f9679ff594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:09.547103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-089af24a-ebe9-4cd5-998b-f1f9679ff594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:09.557633 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-050038c8-bd94-4290-9cb8-84c0aa7b709d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:09.559130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-089af24a-ebe9-4cd5-998b-f1f9679ff594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:09.559816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-089af24a-ebe9-4cd5-998b-f1f9679ff594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:09.561955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-050038c8-bd94-4290-9cb8-84c0aa7b709d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:09.562720 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-050038c8-bd94-4290-9cb8-84c0aa7b709d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:09.563092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-089af24a-ebe9-4cd5-998b-f1f9679ff594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:09.564030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-089af24a-ebe9-4cd5-998b-f1f9679ff594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:09.565593 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-050038c8-bd94-4290-9cb8-84c0aa7b709d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:09.566499 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-089af24a-ebe9-4cd5-998b-f1f9679ff594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:09.567135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-050038c8-bd94-4290-9cb8-84c0aa7b709d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:09.567783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-089af24a-ebe9-4cd5-998b-f1f9679ff594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:09.568977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-050038c8-bd94-4290-9cb8-84c0aa7b709d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:09.798425 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-050038c8-bd94-4290-9cb8-84c0aa7b709d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:09.807607 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-050038c8-bd94-4290-9cb8-84c0aa7b709d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.274056 Aug 30 14:43:09.807746 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-089af24a-ebe9-4cd5-998b-f1f9679ff594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:09.808346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 67/127] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:09 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:09.819954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-089af24a-ebe9-4cd5-998b-f1f9679ff594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:09.821729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-089af24a-ebe9-4cd5-998b-f1f9679ff594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:09.823038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-089af24a-ebe9-4cd5-998b-f1f9679ff594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1406 microversion: 2.20 time: 0.290754 Aug 30 14:43:09.823641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 61/128] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:43:09 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:43:10.555733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7a7c27b7-fd7b-4a33-9bd8-d86289e7aecd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:10.556461 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7a7c27b7-fd7b-4a33-9bd8-d86289e7aecd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:10.564146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7a7c27b7-fd7b-4a33-9bd8-d86289e7aecd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:10.565622 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7a7c27b7-fd7b-4a33-9bd8-d86289e7aecd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:10.566283 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7a7c27b7-fd7b-4a33-9bd8-d86289e7aecd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:10.567532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7a7c27b7-fd7b-4a33-9bd8-d86289e7aecd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:10.568538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7a7c27b7-fd7b-4a33-9bd8-d86289e7aecd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:10.569192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7a7c27b7-fd7b-4a33-9bd8-d86289e7aecd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:10.719316 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7a7c27b7-fd7b-4a33-9bd8-d86289e7aecd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:10.727533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7a7c27b7-fd7b-4a33-9bd8-d86289e7aecd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1362 microversion: 2.1 time: 0.177179 Aug 30 14:43:10.728114 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 68/129] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:10 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:10.830057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3b1d000e-7fc6-4da8-9fb7-1e607ed3849e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:10.830671 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3b1d000e-7fc6-4da8-9fb7-1e607ed3849e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:10.837505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b1d000e-7fc6-4da8-9fb7-1e607ed3849e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:10.838038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b1d000e-7fc6-4da8-9fb7-1e607ed3849e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:10.838470 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b1d000e-7fc6-4da8-9fb7-1e607ed3849e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:10.854488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-079fd011-9bbe-417e-aacc-27cafdd0bccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:10.855137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-079fd011-9bbe-417e-aacc-27cafdd0bccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:10.860560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b1d000e-7fc6-4da8-9fb7-1e607ed3849e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:10.861351 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b1d000e-7fc6-4da8-9fb7-1e607ed3849e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:10.861790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b1d000e-7fc6-4da8-9fb7-1e607ed3849e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:10.865419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-079fd011-9bbe-417e-aacc-27cafdd0bccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:10.866052 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-079fd011-9bbe-417e-aacc-27cafdd0bccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:10.866485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-079fd011-9bbe-417e-aacc-27cafdd0bccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:10.867181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-079fd011-9bbe-417e-aacc-27cafdd0bccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:10.867668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-079fd011-9bbe-417e-aacc-27cafdd0bccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:10.868179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-079fd011-9bbe-417e-aacc-27cafdd0bccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:11.080357 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3b1d000e-7fc6-4da8-9fb7-1e607ed3849e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:11.089563 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3b1d000e-7fc6-4da8-9fb7-1e607ed3849e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.262948 Aug 30 14:43:11.090341 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 62/130] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:10 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:11.099495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-079fd011-9bbe-417e-aacc-27cafdd0bccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:11.105817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-079fd011-9bbe-417e-aacc-27cafdd0bccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:11.108504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-079fd011-9bbe-417e-aacc-27cafdd0bccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:11.109825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-079fd011-9bbe-417e-aacc-27cafdd0bccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1406 microversion: 2.20 time: 0.264426 Aug 30 14:43:11.110362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 69/131] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:43:10 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:43:11.750915 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-00290b62-f039-47ed-8d39-b60c803a8142 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:11.751592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-00290b62-f039-47ed-8d39-b60c803a8142 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:11.761260 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00290b62-f039-47ed-8d39-b60c803a8142 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:11.762142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00290b62-f039-47ed-8d39-b60c803a8142 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:11.763021 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00290b62-f039-47ed-8d39-b60c803a8142 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:11.764954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00290b62-f039-47ed-8d39-b60c803a8142 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:11.765806 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00290b62-f039-47ed-8d39-b60c803a8142 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:11.766482 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00290b62-f039-47ed-8d39-b60c803a8142 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:11.951429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-00290b62-f039-47ed-8d39-b60c803a8142 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:11.960037 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-00290b62-f039-47ed-8d39-b60c803a8142 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1362 microversion: 2.1 time: 0.213991 Aug 30 14:43:11.960954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 63/132] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:11 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:43:12.111652 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3e897ccc-a2b5-4a0e-bc0c-5717bfd7647e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:12.112280 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3e897ccc-a2b5-4a0e-bc0c-5717bfd7647e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:12.118282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e897ccc-a2b5-4a0e-bc0c-5717bfd7647e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:12.118781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e897ccc-a2b5-4a0e-bc0c-5717bfd7647e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:12.119228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e897ccc-a2b5-4a0e-bc0c-5717bfd7647e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:12.119915 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e897ccc-a2b5-4a0e-bc0c-5717bfd7647e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:12.120355 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e897ccc-a2b5-4a0e-bc0c-5717bfd7647e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:12.120770 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e897ccc-a2b5-4a0e-bc0c-5717bfd7647e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:12.133378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-587f2a65-c25d-4ef3-9425-0e20f63c3296 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:12.134075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-587f2a65-c25d-4ef3-9425-0e20f63c3296 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:12.139910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-587f2a65-c25d-4ef3-9425-0e20f63c3296 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:12.140388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-587f2a65-c25d-4ef3-9425-0e20f63c3296 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:12.140819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-587f2a65-c25d-4ef3-9425-0e20f63c3296 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:12.141507 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-587f2a65-c25d-4ef3-9425-0e20f63c3296 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:12.141959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-587f2a65-c25d-4ef3-9425-0e20f63c3296 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:12.142378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-587f2a65-c25d-4ef3-9425-0e20f63c3296 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:12.250794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3e897ccc-a2b5-4a0e-bc0c-5717bfd7647e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:12.258684 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3e897ccc-a2b5-4a0e-bc0c-5717bfd7647e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.151405 Aug 30 14:43:12.259272 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 70/133] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:12 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:12.276550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-587f2a65-c25d-4ef3-9425-0e20f63c3296 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:12.284989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-587f2a65-c25d-4ef3-9425-0e20f63c3296 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:12.286409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-587f2a65-c25d-4ef3-9425-0e20f63c3296 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:12.287538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-587f2a65-c25d-4ef3-9425-0e20f63c3296 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1406 microversion: 2.20 time: 0.158099 Aug 30 14:43:12.288086 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 64/134] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:43:12 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:43:12.981402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f39e93bf-51ec-4cfb-ac5c-bbaf01b61ba3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:12.982235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f39e93bf-51ec-4cfb-ac5c-bbaf01b61ba3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:12.989338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f39e93bf-51ec-4cfb-ac5c-bbaf01b61ba3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:12.989827 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f39e93bf-51ec-4cfb-ac5c-bbaf01b61ba3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:12.990255 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f39e93bf-51ec-4cfb-ac5c-bbaf01b61ba3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:12.990958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f39e93bf-51ec-4cfb-ac5c-bbaf01b61ba3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:12.991430 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f39e93bf-51ec-4cfb-ac5c-bbaf01b61ba3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:12.991850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f39e93bf-51ec-4cfb-ac5c-bbaf01b61ba3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:13.137027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f39e93bf-51ec-4cfb-ac5c-bbaf01b61ba3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:13.145443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f39e93bf-51ec-4cfb-ac5c-bbaf01b61ba3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1362 microversion: 2.1 time: 0.167990 Aug 30 14:43:13.146058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 71/135] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:12 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:13.279552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2064ca4c-a80c-4d74-9097-0ef72ba07787 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:13.280150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2064ca4c-a80c-4d74-9097-0ef72ba07787 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:13.286168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2064ca4c-a80c-4d74-9097-0ef72ba07787 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:13.286636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2064ca4c-a80c-4d74-9097-0ef72ba07787 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:13.287063 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2064ca4c-a80c-4d74-9097-0ef72ba07787 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:13.287763 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2064ca4c-a80c-4d74-9097-0ef72ba07787 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:13.288204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2064ca4c-a80c-4d74-9097-0ef72ba07787 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:13.288617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2064ca4c-a80c-4d74-9097-0ef72ba07787 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:13.310706 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ce2cf860-2a5d-455b-8ef0-1a6855876a9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:13.311945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ce2cf860-2a5d-455b-8ef0-1a6855876a9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:13.318938 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce2cf860-2a5d-455b-8ef0-1a6855876a9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:13.320051 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce2cf860-2a5d-455b-8ef0-1a6855876a9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:13.320918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce2cf860-2a5d-455b-8ef0-1a6855876a9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:13.321982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce2cf860-2a5d-455b-8ef0-1a6855876a9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:13.322702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce2cf860-2a5d-455b-8ef0-1a6855876a9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:13.323342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce2cf860-2a5d-455b-8ef0-1a6855876a9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:13.456507 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2064ca4c-a80c-4d74-9097-0ef72ba07787 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:13.463692 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ce2cf860-2a5d-455b-8ef0-1a6855876a9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:13.464644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2064ca4c-a80c-4d74-9097-0ef72ba07787 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.188900 Aug 30 14:43:13.465220 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 65/136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:13 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:13.471927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ce2cf860-2a5d-455b-8ef0-1a6855876a9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:13.473384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ce2cf860-2a5d-455b-8ef0-1a6855876a9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:13.474475 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ce2cf860-2a5d-455b-8ef0-1a6855876a9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1406 microversion: 2.20 time: 0.168194 Aug 30 14:43:13.475017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 72/137] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:43:13 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:43:14.167832 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fcc0c368-629c-4910-9e45-cc3210c9be33 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:14.168410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fcc0c368-629c-4910-9e45-cc3210c9be33 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:14.175149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcc0c368-629c-4910-9e45-cc3210c9be33 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:14.175840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcc0c368-629c-4910-9e45-cc3210c9be33 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:14.176464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcc0c368-629c-4910-9e45-cc3210c9be33 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:14.177486 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcc0c368-629c-4910-9e45-cc3210c9be33 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:14.178134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcc0c368-629c-4910-9e45-cc3210c9be33 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:14.178678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcc0c368-629c-4910-9e45-cc3210c9be33 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:14.285228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5b603e2f-059e-4845-b79c-22170a3170fb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cd61010-f9f1-4355-8014-32d669982a03"}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:43:14.288519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5b603e2f-059e-4845-b79c-22170a3170fb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:14.296755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b603e2f-059e-4845-b79c-22170a3170fb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:14.297687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b603e2f-059e-4845-b79c-22170a3170fb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:14.298278 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b603e2f-059e-4845-b79c-22170a3170fb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:14.299156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b603e2f-059e-4845-b79c-22170a3170fb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:14.299850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b603e2f-059e-4845-b79c-22170a3170fb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:14.300732 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b603e2f-059e-4845-b79c-22170a3170fb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:14.333743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fcc0c368-629c-4910-9e45-cc3210c9be33 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:14.344232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fcc0c368-629c-4910-9e45-cc3210c9be33 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1547 microversion: 2.1 time: 0.181211 Aug 30 14:43:14.351464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 66/138] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:14 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1547 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:14.369850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3231d7ad-2b5c-4fab-b79f-98a807e58085 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:14.372925 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3231d7ad-2b5c-4fab-b79f-98a807e58085 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:14.379939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3231d7ad-2b5c-4fab-b79f-98a807e58085 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:14.380427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3231d7ad-2b5c-4fab-b79f-98a807e58085 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:14.380864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3231d7ad-2b5c-4fab-b79f-98a807e58085 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:14.381555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3231d7ad-2b5c-4fab-b79f-98a807e58085 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:14.382000 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3231d7ad-2b5c-4fab-b79f-98a807e58085 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:14.382424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3231d7ad-2b5c-4fab-b79f-98a807e58085 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:14.387564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:14.489397 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3231d7ad-2b5c-4fab-b79f-98a807e58085 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127208 Aug 30 14:43:14.490553 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 67/139] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 14:43:14 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:43:14.495684 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4195bafd-7f72-4868-8799-7f303450aa4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:14.496278 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4195bafd-7f72-4868-8799-7f303450aa4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:14.502738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4195bafd-7f72-4868-8799-7f303450aa4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:14.503329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4195bafd-7f72-4868-8799-7f303450aa4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:14.503778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4195bafd-7f72-4868-8799-7f303450aa4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:14.504370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4195bafd-7f72-4868-8799-7f303450aa4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:14.507675 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4195bafd-7f72-4868-8799-7f303450aa4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:14.508371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4195bafd-7f72-4868-8799-7f303450aa4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:14.707011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4195bafd-7f72-4868-8799-7f303450aa4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:14.714786 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4195bafd-7f72-4868-8799-7f303450aa4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.223010 Aug 30 14:43:14.728350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 68/140] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:14 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:14.735695 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3d357d75-5d13-4270-b132-d9c4a15224a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:14.736563 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3d357d75-5d13-4270-b132-d9c4a15224a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:14.743324 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d357d75-5d13-4270-b132-d9c4a15224a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:14.744057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d357d75-5d13-4270-b132-d9c4a15224a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:14.745010 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d357d75-5d13-4270-b132-d9c4a15224a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:14.746402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d357d75-5d13-4270-b132-d9c4a15224a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:14.747304 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d357d75-5d13-4270-b132-d9c4a15224a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:14.748846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d357d75-5d13-4270-b132-d9c4a15224a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:14.922374 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3d357d75-5d13-4270-b132-d9c4a15224a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:14.931927 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3d357d75-5d13-4270-b132-d9c4a15224a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:14.933400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3d357d75-5d13-4270-b132-d9c4a15224a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:14.934603 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3d357d75-5d13-4270-b132-d9c4a15224a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1406 microversion: 2.20 time: 0.202872 Aug 30 14:43:14.935626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 69/141] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:43:14 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:43:15.736080 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a4d86f4c-d754-4cc1-b629-f4a28e800e14 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:15.736705 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a4d86f4c-d754-4cc1-b629-f4a28e800e14 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:15.742478 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4d86f4c-d754-4cc1-b629-f4a28e800e14 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:15.742949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4d86f4c-d754-4cc1-b629-f4a28e800e14 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:15.743406 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4d86f4c-d754-4cc1-b629-f4a28e800e14 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:15.744083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4d86f4c-d754-4cc1-b629-f4a28e800e14 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:15.744525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4d86f4c-d754-4cc1-b629-f4a28e800e14 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:15.744938 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4d86f4c-d754-4cc1-b629-f4a28e800e14 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:15.877263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a4d86f4c-d754-4cc1-b629-f4a28e800e14 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:15.885258 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a4d86f4c-d754-4cc1-b629-f4a28e800e14 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.153623 Aug 30 14:43:15.885827 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 70/142] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:15 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:43:15.903877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-ac74cd9f-20dd-45f7-99dc-c138f5793242 req-7bf4d512-3805-4da7-8423-b352b357e763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9dfd407-56eb-4670-8ee7-5e0cabe294e3", "tag": "5494fd19-6c12-4b87-9225-d31bc888c0bc"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:43:15.913142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ac74cd9f-20dd-45f7-99dc-c138f5793242 req-7bf4d512-3805-4da7-8423-b352b357e763 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:15.913616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ac74cd9f-20dd-45f7-99dc-c138f5793242 req-7bf4d512-3805-4da7-8423-b352b357e763 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:15.914036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ac74cd9f-20dd-45f7-99dc-c138f5793242 req-7bf4d512-3805-4da7-8423-b352b357e763 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:15.925971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-ac74cd9f-20dd-45f7-99dc-c138f5793242 req-7bf4d512-3805-4da7-8423-b352b357e763 service nova] Creating event network-changed:5494fd19-6c12-4b87-9225-d31bc888c0bc for instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 on hv-cinder-82880 Aug 30 14:43:15.931592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-ac74cd9f-20dd-45f7-99dc-c138f5793242 req-7bf4d512-3805-4da7-8423-b352b357e763 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031440 Aug 30 14:43:15.936840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 71/143] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:43:15.958264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8943f310-be47-476b-b546-e6640dadb54f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:15.958989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8943f310-be47-476b-b546-e6640dadb54f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:15.964998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8943f310-be47-476b-b546-e6640dadb54f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:15.965481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8943f310-be47-476b-b546-e6640dadb54f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:15.965912 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8943f310-be47-476b-b546-e6640dadb54f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:15.966629 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8943f310-be47-476b-b546-e6640dadb54f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:15.967081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8943f310-be47-476b-b546-e6640dadb54f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:15.967527 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8943f310-be47-476b-b546-e6640dadb54f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:16.102972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8943f310-be47-476b-b546-e6640dadb54f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:16.111652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8943f310-be47-476b-b546-e6640dadb54f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:16.113096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8943f310-be47-476b-b546-e6640dadb54f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:16.114253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8943f310-be47-476b-b546-e6640dadb54f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1597 microversion: 2.20 time: 0.160209 Aug 30 14:43:16.114808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 72/144] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:43:15 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:43:16.136427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dad85c4e-f151-4c56-8224-a6ac3f79aa59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:16.136917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dad85c4e-f151-4c56-8224-a6ac3f79aa59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:16.143373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dad85c4e-f151-4c56-8224-a6ac3f79aa59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:16.143858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dad85c4e-f151-4c56-8224-a6ac3f79aa59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:16.144286 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dad85c4e-f151-4c56-8224-a6ac3f79aa59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:16.144971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dad85c4e-f151-4c56-8224-a6ac3f79aa59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:16.145416 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dad85c4e-f151-4c56-8224-a6ac3f79aa59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:16.145835 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dad85c4e-f151-4c56-8224-a6ac3f79aa59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:16.226777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dad85c4e-f151-4c56-8224-a6ac3f79aa59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093732 Aug 30 14:43:16.228662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 73/145] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Aug 30 14:43:16 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:43:16.908682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ea52f144-3521-4ade-b9dd-5a87fb6ca319 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:16.909601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ea52f144-3521-4ade-b9dd-5a87fb6ca319 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:16.916098 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea52f144-3521-4ade-b9dd-5a87fb6ca319 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:16.916591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea52f144-3521-4ade-b9dd-5a87fb6ca319 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:16.917028 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea52f144-3521-4ade-b9dd-5a87fb6ca319 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:16.917730 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea52f144-3521-4ade-b9dd-5a87fb6ca319 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:16.918180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea52f144-3521-4ade-b9dd-5a87fb6ca319 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:16.918599 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea52f144-3521-4ade-b9dd-5a87fb6ca319 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:17.065259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ea52f144-3521-4ade-b9dd-5a87fb6ca319 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:17.074006 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ea52f144-3521-4ade-b9dd-5a87fb6ca319 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.170234 Aug 30 14:43:17.074732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 74/146] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:16 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:43:17.948083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-780fce4d-5626-4f3c-9735-1f0530f1628d req-ce965a6f-2664-48cd-a88a-d00708bac460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df823286-f7fd-4dbf-acb5-7cd297f48da0", "tag": "356c248c-dbd2-4ea8-93cc-dd834560932d"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:43:17.965065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-780fce4d-5626-4f3c-9735-1f0530f1628d req-ce965a6f-2664-48cd-a88a-d00708bac460 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:17.965776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-780fce4d-5626-4f3c-9735-1f0530f1628d req-ce965a6f-2664-48cd-a88a-d00708bac460 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:17.966859 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-780fce4d-5626-4f3c-9735-1f0530f1628d req-ce965a6f-2664-48cd-a88a-d00708bac460 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:17.980151 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-780fce4d-5626-4f3c-9735-1f0530f1628d req-ce965a6f-2664-48cd-a88a-d00708bac460 service nova] Creating event network-changed:356c248c-dbd2-4ea8-93cc-dd834560932d for instance df823286-f7fd-4dbf-acb5-7cd297f48da0 on hv-cinder-82880 Aug 30 14:43:17.987361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-780fce4d-5626-4f3c-9735-1f0530f1628d req-ce965a6f-2664-48cd-a88a-d00708bac460 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043350 Aug 30 14:43:17.997188 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 75/147] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:43:18.098065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8d28247e-3b13-440a-a0f7-eb034056c6eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:18.099181 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8d28247e-3b13-440a-a0f7-eb034056c6eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:18.104629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:18.117638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d28247e-3b13-440a-a0f7-eb034056c6eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:18.118487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d28247e-3b13-440a-a0f7-eb034056c6eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:18.120455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d28247e-3b13-440a-a0f7-eb034056c6eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:18.122045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d28247e-3b13-440a-a0f7-eb034056c6eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:18.124422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d28247e-3b13-440a-a0f7-eb034056c6eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:18.125093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d28247e-3b13-440a-a0f7-eb034056c6eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:18.416764 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5b603e2f-059e-4845-b79c-22170a3170fb tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "POST /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.118683 Aug 30 14:43:18.420153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 73/148] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 14:43:14 2022] POST /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b/os-volume_attachments => generated 194 bytes in 4138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:43:18.842518 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8d28247e-3b13-440a-a0f7-eb034056c6eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:18.860742 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8d28247e-3b13-440a-a0f7-eb034056c6eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.767777 Aug 30 14:43:18.862393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 76/149] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:18 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:19.884851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5bd7fa0c-193c-4899-8a13-850d3332156f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:19.885562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5bd7fa0c-193c-4899-8a13-850d3332156f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:19.899401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bd7fa0c-193c-4899-8a13-850d3332156f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:19.899992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bd7fa0c-193c-4899-8a13-850d3332156f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:19.900665 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bd7fa0c-193c-4899-8a13-850d3332156f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:19.902324 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bd7fa0c-193c-4899-8a13-850d3332156f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:19.903376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bd7fa0c-193c-4899-8a13-850d3332156f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:19.904462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bd7fa0c-193c-4899-8a13-850d3332156f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:20.122327 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5bd7fa0c-193c-4899-8a13-850d3332156f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:20.131699 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5bd7fa0c-193c-4899-8a13-850d3332156f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.252461 Aug 30 14:43:20.132783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 74/150] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:19 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:21.154418 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a9cc3ba4-8a4a-44e0-8e4b-4e282d839d4c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:21.155711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a9cc3ba4-8a4a-44e0-8e4b-4e282d839d4c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:21.161580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=91 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:21.162939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9cc3ba4-8a4a-44e0-8e4b-4e282d839d4c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:21.163703 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9cc3ba4-8a4a-44e0-8e4b-4e282d839d4c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:21.164340 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9cc3ba4-8a4a-44e0-8e4b-4e282d839d4c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:21.165109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9cc3ba4-8a4a-44e0-8e4b-4e282d839d4c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:21.165753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9cc3ba4-8a4a-44e0-8e4b-4e282d839d4c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:21.166179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9cc3ba4-8a4a-44e0-8e4b-4e282d839d4c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:21.311519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a9cc3ba4-8a4a-44e0-8e4b-4e282d839d4c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:21.320007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a9cc3ba4-8a4a-44e0-8e4b-4e282d839d4c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.170067 Aug 30 14:43:21.320478 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 77/151] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:21 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:22.341460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-acceee4e-6e26-45b3-a952-73777a9c4874 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:22.343647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-acceee4e-6e26-45b3-a952-73777a9c4874 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:22.353576 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-acceee4e-6e26-45b3-a952-73777a9c4874 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:22.354336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-acceee4e-6e26-45b3-a952-73777a9c4874 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:22.355005 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-acceee4e-6e26-45b3-a952-73777a9c4874 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:22.357394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-acceee4e-6e26-45b3-a952-73777a9c4874 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:22.358861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-acceee4e-6e26-45b3-a952-73777a9c4874 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:22.359733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-acceee4e-6e26-45b3-a952-73777a9c4874 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:22.541993 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-acceee4e-6e26-45b3-a952-73777a9c4874 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:22.553139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-acceee4e-6e26-45b3-a952-73777a9c4874 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.215694 Aug 30 14:43:22.553733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 75/152] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:22 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:43:23.577263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-618062fb-e651-4911-b912-e0e80d018788 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:23.578001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-618062fb-e651-4911-b912-e0e80d018788 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:23.584631 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-618062fb-e651-4911-b912-e0e80d018788 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:23.585319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-618062fb-e651-4911-b912-e0e80d018788 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:23.586502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-618062fb-e651-4911-b912-e0e80d018788 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:23.587913 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-618062fb-e651-4911-b912-e0e80d018788 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:23.589906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-618062fb-e651-4911-b912-e0e80d018788 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:23.591675 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-618062fb-e651-4911-b912-e0e80d018788 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:23.786860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-618062fb-e651-4911-b912-e0e80d018788 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:23.800126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-618062fb-e651-4911-b912-e0e80d018788 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.226678 Aug 30 14:43:23.815756 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 78/153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:23 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:24.821115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b6345d60-541f-4eb7-8b61-1f43e81cc800 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:24.821831 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b6345d60-541f-4eb7-8b61-1f43e81cc800 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:24.829693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6345d60-541f-4eb7-8b61-1f43e81cc800 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:24.830443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6345d60-541f-4eb7-8b61-1f43e81cc800 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:24.830944 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6345d60-541f-4eb7-8b61-1f43e81cc800 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:24.831727 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6345d60-541f-4eb7-8b61-1f43e81cc800 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:24.832167 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6345d60-541f-4eb7-8b61-1f43e81cc800 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:24.832820 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6345d60-541f-4eb7-8b61-1f43e81cc800 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:25.001244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b6345d60-541f-4eb7-8b61-1f43e81cc800 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:25.010718 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b6345d60-541f-4eb7-8b61-1f43e81cc800 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.193341 Aug 30 14:43:25.016223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 76/154] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:24 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:26.054287 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fd0c6240-0907-451c-8347-732a1c7321fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:26.055030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fd0c6240-0907-451c-8347-732a1c7321fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:26.062553 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd0c6240-0907-451c-8347-732a1c7321fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:26.063045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd0c6240-0907-451c-8347-732a1c7321fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:26.063523 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd0c6240-0907-451c-8347-732a1c7321fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:26.064278 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd0c6240-0907-451c-8347-732a1c7321fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:26.064729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd0c6240-0907-451c-8347-732a1c7321fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:26.065150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd0c6240-0907-451c-8347-732a1c7321fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:26.222834 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fd0c6240-0907-451c-8347-732a1c7321fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:26.233372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fd0c6240-0907-451c-8347-732a1c7321fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.204459 Aug 30 14:43:26.233971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 79/155] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:26 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:27.256076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6352776d-44fd-4463-a46d-ff64553d8268 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:27.256906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6352776d-44fd-4463-a46d-ff64553d8268 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:27.260667 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=67 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:27.266432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6352776d-44fd-4463-a46d-ff64553d8268 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:27.266976 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6352776d-44fd-4463-a46d-ff64553d8268 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:27.267543 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6352776d-44fd-4463-a46d-ff64553d8268 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:27.268330 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6352776d-44fd-4463-a46d-ff64553d8268 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:27.268851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6352776d-44fd-4463-a46d-ff64553d8268 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:27.269275 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6352776d-44fd-4463-a46d-ff64553d8268 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:27.454961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6352776d-44fd-4463-a46d-ff64553d8268 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:27.464153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6352776d-44fd-4463-a46d-ff64553d8268 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.213330 Aug 30 14:43:27.465104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 77/156] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:27 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:28.493481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cde055e6-3c9c-4c46-b413-67e0561439c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:28.494084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cde055e6-3c9c-4c46-b413-67e0561439c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:28.500642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cde055e6-3c9c-4c46-b413-67e0561439c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:28.501126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cde055e6-3c9c-4c46-b413-67e0561439c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:28.501557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cde055e6-3c9c-4c46-b413-67e0561439c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:28.502270 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cde055e6-3c9c-4c46-b413-67e0561439c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:28.502718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cde055e6-3c9c-4c46-b413-67e0561439c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:28.503133 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cde055e6-3c9c-4c46-b413-67e0561439c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:28.628106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cde055e6-3c9c-4c46-b413-67e0561439c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:28.635633 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cde055e6-3c9c-4c46-b413-67e0561439c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.146042 Aug 30 14:43:28.636210 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 80/157] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:28 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:29.655935 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-36f60a8c-d063-49fb-a81d-c3c9c6dd5db7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:29.656566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-36f60a8c-d063-49fb-a81d-c3c9c6dd5db7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:29.662865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36f60a8c-d063-49fb-a81d-c3c9c6dd5db7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:29.663413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36f60a8c-d063-49fb-a81d-c3c9c6dd5db7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:29.663804 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36f60a8c-d063-49fb-a81d-c3c9c6dd5db7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:29.664478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36f60a8c-d063-49fb-a81d-c3c9c6dd5db7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:29.664917 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36f60a8c-d063-49fb-a81d-c3c9c6dd5db7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:29.665331 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36f60a8c-d063-49fb-a81d-c3c9c6dd5db7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:29.791961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-36f60a8c-d063-49fb-a81d-c3c9c6dd5db7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:29.799534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-36f60a8c-d063-49fb-a81d-c3c9c6dd5db7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.147571 Aug 30 14:43:29.800103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 78/158] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:29 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:30.820989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-316a6b4b-f27a-4516-8e62-c8a7a4a3d2fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:30.821669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-316a6b4b-f27a-4516-8e62-c8a7a4a3d2fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:30.827618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-316a6b4b-f27a-4516-8e62-c8a7a4a3d2fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:30.828103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-316a6b4b-f27a-4516-8e62-c8a7a4a3d2fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:30.828536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-316a6b4b-f27a-4516-8e62-c8a7a4a3d2fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:30.829244 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-316a6b4b-f27a-4516-8e62-c8a7a4a3d2fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:30.829673 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-316a6b4b-f27a-4516-8e62-c8a7a4a3d2fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:30.830092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-316a6b4b-f27a-4516-8e62-c8a7a4a3d2fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:30.977279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-316a6b4b-f27a-4516-8e62-c8a7a4a3d2fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:30.987306 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-316a6b4b-f27a-4516-8e62-c8a7a4a3d2fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.170055 Aug 30 14:43:30.988772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 81/159] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:30 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:32.012713 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-98c4f896-a0cd-44ed-bbdd-eae2ec781b16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:32.013413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-98c4f896-a0cd-44ed-bbdd-eae2ec781b16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:32.020916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-98c4f896-a0cd-44ed-bbdd-eae2ec781b16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:32.021643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-98c4f896-a0cd-44ed-bbdd-eae2ec781b16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:32.022548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-98c4f896-a0cd-44ed-bbdd-eae2ec781b16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:32.023810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-98c4f896-a0cd-44ed-bbdd-eae2ec781b16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:32.024587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-98c4f896-a0cd-44ed-bbdd-eae2ec781b16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:32.025152 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-98c4f896-a0cd-44ed-bbdd-eae2ec781b16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:32.213819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-98c4f896-a0cd-44ed-bbdd-eae2ec781b16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:32.232948 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-98c4f896-a0cd-44ed-bbdd-eae2ec781b16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.224248 Aug 30 14:43:32.233522 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 79/160] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:32 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:32.642072 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4aae747c-3d62-4c66-8d04-5709e56a6011 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:32.643138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4aae747c-3d62-4c66-8d04-5709e56a6011 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:32.649231 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4aae747c-3d62-4c66-8d04-5709e56a6011 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:32.649891 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4aae747c-3d62-4c66-8d04-5709e56a6011 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:32.650604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4aae747c-3d62-4c66-8d04-5709e56a6011 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:32.651328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4aae747c-3d62-4c66-8d04-5709e56a6011 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:32.651933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4aae747c-3d62-4c66-8d04-5709e56a6011 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:32.652857 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4aae747c-3d62-4c66-8d04-5709e56a6011 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:32.681161 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4aae747c-3d62-4c66-8d04-5709e56a6011 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:43:32.777896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4aae747c-3d62-4c66-8d04-5709e56a6011 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 204 len: 0 microversion: 2.1 time: 0.139225 Aug 30 14:43:32.779551 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 82/161] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 14:43:32 2022] DELETE /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:43:32.788083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-613b7844-193f-46de-b893-6533b6299bf8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:32.788776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-613b7844-193f-46de-b893-6533b6299bf8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:32.796018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-613b7844-193f-46de-b893-6533b6299bf8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:32.796504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-613b7844-193f-46de-b893-6533b6299bf8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:32.796937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-613b7844-193f-46de-b893-6533b6299bf8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:32.797625 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-613b7844-193f-46de-b893-6533b6299bf8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:32.798074 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-613b7844-193f-46de-b893-6533b6299bf8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:32.798490 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-613b7844-193f-46de-b893-6533b6299bf8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:32.928823 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-613b7844-193f-46de-b893-6533b6299bf8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:32.936954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-613b7844-193f-46de-b893-6533b6299bf8 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1554 microversion: 2.1 time: 0.152990 Aug 30 14:43:32.937505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 80/162] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:32 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:33.256987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6a9a330c-991c-475b-8de2-a5b5b0e425d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:33.257753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6a9a330c-991c-475b-8de2-a5b5b0e425d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:33.264332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9a330c-991c-475b-8de2-a5b5b0e425d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:33.264882 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9a330c-991c-475b-8de2-a5b5b0e425d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:33.265455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9a330c-991c-475b-8de2-a5b5b0e425d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:33.266510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9a330c-991c-475b-8de2-a5b5b0e425d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:33.267083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9a330c-991c-475b-8de2-a5b5b0e425d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:33.267777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9a330c-991c-475b-8de2-a5b5b0e425d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:33.408431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6a9a330c-991c-475b-8de2-a5b5b0e425d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:33.416126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6a9a330c-991c-475b-8de2-a5b5b0e425d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.165395 Aug 30 14:43:33.416740 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 83/163] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:33 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:33.961867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cbb31d6c-9ed7-4238-a815-af21aa6e5e74 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:33.962477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cbb31d6c-9ed7-4238-a815-af21aa6e5e74 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:33.973572 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb31d6c-9ed7-4238-a815-af21aa6e5e74 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:33.974041 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb31d6c-9ed7-4238-a815-af21aa6e5e74 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:33.974534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb31d6c-9ed7-4238-a815-af21aa6e5e74 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:33.975497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb31d6c-9ed7-4238-a815-af21aa6e5e74 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:33.977338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb31d6c-9ed7-4238-a815-af21aa6e5e74 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:33.977943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb31d6c-9ed7-4238-a815-af21aa6e5e74 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:34.117687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cbb31d6c-9ed7-4238-a815-af21aa6e5e74 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:34.126509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cbb31d6c-9ed7-4238-a815-af21aa6e5e74 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1554 microversion: 2.1 time: 0.171836 Aug 30 14:43:34.127076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 81/164] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:33 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:34.440132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9a4b00e1-9311-4686-8f04-360b061d2d37 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:34.441672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9a4b00e1-9311-4686-8f04-360b061d2d37 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:34.448471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a4b00e1-9311-4686-8f04-360b061d2d37 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:34.449049 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a4b00e1-9311-4686-8f04-360b061d2d37 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:34.449977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a4b00e1-9311-4686-8f04-360b061d2d37 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:34.451661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a4b00e1-9311-4686-8f04-360b061d2d37 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:34.452194 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a4b00e1-9311-4686-8f04-360b061d2d37 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:34.452672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a4b00e1-9311-4686-8f04-360b061d2d37 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:34.457209 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:34.667169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9a4b00e1-9311-4686-8f04-360b061d2d37 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:34.675757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9a4b00e1-9311-4686-8f04-360b061d2d37 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.240164 Aug 30 14:43:34.676334 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 84/165] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:34 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:35.149095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-878fb2e5-d508-48ef-9a0f-7d471dae3ebc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:35.151384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-878fb2e5-d508-48ef-9a0f-7d471dae3ebc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:35.159160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-878fb2e5-d508-48ef-9a0f-7d471dae3ebc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:35.159848 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-878fb2e5-d508-48ef-9a0f-7d471dae3ebc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:35.160553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-878fb2e5-d508-48ef-9a0f-7d471dae3ebc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:35.161469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-878fb2e5-d508-48ef-9a0f-7d471dae3ebc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:35.162101 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-878fb2e5-d508-48ef-9a0f-7d471dae3ebc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:35.162696 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-878fb2e5-d508-48ef-9a0f-7d471dae3ebc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:35.375183 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-878fb2e5-d508-48ef-9a0f-7d471dae3ebc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:35.384071 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-878fb2e5-d508-48ef-9a0f-7d471dae3ebc tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1554 microversion: 2.1 time: 0.239844 Aug 30 14:43:35.385055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 82/166] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:35 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:43:35.699771 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f86e13a5-3a6a-4a65-a1b0-4306e619a20f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:35.701187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f86e13a5-3a6a-4a65-a1b0-4306e619a20f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:35.707123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f86e13a5-3a6a-4a65-a1b0-4306e619a20f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:35.707707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f86e13a5-3a6a-4a65-a1b0-4306e619a20f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:35.708381 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f86e13a5-3a6a-4a65-a1b0-4306e619a20f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:35.709065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f86e13a5-3a6a-4a65-a1b0-4306e619a20f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:35.709516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f86e13a5-3a6a-4a65-a1b0-4306e619a20f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:35.709936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f86e13a5-3a6a-4a65-a1b0-4306e619a20f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:35.956800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f86e13a5-3a6a-4a65-a1b0-4306e619a20f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:35.965611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f86e13a5-3a6a-4a65-a1b0-4306e619a20f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.269506 Aug 30 14:43:35.967317 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 85/167] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:35 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:36.407528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f781d83b-1f82-4de4-b0f3-6c7a78655e58 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:36.409013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f781d83b-1f82-4de4-b0f3-6c7a78655e58 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:36.416636 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f781d83b-1f82-4de4-b0f3-6c7a78655e58 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:36.418447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f781d83b-1f82-4de4-b0f3-6c7a78655e58 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:36.419679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f781d83b-1f82-4de4-b0f3-6c7a78655e58 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:36.420542 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f781d83b-1f82-4de4-b0f3-6c7a78655e58 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:36.421145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f781d83b-1f82-4de4-b0f3-6c7a78655e58 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:36.421824 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f781d83b-1f82-4de4-b0f3-6c7a78655e58 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:36.646871 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f781d83b-1f82-4de4-b0f3-6c7a78655e58 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:36.661588 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f781d83b-1f82-4de4-b0f3-6c7a78655e58 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1554 microversion: 2.1 time: 0.257524 Aug 30 14:43:36.675262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 83/168] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:36 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1554 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:36.766751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-2b771087-f555-4b36-ba6f-dd9c5f3f17c5 req-761743d0-d797-4831-99fa-aa21e9b502d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee44201c-2900-4495-9e36-6dc27160909b", "name": "network-vif-deleted", "tag": "a69483c2-5658-4efb-85f1-64bbe1596652"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:43:36.788440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2b771087-f555-4b36-ba6f-dd9c5f3f17c5 req-761743d0-d797-4831-99fa-aa21e9b502d7 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:36.789443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2b771087-f555-4b36-ba6f-dd9c5f3f17c5 req-761743d0-d797-4831-99fa-aa21e9b502d7 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:36.791390 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2b771087-f555-4b36-ba6f-dd9c5f3f17c5 req-761743d0-d797-4831-99fa-aa21e9b502d7 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:36.808627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-2b771087-f555-4b36-ba6f-dd9c5f3f17c5 req-761743d0-d797-4831-99fa-aa21e9b502d7 service nova] Creating event network-vif-deleted:a69483c2-5658-4efb-85f1-64bbe1596652 for instance ee44201c-2900-4495-9e36-6dc27160909b on hv-cinder-82880 Aug 30 14:43:36.816212 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-2b771087-f555-4b36-ba6f-dd9c5f3f17c5 req-761743d0-d797-4831-99fa-aa21e9b502d7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060909 Aug 30 14:43:36.816998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 86/169] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:43:36.992654 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c1ba04d3-9977-4420-8887-b3ae0abb47a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:36.993508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c1ba04d3-9977-4420-8887-b3ae0abb47a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:37.005397 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c1ba04d3-9977-4420-8887-b3ae0abb47a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:37.005992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c1ba04d3-9977-4420-8887-b3ae0abb47a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:37.006425 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c1ba04d3-9977-4420-8887-b3ae0abb47a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:37.007121 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c1ba04d3-9977-4420-8887-b3ae0abb47a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:37.012143 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c1ba04d3-9977-4420-8887-b3ae0abb47a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:37.013175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c1ba04d3-9977-4420-8887-b3ae0abb47a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:37.217784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c1ba04d3-9977-4420-8887-b3ae0abb47a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:37.227333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c1ba04d3-9977-4420-8887-b3ae0abb47a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.240957 Aug 30 14:43:37.228094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 84/170] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:36 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:37.691300 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-39a99a6f-b324-43d4-9f93-a72fa8d56458 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:37.692005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-39a99a6f-b324-43d4-9f93-a72fa8d56458 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:37.700677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39a99a6f-b324-43d4-9f93-a72fa8d56458 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:37.701252 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39a99a6f-b324-43d4-9f93-a72fa8d56458 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:37.701686 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39a99a6f-b324-43d4-9f93-a72fa8d56458 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:37.702429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39a99a6f-b324-43d4-9f93-a72fa8d56458 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:37.703100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39a99a6f-b324-43d4-9f93-a72fa8d56458 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:37.703682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39a99a6f-b324-43d4-9f93-a72fa8d56458 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:37.745663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39a99a6f-b324-43d4-9f93-a72fa8d56458 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:37.746546 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39a99a6f-b324-43d4-9f93-a72fa8d56458 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:37.747182 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39a99a6f-b324-43d4-9f93-a72fa8d56458 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:37.747856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-39a99a6f-b324-43d4-9f93-a72fa8d56458 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lazy-loading 'fault' on Instance uuid ee44201c-2900-4495-9e36-6dc27160909b {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:43:37.805424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-39a99a6f-b324-43d4-9f93-a72fa8d56458 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:37.815693 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-39a99a6f-b324-43d4-9f93-a72fa8d56458 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1351 microversion: 2.1 time: 0.128889 Aug 30 14:43:37.816995 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 87/171] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:37 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1351 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:38.249484 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d86ce578-2c58-41c0-9449-fd7f6bf43629 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:38.250242 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d86ce578-2c58-41c0-9449-fd7f6bf43629 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:38.257638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d86ce578-2c58-41c0-9449-fd7f6bf43629 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:38.258492 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d86ce578-2c58-41c0-9449-fd7f6bf43629 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:38.259082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d86ce578-2c58-41c0-9449-fd7f6bf43629 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:38.260000 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d86ce578-2c58-41c0-9449-fd7f6bf43629 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:38.260449 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d86ce578-2c58-41c0-9449-fd7f6bf43629 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:38.261028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d86ce578-2c58-41c0-9449-fd7f6bf43629 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:38.410634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d86ce578-2c58-41c0-9449-fd7f6bf43629 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:38.421230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d86ce578-2c58-41c0-9449-fd7f6bf43629 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.175731 Aug 30 14:43:38.423252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 85/172] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:38 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:38.844283 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-04c72c4a-34b7-4142-ae74-22b78908a50e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:38.845056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-04c72c4a-34b7-4142-ae74-22b78908a50e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:38.854460 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04c72c4a-34b7-4142-ae74-22b78908a50e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:38.855143 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04c72c4a-34b7-4142-ae74-22b78908a50e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:38.855751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04c72c4a-34b7-4142-ae74-22b78908a50e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:38.857056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04c72c4a-34b7-4142-ae74-22b78908a50e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:38.857530 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04c72c4a-34b7-4142-ae74-22b78908a50e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:38.858061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04c72c4a-34b7-4142-ae74-22b78908a50e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:38.895831 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04c72c4a-34b7-4142-ae74-22b78908a50e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:38.896599 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04c72c4a-34b7-4142-ae74-22b78908a50e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:38.897034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04c72c4a-34b7-4142-ae74-22b78908a50e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:38.897477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-04c72c4a-34b7-4142-ae74-22b78908a50e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lazy-loading 'fault' on Instance uuid ee44201c-2900-4495-9e36-6dc27160909b {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:43:38.941131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-04c72c4a-34b7-4142-ae74-22b78908a50e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:38.949591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-04c72c4a-34b7-4142-ae74-22b78908a50e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1351 microversion: 2.1 time: 0.116049 Aug 30 14:43:38.950516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 88/173] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:38 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:39.444142 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-197b41c3-4b7c-4e74-8cb8-1dc919a8c85a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:39.445127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-197b41c3-4b7c-4e74-8cb8-1dc919a8c85a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:39.463108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-197b41c3-4b7c-4e74-8cb8-1dc919a8c85a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:39.463626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-197b41c3-4b7c-4e74-8cb8-1dc919a8c85a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:39.464235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-197b41c3-4b7c-4e74-8cb8-1dc919a8c85a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:39.464943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-197b41c3-4b7c-4e74-8cb8-1dc919a8c85a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:39.465395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-197b41c3-4b7c-4e74-8cb8-1dc919a8c85a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:39.466341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-197b41c3-4b7c-4e74-8cb8-1dc919a8c85a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:39.614164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-197b41c3-4b7c-4e74-8cb8-1dc919a8c85a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:39.621915 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-197b41c3-4b7c-4e74-8cb8-1dc919a8c85a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.183689 Aug 30 14:43:39.622490 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 86/174] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:39 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:39.979941 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d977e156-55bd-498a-bcf3-164960095df6 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:39.980660 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d977e156-55bd-498a-bcf3-164960095df6 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:39.986758 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d977e156-55bd-498a-bcf3-164960095df6 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:39.987252 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d977e156-55bd-498a-bcf3-164960095df6 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:39.987678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d977e156-55bd-498a-bcf3-164960095df6 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:39.988356 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d977e156-55bd-498a-bcf3-164960095df6 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:39.988796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d977e156-55bd-498a-bcf3-164960095df6 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:39.989206 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d977e156-55bd-498a-bcf3-164960095df6 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:40.020868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d977e156-55bd-498a-bcf3-164960095df6 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:40.021337 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d977e156-55bd-498a-bcf3-164960095df6 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:40.021757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d977e156-55bd-498a-bcf3-164960095df6 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:40.022193 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-d977e156-55bd-498a-bcf3-164960095df6 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lazy-loading 'fault' on Instance uuid ee44201c-2900-4495-9e36-6dc27160909b {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:43:40.062422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d977e156-55bd-498a-bcf3-164960095df6 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0642fa92a86c4e01a42bf087cd36cace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aeffb40eafc44639c8e5032dce345aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:40.073844 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d977e156-55bd-498a-bcf3-164960095df6 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 200 len: 1351 microversion: 2.1 time: 0.097972 Aug 30 14:43:40.074421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 89/175] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:39 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:40.642255 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3a5977d7-bf98-4026-a60b-55d6907baf91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:40.642876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3a5977d7-bf98-4026-a60b-55d6907baf91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:40.649223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a5977d7-bf98-4026-a60b-55d6907baf91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:40.649704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a5977d7-bf98-4026-a60b-55d6907baf91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:40.650137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a5977d7-bf98-4026-a60b-55d6907baf91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:40.650818 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a5977d7-bf98-4026-a60b-55d6907baf91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:40.651289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a5977d7-bf98-4026-a60b-55d6907baf91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:40.651710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a5977d7-bf98-4026-a60b-55d6907baf91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:40.787666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3a5977d7-bf98-4026-a60b-55d6907baf91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:40.799278 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3a5977d7-bf98-4026-a60b-55d6907baf91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.161250 Aug 30 14:43:40.801120 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 87/176] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:40 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:41.096403 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2dfb032f-da3f-45d9-9aea-b8d029044416 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:41.096403 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2dfb032f-da3f-45d9-9aea-b8d029044416 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:41.101455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dfb032f-da3f-45d9-9aea-b8d029044416 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:41.101937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dfb032f-da3f-45d9-9aea-b8d029044416 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:41.102372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dfb032f-da3f-45d9-9aea-b8d029044416 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:41.103058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dfb032f-da3f-45d9-9aea-b8d029044416 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:41.103531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dfb032f-da3f-45d9-9aea-b8d029044416 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:41.103957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dfb032f-da3f-45d9-9aea-b8d029044416 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:41.118131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-2dfb032f-da3f-45d9-9aea-b8d029044416 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] HTTP exception thrown: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2dfb032f-da3f-45d9-9aea-b8d029044416 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Request method failure captured: Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b HTTP/1.1 Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDiHS3XMRAfWIGn9Z4iExAToL_nuYhcmqGec2dPg9aMtk724pKSCbQ17ibzXHikvofkVC9OuoA-0YZ4KqNi2kpSTgFJvJwVVPKdtzrfq0Mj79VH1_AHDRhDRR7rpjYOCAVpOrpHXIczprY_C9DgsT66QCjLOXKHre15gGuR0sto50Waw Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: 8aeffb40eafc44639c8e5032dce345aa Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-DeleteServersTestJSON-1458931044 Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 14:43:41.123134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 14:43:41.124609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8aeffb40eafc44639c8e5032dce345aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8aeffb40eafc44639c8e5032dce345aa", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8aeffb40eafc44639c8e5032dce345aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8aeffb40eafc44639c8e5032dce345aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:43:41.124609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-DeleteServersTestJSON-1458931044 Aug 30 14:43:41.124609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 8aeffb40eafc44639c8e5032dce345aa Aug 30 14:43:41.124609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-DeleteServersTestJSON-1458931044 Aug 30 14:43:41.124609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-DeleteServersTestJSON-1458931044-project Aug 30 14:43:41.124609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 14:43:41.124609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 14:43:41.124609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: 0642fa92a86c4e01a42bf087cd36cace Aug 30 14:43:41.124609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-DeleteServersTestJSON-1458931044-project Aug 30 14:43:41.124609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 14:43:41.124609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:41.124609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': 'ee44201c-2900-4495-9e36-6dc27160909b'} Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:43:41.125413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:41.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:43:41.127704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2dfb032f-da3f-45d9-9aea-b8d029044416 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Returning 404 to user: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:43:41.127704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2dfb032f-da3f-45d9-9aea-b8d029044416 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 404 len: 111 microversion: 2.1 time: 0.034084 Aug 30 14:43:41.127704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 90/177] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:41 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:43:41.244680 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d5de8dda-42d1-4faa-a16f-fd30bd18ca9e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:41.244680 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d5de8dda-42d1-4faa-a16f-fd30bd18ca9e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:41.250355 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5de8dda-42d1-4faa-a16f-fd30bd18ca9e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:41.250838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5de8dda-42d1-4faa-a16f-fd30bd18ca9e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:41.251298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5de8dda-42d1-4faa-a16f-fd30bd18ca9e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:41.251987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5de8dda-42d1-4faa-a16f-fd30bd18ca9e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:41.252437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5de8dda-42d1-4faa-a16f-fd30bd18ca9e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:41.252855 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5de8dda-42d1-4faa-a16f-fd30bd18ca9e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:41.266643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-d5de8dda-42d1-4faa-a16f-fd30bd18ca9e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] HTTP exception thrown: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d5de8dda-42d1-4faa-a16f-fd30bd18ca9e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Request method failure captured: Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b/os-volume_attachments HTTP/1.1 Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHS3XMRAfWIGn9Z4iExAToL_nuYhcmqGec2dPg9aMtk724pKSCbQ17ibzXHikvofkVC9OuoA-0YZ4KqNi2kpSTgFJvJwVVPKdtzrfq0Mj79VH1_AHDRhDRR7rpjYOCAVpOrpHXIczprY_C9DgsT66QCjLOXKHre15gGuR0sto50Waw Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: 8aeffb40eafc44639c8e5032dce345aa Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-DeleteServersTestJSON-1458931044 Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 14:43:41.270717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 14:43:41.272154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8aeffb40eafc44639c8e5032dce345aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8aeffb40eafc44639c8e5032dce345aa", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8aeffb40eafc44639c8e5032dce345aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8aeffb40eafc44639c8e5032dce345aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:43:41.272154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-DeleteServersTestJSON-1458931044 Aug 30 14:43:41.272154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: 8aeffb40eafc44639c8e5032dce345aa Aug 30 14:43:41.272154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-DeleteServersTestJSON-1458931044 Aug 30 14:43:41.272154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-DeleteServersTestJSON-1458931044-project Aug 30 14:43:41.272154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 14:43:41.272154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 14:43:41.272154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: 0642fa92a86c4e01a42bf087cd36cace Aug 30 14:43:41.272154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-DeleteServersTestJSON-1458931044-project Aug 30 14:43:41.272154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 14:43:41.272154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:41.272154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'server_id': 'ee44201c-2900-4495-9e36-6dc27160909b'} Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:43:41.273145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:41.274262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:43:41.275370 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d5de8dda-42d1-4faa-a16f-fd30bd18ca9e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Returning 404 to user: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:43:41.275370 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d5de8dda-42d1-4faa-a16f-fd30bd18ca9e tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034286 Aug 30 14:43:41.275370 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 88/178] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:43:41 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:43:41.822206 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7bb03648-e4f3-4715-b720-32beb5bd351c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:41.822861 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7bb03648-e4f3-4715-b720-32beb5bd351c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:41.829724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7bb03648-e4f3-4715-b720-32beb5bd351c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:41.830201 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7bb03648-e4f3-4715-b720-32beb5bd351c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:41.830631 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7bb03648-e4f3-4715-b720-32beb5bd351c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:41.831374 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7bb03648-e4f3-4715-b720-32beb5bd351c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:41.831835 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7bb03648-e4f3-4715-b720-32beb5bd351c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:41.832235 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7bb03648-e4f3-4715-b720-32beb5bd351c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:42.014770 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7bb03648-e4f3-4715-b720-32beb5bd351c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:42.034709 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7bb03648-e4f3-4715-b720-32beb5bd351c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.216213 Aug 30 14:43:42.035388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 91/179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:41 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:42.491863 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cf137f25-368f-43ba-99bc-4f218d6a6641 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:42.492365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cf137f25-368f-43ba-99bc-4f218d6a6641 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:42.499432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cf137f25-368f-43ba-99bc-4f218d6a6641 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:42.499912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cf137f25-368f-43ba-99bc-4f218d6a6641 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:42.500335 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cf137f25-368f-43ba-99bc-4f218d6a6641 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:42.501023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cf137f25-368f-43ba-99bc-4f218d6a6641 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:42.501458 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cf137f25-368f-43ba-99bc-4f218d6a6641 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:42.501873 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cf137f25-368f-43ba-99bc-4f218d6a6641 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:42.523273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-cf137f25-368f-43ba-99bc-4f218d6a6641 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] HTTP exception thrown: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cf137f25-368f-43ba-99bc-4f218d6a6641 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Request method failure captured: Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: DELETE /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b HTTP/1.1 Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHS3XMRAfWIGn9Z4iExAToL_nuYhcmqGec2dPg9aMtk724pKSCbQ17ibzXHikvofkVC9OuoA-0YZ4KqNi2kpSTgFJvJwVVPKdtzrfq0Mj79VH1_AHDRhDRR7rpjYOCAVpOrpHXIczprY_C9DgsT66QCjLOXKHre15gGuR0sto50Waw Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: 8aeffb40eafc44639c8e5032dce345aa Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-DeleteServersTestJSON-1458931044 Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 14:43:42.525683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 14:43:42.527092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8aeffb40eafc44639c8e5032dce345aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8aeffb40eafc44639c8e5032dce345aa", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8aeffb40eafc44639c8e5032dce345aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8aeffb40eafc44639c8e5032dce345aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:43:42.527092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-DeleteServersTestJSON-1458931044 Aug 30 14:43:42.527092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: 8aeffb40eafc44639c8e5032dce345aa Aug 30 14:43:42.527092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-DeleteServersTestJSON-1458931044 Aug 30 14:43:42.527092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-DeleteServersTestJSON-1458931044-project Aug 30 14:43:42.527092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 14:43:42.527092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 14:43:42.527092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: 0642fa92a86c4e01a42bf087cd36cace Aug 30 14:43:42.527092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-DeleteServersTestJSON-1458931044-project Aug 30 14:43:42.527092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 14:43:42.527092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:42.527092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': 'ee44201c-2900-4495-9e36-6dc27160909b'} Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:43:42.527898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:42.529454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:43:42.531882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cf137f25-368f-43ba-99bc-4f218d6a6641 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Returning 404 to user: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:43:42.532882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cf137f25-368f-43ba-99bc-4f218d6a6641 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 404 len: 111 microversion: 2.1 time: 0.044853 Aug 30 14:43:42.533997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 89/180] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 14:43:42 2022] DELETE /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 14:43:42.544226 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fdb8dc7b-ea34-40a0-9741-be15ac069d45 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:42.546780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fdb8dc7b-ea34-40a0-9741-be15ac069d45 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] [instance: ee44201c-2900-4495-9e36-6dc27160909b] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:42.554467 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdb8dc7b-ea34-40a0-9741-be15ac069d45 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:42.555449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdb8dc7b-ea34-40a0-9741-be15ac069d45 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:42.556416 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdb8dc7b-ea34-40a0-9741-be15ac069d45 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:42.557354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdb8dc7b-ea34-40a0-9741-be15ac069d45 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:42.558321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdb8dc7b-ea34-40a0-9741-be15ac069d45 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:42.559900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdb8dc7b-ea34-40a0-9741-be15ac069d45 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:42.581859 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-fdb8dc7b-ea34-40a0-9741-be15ac069d45 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] HTTP exception thrown: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fdb8dc7b-ea34-40a0-9741-be15ac069d45 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Request method failure captured: Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b HTTP/1.1 Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDiHS3XMRAfWIGn9Z4iExAToL_nuYhcmqGec2dPg9aMtk724pKSCbQ17ibzXHikvofkVC9OuoA-0YZ4KqNi2kpSTgFJvJwVVPKdtzrfq0Mj79VH1_AHDRhDRR7rpjYOCAVpOrpHXIczprY_C9DgsT66QCjLOXKHre15gGuR0sto50Waw Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: 8aeffb40eafc44639c8e5032dce345aa Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-DeleteServersTestJSON-1458931044 Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 14:43:42.583696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 14:43:42.585296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8aeffb40eafc44639c8e5032dce345aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8aeffb40eafc44639c8e5032dce345aa", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8aeffb40eafc44639c8e5032dce345aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8aeffb40eafc44639c8e5032dce345aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:43:42.585296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-DeleteServersTestJSON-1458931044 Aug 30 14:43:42.585296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 8aeffb40eafc44639c8e5032dce345aa Aug 30 14:43:42.585296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-DeleteServersTestJSON-1458931044 Aug 30 14:43:42.585296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-DeleteServersTestJSON-1458931044-project Aug 30 14:43:42.585296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 14:43:42.585296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 14:43:42.585296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: 0642fa92a86c4e01a42bf087cd36cace Aug 30 14:43:42.585296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-DeleteServersTestJSON-1458931044-project Aug 30 14:43:42.585296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 14:43:42.585296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:42.585296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': 'ee44201c-2900-4495-9e36-6dc27160909b'} Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:43:42.585949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. Aug 30 14:43:42.587040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:43:42.589408 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fdb8dc7b-ea34-40a0-9741-be15ac069d45 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] Returning 404 to user: Instance ee44201c-2900-4495-9e36-6dc27160909b could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:43:42.591364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fdb8dc7b-ea34-40a0-9741-be15ac069d45 tempest-DeleteServersTestJSON-1458931044 tempest-DeleteServersTestJSON-1458931044-project] 10.222.0.30 "GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b" status: 404 len: 111 microversion: 2.1 time: 0.052166 Aug 30 14:43:42.592639 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 92/181] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:42 2022] GET /compute/v2.1/servers/ee44201c-2900-4495-9e36-6dc27160909b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:43:43.068774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ed6d3ef0-7984-4544-80cc-0f0ac55629b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:43.069334 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ed6d3ef0-7984-4544-80cc-0f0ac55629b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:43.078770 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ed6d3ef0-7984-4544-80cc-0f0ac55629b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:43.079271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ed6d3ef0-7984-4544-80cc-0f0ac55629b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:43.079708 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ed6d3ef0-7984-4544-80cc-0f0ac55629b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:43.080399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ed6d3ef0-7984-4544-80cc-0f0ac55629b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:43.080841 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ed6d3ef0-7984-4544-80cc-0f0ac55629b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:43.081253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ed6d3ef0-7984-4544-80cc-0f0ac55629b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:43.437075 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ed6d3ef0-7984-4544-80cc-0f0ac55629b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:43.441579 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:43.456584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ed6d3ef0-7984-4544-80cc-0f0ac55629b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.391865 Aug 30 14:43:43.468771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 90/182] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:43 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:44.490947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cf6b989e-4e7a-44cf-92aa-37d776beec04 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:44.492598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cf6b989e-4e7a-44cf-92aa-37d776beec04 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:44.500757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf6b989e-4e7a-44cf-92aa-37d776beec04 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:44.501756 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf6b989e-4e7a-44cf-92aa-37d776beec04 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:44.502606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf6b989e-4e7a-44cf-92aa-37d776beec04 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:44.504139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf6b989e-4e7a-44cf-92aa-37d776beec04 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:44.504818 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf6b989e-4e7a-44cf-92aa-37d776beec04 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:44.505442 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf6b989e-4e7a-44cf-92aa-37d776beec04 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:44.676985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cf6b989e-4e7a-44cf-92aa-37d776beec04 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:44.685081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cf6b989e-4e7a-44cf-92aa-37d776beec04 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.199127 Aug 30 14:43:44.695581 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 93/183] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:44 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:45.708179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b395f55b-fb73-49ba-a521-5ae6600689aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:45.708855 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b395f55b-fb73-49ba-a521-5ae6600689aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:45.716696 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b395f55b-fb73-49ba-a521-5ae6600689aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:45.717177 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b395f55b-fb73-49ba-a521-5ae6600689aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:45.717660 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b395f55b-fb73-49ba-a521-5ae6600689aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:45.718534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b395f55b-fb73-49ba-a521-5ae6600689aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:45.719250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b395f55b-fb73-49ba-a521-5ae6600689aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:45.719659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b395f55b-fb73-49ba-a521-5ae6600689aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:45.952698 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b395f55b-fb73-49ba-a521-5ae6600689aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:45.964060 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b395f55b-fb73-49ba-a521-5ae6600689aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.259834 Aug 30 14:43:45.964756 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 91/184] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:45 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:46.986449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-22a99334-345e-4b05-b07f-2668ccc05cfc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:46.987062 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-22a99334-345e-4b05-b07f-2668ccc05cfc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:46.992859 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22a99334-345e-4b05-b07f-2668ccc05cfc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:46.993454 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22a99334-345e-4b05-b07f-2668ccc05cfc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:46.993879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22a99334-345e-4b05-b07f-2668ccc05cfc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:46.994538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22a99334-345e-4b05-b07f-2668ccc05cfc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:46.995016 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22a99334-345e-4b05-b07f-2668ccc05cfc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:46.995436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22a99334-345e-4b05-b07f-2668ccc05cfc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:47.196606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-22a99334-345e-4b05-b07f-2668ccc05cfc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:47.208259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-22a99334-345e-4b05-b07f-2668ccc05cfc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.225522 Aug 30 14:43:47.209269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 94/185] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:46 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:48.230597 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7661b623-7405-4c46-a48d-8dd2099ae40a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:48.231331 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7661b623-7405-4c46-a48d-8dd2099ae40a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:48.237948 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7661b623-7405-4c46-a48d-8dd2099ae40a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:48.238394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7661b623-7405-4c46-a48d-8dd2099ae40a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:48.238826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7661b623-7405-4c46-a48d-8dd2099ae40a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:48.239834 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7661b623-7405-4c46-a48d-8dd2099ae40a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:48.240317 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7661b623-7405-4c46-a48d-8dd2099ae40a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:48.240905 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7661b623-7405-4c46-a48d-8dd2099ae40a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:48.390463 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7661b623-7405-4c46-a48d-8dd2099ae40a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:48.399257 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7661b623-7405-4c46-a48d-8dd2099ae40a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.173140 Aug 30 14:43:48.400428 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 92/186] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:48 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:49.422967 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-16ce6bc4-03fa-427d-bfc0-6cf6032e3df2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:49.423730 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-16ce6bc4-03fa-427d-bfc0-6cf6032e3df2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:49.429984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16ce6bc4-03fa-427d-bfc0-6cf6032e3df2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:49.430572 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16ce6bc4-03fa-427d-bfc0-6cf6032e3df2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:49.431010 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16ce6bc4-03fa-427d-bfc0-6cf6032e3df2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:49.431725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16ce6bc4-03fa-427d-bfc0-6cf6032e3df2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:49.432186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16ce6bc4-03fa-427d-bfc0-6cf6032e3df2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:49.432603 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16ce6bc4-03fa-427d-bfc0-6cf6032e3df2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:49.581688 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-16ce6bc4-03fa-427d-bfc0-6cf6032e3df2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:49.589908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-16ce6bc4-03fa-427d-bfc0-6cf6032e3df2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.173116 Aug 30 14:43:49.590587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 95/187] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:49 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:50.610889 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8cafd557-d389-4712-8b8b-53cb484dfa91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:50.611480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8cafd557-d389-4712-8b8b-53cb484dfa91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:50.617918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8cafd557-d389-4712-8b8b-53cb484dfa91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:50.618397 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8cafd557-d389-4712-8b8b-53cb484dfa91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:50.618849 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8cafd557-d389-4712-8b8b-53cb484dfa91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:50.619702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8cafd557-d389-4712-8b8b-53cb484dfa91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:50.620546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8cafd557-d389-4712-8b8b-53cb484dfa91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:50.628467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8cafd557-d389-4712-8b8b-53cb484dfa91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:50.829323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8cafd557-d389-4712-8b8b-53cb484dfa91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:50.837939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8cafd557-d389-4712-8b8b-53cb484dfa91 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.231838 Aug 30 14:43:50.863796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 93/188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:50 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:51.870325 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-297b03f5-0872-466c-98e8-2c44aad40a16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:51.872114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-297b03f5-0872-466c-98e8-2c44aad40a16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:51.874297 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:51.879828 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-297b03f5-0872-466c-98e8-2c44aad40a16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:51.880353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-297b03f5-0872-466c-98e8-2c44aad40a16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:51.880785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-297b03f5-0872-466c-98e8-2c44aad40a16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:51.881480 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-297b03f5-0872-466c-98e8-2c44aad40a16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:51.881927 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-297b03f5-0872-466c-98e8-2c44aad40a16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:51.882347 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-297b03f5-0872-466c-98e8-2c44aad40a16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:52.025839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-297b03f5-0872-466c-98e8-2c44aad40a16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:52.034835 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-297b03f5-0872-466c-98e8-2c44aad40a16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.168541 Aug 30 14:43:52.035469 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 96/189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:51 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:53.057345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0b03a785-51e6-49f8-96dd-54595e311076 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:53.057958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0b03a785-51e6-49f8-96dd-54595e311076 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:53.065061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b03a785-51e6-49f8-96dd-54595e311076 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:53.065840 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b03a785-51e6-49f8-96dd-54595e311076 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:53.066277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b03a785-51e6-49f8-96dd-54595e311076 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:53.066967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b03a785-51e6-49f8-96dd-54595e311076 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:53.067457 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b03a785-51e6-49f8-96dd-54595e311076 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:53.067883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b03a785-51e6-49f8-96dd-54595e311076 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:53.194808 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0b03a785-51e6-49f8-96dd-54595e311076 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:53.202467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0b03a785-51e6-49f8-96dd-54595e311076 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.149016 Aug 30 14:43:53.203040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 94/190] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:53 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:54.222442 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1a97ee06-6567-42a6-aa2e-76f0d3b7eac9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:54.223047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1a97ee06-6567-42a6-aa2e-76f0d3b7eac9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:54.229013 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a97ee06-6567-42a6-aa2e-76f0d3b7eac9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:54.229491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a97ee06-6567-42a6-aa2e-76f0d3b7eac9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:54.229921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a97ee06-6567-42a6-aa2e-76f0d3b7eac9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:54.230598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a97ee06-6567-42a6-aa2e-76f0d3b7eac9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:54.231168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a97ee06-6567-42a6-aa2e-76f0d3b7eac9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:54.231629 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a97ee06-6567-42a6-aa2e-76f0d3b7eac9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:54.358376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1a97ee06-6567-42a6-aa2e-76f0d3b7eac9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:54.365908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1a97ee06-6567-42a6-aa2e-76f0d3b7eac9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.147324 Aug 30 14:43:54.366477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 97/191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:54 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:55.386599 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-168cb3af-3da7-4972-bafe-58fd673a4dbe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:55.387758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-168cb3af-3da7-4972-bafe-58fd673a4dbe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:55.394774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-168cb3af-3da7-4972-bafe-58fd673a4dbe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:55.395325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-168cb3af-3da7-4972-bafe-58fd673a4dbe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:55.395751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-168cb3af-3da7-4972-bafe-58fd673a4dbe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:55.396429 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-168cb3af-3da7-4972-bafe-58fd673a4dbe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:55.396870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-168cb3af-3da7-4972-bafe-58fd673a4dbe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:55.397279 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-168cb3af-3da7-4972-bafe-58fd673a4dbe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:55.544925 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-168cb3af-3da7-4972-bafe-58fd673a4dbe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:55.552493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-168cb3af-3da7-4972-bafe-58fd673a4dbe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.169756 Aug 30 14:43:55.553059 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 95/192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:55 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:56.575393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-74f8d83b-b373-4b50-8817-9a83eb1bfe38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:56.576349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-74f8d83b-b373-4b50-8817-9a83eb1bfe38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:56.583587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-74f8d83b-b373-4b50-8817-9a83eb1bfe38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:56.584333 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-74f8d83b-b373-4b50-8817-9a83eb1bfe38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:56.586027 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-74f8d83b-b373-4b50-8817-9a83eb1bfe38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:56.587221 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-74f8d83b-b373-4b50-8817-9a83eb1bfe38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:56.587830 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-74f8d83b-b373-4b50-8817-9a83eb1bfe38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:56.588401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-74f8d83b-b373-4b50-8817-9a83eb1bfe38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:56.765877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-74f8d83b-b373-4b50-8817-9a83eb1bfe38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:56.777969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-74f8d83b-b373-4b50-8817-9a83eb1bfe38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.206960 Aug 30 14:43:56.783659 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 98/193] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:56 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:57.800157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d8a64da1-740e-40d0-a42b-6b37404a5b85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:57.800755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d8a64da1-740e-40d0-a42b-6b37404a5b85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:57.803434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=38 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:43:57.808594 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8a64da1-740e-40d0-a42b-6b37404a5b85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:57.809639 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8a64da1-740e-40d0-a42b-6b37404a5b85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:57.810062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8a64da1-740e-40d0-a42b-6b37404a5b85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:57.810731 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8a64da1-740e-40d0-a42b-6b37404a5b85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:57.811168 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8a64da1-740e-40d0-a42b-6b37404a5b85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:57.811605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8a64da1-740e-40d0-a42b-6b37404a5b85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:57.939655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d8a64da1-740e-40d0-a42b-6b37404a5b85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:57.947823 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d8a64da1-740e-40d0-a42b-6b37404a5b85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.151330 Aug 30 14:43:57.948639 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 96/194] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:57 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:43:58.968811 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4f90a767-4c45-4a74-955a-ea6e9ac01e2e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:43:58.969442 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4f90a767-4c45-4a74-955a-ea6e9ac01e2e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:43:58.975813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f90a767-4c45-4a74-955a-ea6e9ac01e2e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:58.976299 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f90a767-4c45-4a74-955a-ea6e9ac01e2e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:58.976728 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f90a767-4c45-4a74-955a-ea6e9ac01e2e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:58.977418 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f90a767-4c45-4a74-955a-ea6e9ac01e2e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:43:58.977862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f90a767-4c45-4a74-955a-ea6e9ac01e2e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:43:58.978276 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f90a767-4c45-4a74-955a-ea6e9ac01e2e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:43:59.126539 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4f90a767-4c45-4a74-955a-ea6e9ac01e2e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:43:59.134266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4f90a767-4c45-4a74-955a-ea6e9ac01e2e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.169486 Aug 30 14:43:59.135029 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 99/195] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:43:58 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:00.155996 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ac4a32b7-4c7b-4406-b8b2-46371b19dc87 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:00.156575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ac4a32b7-4c7b-4406-b8b2-46371b19dc87 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:00.162901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac4a32b7-4c7b-4406-b8b2-46371b19dc87 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:00.163413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac4a32b7-4c7b-4406-b8b2-46371b19dc87 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:00.163835 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac4a32b7-4c7b-4406-b8b2-46371b19dc87 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:00.164506 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac4a32b7-4c7b-4406-b8b2-46371b19dc87 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:00.164946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac4a32b7-4c7b-4406-b8b2-46371b19dc87 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:00.165357 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac4a32b7-4c7b-4406-b8b2-46371b19dc87 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:00.299522 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ac4a32b7-4c7b-4406-b8b2-46371b19dc87 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:00.307273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ac4a32b7-4c7b-4406-b8b2-46371b19dc87 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.155813 Aug 30 14:44:00.307842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 97/196] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:00 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:01.328759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c3a39c55-6377-4470-89a2-67ffac4c1a47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:01.329402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c3a39c55-6377-4470-89a2-67ffac4c1a47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:01.336229 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3a39c55-6377-4470-89a2-67ffac4c1a47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:01.336712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3a39c55-6377-4470-89a2-67ffac4c1a47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:01.337149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3a39c55-6377-4470-89a2-67ffac4c1a47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:01.337868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3a39c55-6377-4470-89a2-67ffac4c1a47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:01.338318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3a39c55-6377-4470-89a2-67ffac4c1a47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:01.338738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3a39c55-6377-4470-89a2-67ffac4c1a47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:01.476151 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c3a39c55-6377-4470-89a2-67ffac4c1a47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:01.483819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c3a39c55-6377-4470-89a2-67ffac4c1a47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.159253 Aug 30 14:44:01.484386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 100/197] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:01 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:02.503821 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-87046e85-db51-42ff-be97-227bc165d477 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:02.504422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-87046e85-db51-42ff-be97-227bc165d477 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:02.510762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-87046e85-db51-42ff-be97-227bc165d477 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:02.511259 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-87046e85-db51-42ff-be97-227bc165d477 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:02.511693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-87046e85-db51-42ff-be97-227bc165d477 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:02.512710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-87046e85-db51-42ff-be97-227bc165d477 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:02.513159 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-87046e85-db51-42ff-be97-227bc165d477 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:02.513579 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-87046e85-db51-42ff-be97-227bc165d477 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:02.651060 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-87046e85-db51-42ff-be97-227bc165d477 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:02.659835 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-87046e85-db51-42ff-be97-227bc165d477 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.159918 Aug 30 14:44:02.660433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 98/198] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:02 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:03.684856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fdf7b91e-60fb-4e2e-a31d-bcb2d9defc41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:03.687196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fdf7b91e-60fb-4e2e-a31d-bcb2d9defc41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:03.696330 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdf7b91e-60fb-4e2e-a31d-bcb2d9defc41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:03.696909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdf7b91e-60fb-4e2e-a31d-bcb2d9defc41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:03.697407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdf7b91e-60fb-4e2e-a31d-bcb2d9defc41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:03.698206 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdf7b91e-60fb-4e2e-a31d-bcb2d9defc41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:03.698878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdf7b91e-60fb-4e2e-a31d-bcb2d9defc41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:03.699647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdf7b91e-60fb-4e2e-a31d-bcb2d9defc41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:03.831351 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fdf7b91e-60fb-4e2e-a31d-bcb2d9defc41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:03.834780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:03.840143 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fdf7b91e-60fb-4e2e-a31d-bcb2d9defc41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.162307 Aug 30 14:44:03.840715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 101/199] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:03 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:04.860139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-376a8501-d1eb-4c71-b99d-44a6c0252fb1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:04.860787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-376a8501-d1eb-4c71-b99d-44a6c0252fb1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:04.867177 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-376a8501-d1eb-4c71-b99d-44a6c0252fb1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:04.867703 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-376a8501-d1eb-4c71-b99d-44a6c0252fb1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:04.868135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-376a8501-d1eb-4c71-b99d-44a6c0252fb1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:04.868824 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-376a8501-d1eb-4c71-b99d-44a6c0252fb1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:04.869278 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-376a8501-d1eb-4c71-b99d-44a6c0252fb1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:04.869697 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-376a8501-d1eb-4c71-b99d-44a6c0252fb1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:05.037077 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-376a8501-d1eb-4c71-b99d-44a6c0252fb1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:05.044693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-376a8501-d1eb-4c71-b99d-44a6c0252fb1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.188391 Aug 30 14:44:05.045639 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 99/200] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:04 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:06.066032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2ee9d324-2d56-4d96-a2e0-45be2972497b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:06.066649 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2ee9d324-2d56-4d96-a2e0-45be2972497b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:06.072689 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ee9d324-2d56-4d96-a2e0-45be2972497b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:06.073174 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ee9d324-2d56-4d96-a2e0-45be2972497b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:06.073611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ee9d324-2d56-4d96-a2e0-45be2972497b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:06.075437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ee9d324-2d56-4d96-a2e0-45be2972497b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:06.075719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ee9d324-2d56-4d96-a2e0-45be2972497b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:06.076146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ee9d324-2d56-4d96-a2e0-45be2972497b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:06.236809 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2ee9d324-2d56-4d96-a2e0-45be2972497b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:06.245025 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2ee9d324-2d56-4d96-a2e0-45be2972497b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.183388 Aug 30 14:44:06.245736 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 102/201] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:06 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:07.268859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-17277765-d04a-4d46-b092-96869e1eba13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:07.269758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-17277765-d04a-4d46-b092-96869e1eba13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:07.278581 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17277765-d04a-4d46-b092-96869e1eba13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:07.279085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17277765-d04a-4d46-b092-96869e1eba13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:07.279714 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17277765-d04a-4d46-b092-96869e1eba13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:07.280585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17277765-d04a-4d46-b092-96869e1eba13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:07.281029 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17277765-d04a-4d46-b092-96869e1eba13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:07.281483 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17277765-d04a-4d46-b092-96869e1eba13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:07.414709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-17277765-d04a-4d46-b092-96869e1eba13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:07.423429 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-17277765-d04a-4d46-b092-96869e1eba13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.159137 Aug 30 14:44:07.424010 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 100/202] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:07 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:08.443442 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a6568303-4405-45b3-a7de-85fa560c094b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:08.444016 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a6568303-4405-45b3-a7de-85fa560c094b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:08.450584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6568303-4405-45b3-a7de-85fa560c094b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:08.451055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6568303-4405-45b3-a7de-85fa560c094b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:08.451509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6568303-4405-45b3-a7de-85fa560c094b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:08.452183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6568303-4405-45b3-a7de-85fa560c094b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:08.452624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6568303-4405-45b3-a7de-85fa560c094b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:08.453035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6568303-4405-45b3-a7de-85fa560c094b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:08.596919 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a6568303-4405-45b3-a7de-85fa560c094b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:08.605595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a6568303-4405-45b3-a7de-85fa560c094b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.166386 Aug 30 14:44:08.606394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 103/203] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:08 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:09.625672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-214ac01c-51aa-4215-a3b1-ec16d612dc07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:09.626287 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-214ac01c-51aa-4215-a3b1-ec16d612dc07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:09.632683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-214ac01c-51aa-4215-a3b1-ec16d612dc07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:09.633167 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-214ac01c-51aa-4215-a3b1-ec16d612dc07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:09.633605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-214ac01c-51aa-4215-a3b1-ec16d612dc07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:09.634314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-214ac01c-51aa-4215-a3b1-ec16d612dc07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:09.634745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-214ac01c-51aa-4215-a3b1-ec16d612dc07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:09.635166 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-214ac01c-51aa-4215-a3b1-ec16d612dc07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:09.800994 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-214ac01c-51aa-4215-a3b1-ec16d612dc07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:09.809399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-214ac01c-51aa-4215-a3b1-ec16d612dc07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.187517 Aug 30 14:44:09.810078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 101/204] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:09 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:10.831320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7bced7bc-e127-40c9-8b7f-8ac8f992ad7c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:10.831988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7bced7bc-e127-40c9-8b7f-8ac8f992ad7c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:10.838255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7bced7bc-e127-40c9-8b7f-8ac8f992ad7c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:10.838745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7bced7bc-e127-40c9-8b7f-8ac8f992ad7c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:10.839278 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7bced7bc-e127-40c9-8b7f-8ac8f992ad7c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:10.840046 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7bced7bc-e127-40c9-8b7f-8ac8f992ad7c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:10.840575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7bced7bc-e127-40c9-8b7f-8ac8f992ad7c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:10.840932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7bced7bc-e127-40c9-8b7f-8ac8f992ad7c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:10.989477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7bced7bc-e127-40c9-8b7f-8ac8f992ad7c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:10.998238 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7bced7bc-e127-40c9-8b7f-8ac8f992ad7c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.171208 Aug 30 14:44:10.998808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 104/205] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:10 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:12.018860 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e0db21bb-f62b-435f-b8eb-a871244c5a5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:12.019495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e0db21bb-f62b-435f-b8eb-a871244c5a5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:12.025882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e0db21bb-f62b-435f-b8eb-a871244c5a5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:12.026357 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e0db21bb-f62b-435f-b8eb-a871244c5a5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:12.026784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e0db21bb-f62b-435f-b8eb-a871244c5a5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:12.027495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e0db21bb-f62b-435f-b8eb-a871244c5a5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:12.028053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e0db21bb-f62b-435f-b8eb-a871244c5a5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:12.028479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e0db21bb-f62b-435f-b8eb-a871244c5a5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:12.154492 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e0db21bb-f62b-435f-b8eb-a871244c5a5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:12.162028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e0db21bb-f62b-435f-b8eb-a871244c5a5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.147029 Aug 30 14:44:12.162885 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 102/206] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:12 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:13.184450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1c45574b-cd48-453d-ac72-9195a80f5e34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:13.185065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1c45574b-cd48-453d-ac72-9195a80f5e34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:13.192058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c45574b-cd48-453d-ac72-9195a80f5e34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:13.192540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c45574b-cd48-453d-ac72-9195a80f5e34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:13.192964 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c45574b-cd48-453d-ac72-9195a80f5e34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:13.193648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c45574b-cd48-453d-ac72-9195a80f5e34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:13.194095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c45574b-cd48-453d-ac72-9195a80f5e34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:13.194513 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c45574b-cd48-453d-ac72-9195a80f5e34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:13.348705 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1c45574b-cd48-453d-ac72-9195a80f5e34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:13.356794 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1c45574b-cd48-453d-ac72-9195a80f5e34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.176870 Aug 30 14:44:13.357354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 105/207] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:13 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:14.377140 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0adc1099-ff1f-4ea5-85f1-4b8e1a5cca56 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:14.377753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0adc1099-ff1f-4ea5-85f1-4b8e1a5cca56 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:14.384143 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0adc1099-ff1f-4ea5-85f1-4b8e1a5cca56 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:14.384618 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0adc1099-ff1f-4ea5-85f1-4b8e1a5cca56 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:14.385050 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0adc1099-ff1f-4ea5-85f1-4b8e1a5cca56 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:14.385740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0adc1099-ff1f-4ea5-85f1-4b8e1a5cca56 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:14.386192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0adc1099-ff1f-4ea5-85f1-4b8e1a5cca56 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:14.387118 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0adc1099-ff1f-4ea5-85f1-4b8e1a5cca56 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:14.513855 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0adc1099-ff1f-4ea5-85f1-4b8e1a5cca56 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:14.535848 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0adc1099-ff1f-4ea5-85f1-4b8e1a5cca56 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.161953 Aug 30 14:44:14.536638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 103/208] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:14 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:14.581284 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c20f2aa3-05e6-4814-843b-14d3b42eabd4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:14.581824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c20f2aa3-05e6-4814-843b-14d3b42eabd4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:14.587664 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c20f2aa3-05e6-4814-843b-14d3b42eabd4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:14.588141 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c20f2aa3-05e6-4814-843b-14d3b42eabd4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:14.588572 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c20f2aa3-05e6-4814-843b-14d3b42eabd4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:14.589249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c20f2aa3-05e6-4814-843b-14d3b42eabd4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:14.589754 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c20f2aa3-05e6-4814-843b-14d3b42eabd4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:14.590189 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c20f2aa3-05e6-4814-843b-14d3b42eabd4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:14.613626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c20f2aa3-05e6-4814-843b-14d3b42eabd4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/ips" status: 200 len: 145 microversion: 2.1 time: 0.036150 Aug 30 14:44:14.614190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 106/209] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 14:44:14 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:15.555984 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2281dbd9-b9cc-410d-b42e-6033e67a8067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:15.556583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2281dbd9-b9cc-410d-b42e-6033e67a8067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:15.563300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2281dbd9-b9cc-410d-b42e-6033e67a8067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:15.563778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2281dbd9-b9cc-410d-b42e-6033e67a8067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:15.564236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2281dbd9-b9cc-410d-b42e-6033e67a8067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:15.564921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2281dbd9-b9cc-410d-b42e-6033e67a8067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:15.565364 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2281dbd9-b9cc-410d-b42e-6033e67a8067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:15.566036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2281dbd9-b9cc-410d-b42e-6033e67a8067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:15.696354 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2281dbd9-b9cc-410d-b42e-6033e67a8067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:15.704492 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2281dbd9-b9cc-410d-b42e-6033e67a8067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.152311 Aug 30 14:44:15.705059 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 104/210] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:15 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:16.063389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1122dc68-01c7-4d45-a599-6140c69795d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:16.063930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1122dc68-01c7-4d45-a599-6140c69795d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:16.070004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1122dc68-01c7-4d45-a599-6140c69795d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:16.070471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1122dc68-01c7-4d45-a599-6140c69795d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:16.070897 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1122dc68-01c7-4d45-a599-6140c69795d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:16.071595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1122dc68-01c7-4d45-a599-6140c69795d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:16.072038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1122dc68-01c7-4d45-a599-6140c69795d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:16.072452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1122dc68-01c7-4d45-a599-6140c69795d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:16.095669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1122dc68-01c7-4d45-a599-6140c69795d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/ips" status: 200 len: 150 microversion: 2.20 time: 0.036127 Aug 30 14:44:16.096530 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 107/211] 10.222.0.30 () {60 vars in 1289 bytes} [Tue Aug 30 14:44:16 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:44:16.725682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3241e479-ba89-43e3-a5cd-399e8522c7cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:16.726291 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3241e479-ba89-43e3-a5cd-399e8522c7cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:16.733460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3241e479-ba89-43e3-a5cd-399e8522c7cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:16.733936 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3241e479-ba89-43e3-a5cd-399e8522c7cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:16.734359 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3241e479-ba89-43e3-a5cd-399e8522c7cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:16.735035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3241e479-ba89-43e3-a5cd-399e8522c7cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:16.735511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3241e479-ba89-43e3-a5cd-399e8522c7cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:16.735924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3241e479-ba89-43e3-a5cd-399e8522c7cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:16.739788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=85 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:16.861213 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3241e479-ba89-43e3-a5cd-399e8522c7cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:16.868782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3241e479-ba89-43e3-a5cd-399e8522c7cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.147128 Aug 30 14:44:16.869348 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 105/212] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:16 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:17.888909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e9a02b8f-29f5-458b-924d-705620f66d9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:17.889522 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e9a02b8f-29f5-458b-924d-705620f66d9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:17.895588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9a02b8f-29f5-458b-924d-705620f66d9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:17.896065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9a02b8f-29f5-458b-924d-705620f66d9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:17.896492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9a02b8f-29f5-458b-924d-705620f66d9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:17.897319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9a02b8f-29f5-458b-924d-705620f66d9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:17.897801 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9a02b8f-29f5-458b-924d-705620f66d9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:17.898186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9a02b8f-29f5-458b-924d-705620f66d9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:18.023081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e9a02b8f-29f5-458b-924d-705620f66d9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:18.030820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e9a02b8f-29f5-458b-924d-705620f66d9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.145799 Aug 30 14:44:18.031410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 108/213] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:17 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:19.051999 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6a015fd1-955c-4a7f-baeb-8366c7560634 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:19.052551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6a015fd1-955c-4a7f-baeb-8366c7560634 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:19.059629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a015fd1-955c-4a7f-baeb-8366c7560634 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:19.060111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a015fd1-955c-4a7f-baeb-8366c7560634 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:19.060545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a015fd1-955c-4a7f-baeb-8366c7560634 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:19.061226 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a015fd1-955c-4a7f-baeb-8366c7560634 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:19.061676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a015fd1-955c-4a7f-baeb-8366c7560634 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:19.062095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a015fd1-955c-4a7f-baeb-8366c7560634 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:19.192344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6a015fd1-955c-4a7f-baeb-8366c7560634 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:19.200551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6a015fd1-955c-4a7f-baeb-8366c7560634 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.152499 Aug 30 14:44:19.201109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 106/214] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:19 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:19.734007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-251fb2bd-33ab-48b1-9c07-0e945a242d3f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd340d06-1624-49eb-82ab-202c7aa240d5"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:19.736421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-251fb2bd-33ab-48b1-9c07-0e945a242d3f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:19.742419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-251fb2bd-33ab-48b1-9c07-0e945a242d3f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:19.742896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-251fb2bd-33ab-48b1-9c07-0e945a242d3f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:19.743359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-251fb2bd-33ab-48b1-9c07-0e945a242d3f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:19.744047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-251fb2bd-33ab-48b1-9c07-0e945a242d3f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:19.744495 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-251fb2bd-33ab-48b1-9c07-0e945a242d3f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:19.744909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-251fb2bd-33ab-48b1-9c07-0e945a242d3f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:20.221780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f9970574-ef89-4934-9516-6df8a7cdf74d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:20.222421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f9970574-ef89-4934-9516-6df8a7cdf74d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:20.229272 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9970574-ef89-4934-9516-6df8a7cdf74d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:20.229753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9970574-ef89-4934-9516-6df8a7cdf74d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:20.230186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9970574-ef89-4934-9516-6df8a7cdf74d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:20.230963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9970574-ef89-4934-9516-6df8a7cdf74d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:20.231443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9970574-ef89-4934-9516-6df8a7cdf74d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:20.231868 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9970574-ef89-4934-9516-6df8a7cdf74d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:20.380026 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f9970574-ef89-4934-9516-6df8a7cdf74d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:20.388533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f9970574-ef89-4934-9516-6df8a7cdf74d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1521 microversion: 2.1 time: 0.170800 Aug 30 14:44:20.389108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 107/215] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:20 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:20.649155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c4ab18a3-9ff7-4380-b947-cf5198a4e0e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:20.649690 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c4ab18a3-9ff7-4380-b947-cf5198a4e0e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:20.656924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c4ab18a3-9ff7-4380-b947-cf5198a4e0e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:20.657379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c4ab18a3-9ff7-4380-b947-cf5198a4e0e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:20.657955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c4ab18a3-9ff7-4380-b947-cf5198a4e0e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:20.658633 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c4ab18a3-9ff7-4380-b947-cf5198a4e0e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:20.659080 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c4ab18a3-9ff7-4380-b947-cf5198a4e0e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:20.659535 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c4ab18a3-9ff7-4380-b947-cf5198a4e0e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:20.683560 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.objects.instance [None req-c4ab18a3-9ff7-4380-b947-cf5198a4e0e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lazy-loading 'flavor' on Instance uuid df823286-f7fd-4dbf-acb5-7cd297f48da0 {{(pid=127089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:44:20.722185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-251fb2bd-33ab-48b1-9c07-0e945a242d3f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "POST /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.992903 Aug 30 14:44:20.723249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 109/216] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 14:44:19 2022] POST /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/os-volume_attachments => generated 194 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:20.978127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c4ab18a3-9ff7-4380-b947-cf5198a4e0e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "POST /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/action" status: 202 len: 0 microversion: 2.20 time: 0.332787 Aug 30 14:44:20.978909 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 108/217] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 14:44:20 2022] POST /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 14:44:20.990295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a71f3b37-7050-482b-9f42-c66262395fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:20.991580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a71f3b37-7050-482b-9f42-c66262395fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:21.001545 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a71f3b37-7050-482b-9f42-c66262395fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:21.002103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a71f3b37-7050-482b-9f42-c66262395fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:21.002599 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a71f3b37-7050-482b-9f42-c66262395fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:21.003523 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a71f3b37-7050-482b-9f42-c66262395fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:21.004288 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a71f3b37-7050-482b-9f42-c66262395fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:21.004771 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a71f3b37-7050-482b-9f42-c66262395fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:21.140533 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a71f3b37-7050-482b-9f42-c66262395fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:21.148807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a71f3b37-7050-482b-9f42-c66262395fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:21.150466 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a71f3b37-7050-482b-9f42-c66262395fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:21.151707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a71f3b37-7050-482b-9f42-c66262395fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.166950 Aug 30 14:44:21.152338 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 110/218] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:20 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:21.411113 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-eedcb3ba-45c7-4c50-b5c7-a4c9f5c9fd44 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:21.411856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-eedcb3ba-45c7-4c50-b5c7-a4c9f5c9fd44 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:21.418961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eedcb3ba-45c7-4c50-b5c7-a4c9f5c9fd44 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:21.419461 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eedcb3ba-45c7-4c50-b5c7-a4c9f5c9fd44 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:21.419888 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eedcb3ba-45c7-4c50-b5c7-a4c9f5c9fd44 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:21.420564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eedcb3ba-45c7-4c50-b5c7-a4c9f5c9fd44 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:21.421006 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eedcb3ba-45c7-4c50-b5c7-a4c9f5c9fd44 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:21.421422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eedcb3ba-45c7-4c50-b5c7-a4c9f5c9fd44 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:21.546904 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-eedcb3ba-45c7-4c50-b5c7-a4c9f5c9fd44 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:21.554659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-eedcb3ba-45c7-4c50-b5c7-a4c9f5c9fd44 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1501 microversion: 2.1 time: 0.148582 Aug 30 14:44:21.555235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 109/219] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:21 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1501 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:21.574209 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dbef027c-4592-4f2e-89bc-8024e92b74c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:21.574871 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dbef027c-4592-4f2e-89bc-8024e92b74c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:21.581240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbef027c-4592-4f2e-89bc-8024e92b74c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:21.581747 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbef027c-4592-4f2e-89bc-8024e92b74c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:21.582177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbef027c-4592-4f2e-89bc-8024e92b74c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:21.582854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbef027c-4592-4f2e-89bc-8024e92b74c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:21.583332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbef027c-4592-4f2e-89bc-8024e92b74c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:21.583751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbef027c-4592-4f2e-89bc-8024e92b74c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:21.850867 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-dbef027c-4592-4f2e-89bc-8024e92b74c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:21.859253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dbef027c-4592-4f2e-89bc-8024e92b74c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1516 microversion: 2.1 time: 0.288761 Aug 30 14:44:21.859823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 111/220] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:21 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1516 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:22.174268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ce8e8097-70ce-4d70-a6f5-cab09bd39730 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:22.174869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ce8e8097-70ce-4d70-a6f5-cab09bd39730 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:22.181996 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce8e8097-70ce-4d70-a6f5-cab09bd39730 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:22.182467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce8e8097-70ce-4d70-a6f5-cab09bd39730 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:22.184668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce8e8097-70ce-4d70-a6f5-cab09bd39730 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:22.185377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce8e8097-70ce-4d70-a6f5-cab09bd39730 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:22.185822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce8e8097-70ce-4d70-a6f5-cab09bd39730 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:22.186493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce8e8097-70ce-4d70-a6f5-cab09bd39730 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:22.342965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ce8e8097-70ce-4d70-a6f5-cab09bd39730 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:22.351474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ce8e8097-70ce-4d70-a6f5-cab09bd39730 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:22.352910 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ce8e8097-70ce-4d70-a6f5-cab09bd39730 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:22.354049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ce8e8097-70ce-4d70-a6f5-cab09bd39730 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.183673 Aug 30 14:44:22.354605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 110/221] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:22 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:23.263448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3be3159d-2bc7-4f4d-bb30-117153e0e0ba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:23.265794 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3be3159d-2bc7-4f4d-bb30-117153e0e0ba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:23.269331 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=32 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:23.273075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3be3159d-2bc7-4f4d-bb30-117153e0e0ba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:23.273528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3be3159d-2bc7-4f4d-bb30-117153e0e0ba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:23.273956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3be3159d-2bc7-4f4d-bb30-117153e0e0ba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:23.274668 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3be3159d-2bc7-4f4d-bb30-117153e0e0ba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:23.275113 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3be3159d-2bc7-4f4d-bb30-117153e0e0ba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:23.275557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3be3159d-2bc7-4f4d-bb30-117153e0e0ba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:23.307372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-3be3159d-2bc7-4f4d-bb30-117153e0e0ba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lazy-loading 'flavor' on Instance uuid d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:44:23.382764 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6545cc76-5038-413a-827b-9274f0f511f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:23.384088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6545cc76-5038-413a-827b-9274f0f511f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:23.385623 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3be3159d-2bc7-4f4d-bb30-117153e0e0ba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "POST /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6/action" status: 200 len: 32 microversion: 2.1 time: 0.126823 Aug 30 14:44:23.386759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 112/222] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 14:44:23 2022] POST /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6/action => generated 32 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 14:44:23.391989 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6545cc76-5038-413a-827b-9274f0f511f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:23.392599 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6545cc76-5038-413a-827b-9274f0f511f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:23.393053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6545cc76-5038-413a-827b-9274f0f511f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:23.393756 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6545cc76-5038-413a-827b-9274f0f511f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:23.394208 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6545cc76-5038-413a-827b-9274f0f511f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:23.394634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6545cc76-5038-413a-827b-9274f0f511f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:23.397510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-38e9f1c1-ed30-4e01-bd1d-510d8312397b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:23.398679 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-38e9f1c1-ed30-4e01-bd1d-510d8312397b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:23.406616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38e9f1c1-ed30-4e01-bd1d-510d8312397b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:23.407079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38e9f1c1-ed30-4e01-bd1d-510d8312397b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:23.407621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38e9f1c1-ed30-4e01-bd1d-510d8312397b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:23.408314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38e9f1c1-ed30-4e01-bd1d-510d8312397b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:23.409251 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38e9f1c1-ed30-4e01-bd1d-510d8312397b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:23.409664 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38e9f1c1-ed30-4e01-bd1d-510d8312397b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:23.567321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-38e9f1c1-ed30-4e01-bd1d-510d8312397b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:23.570620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6545cc76-5038-413a-827b-9274f0f511f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:23.576224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-38e9f1c1-ed30-4e01-bd1d-510d8312397b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.183599 Aug 30 14:44:23.577101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 113/223] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:23 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:23.581616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6545cc76-5038-413a-827b-9274f0f511f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:23.583153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6545cc76-5038-413a-827b-9274f0f511f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:23.584345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6545cc76-5038-413a-827b-9274f0f511f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.207899 Aug 30 14:44:23.584907 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 111/224] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:23 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:24.597260 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-490d11ad-4670-41e1-bea9-c81c3203c743 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:24.598614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-490d11ad-4670-41e1-bea9-c81c3203c743 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:24.606210 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-490d11ad-4670-41e1-bea9-c81c3203c743 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:24.606210 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-490d11ad-4670-41e1-bea9-c81c3203c743 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:24.608989 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bb14680c-06db-4581-b62f-c07a26ed4cdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:24.609543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-490d11ad-4670-41e1-bea9-c81c3203c743 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:24.609830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bb14680c-06db-4581-b62f-c07a26ed4cdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:24.610338 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-490d11ad-4670-41e1-bea9-c81c3203c743 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:24.610930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-490d11ad-4670-41e1-bea9-c81c3203c743 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:24.611395 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-490d11ad-4670-41e1-bea9-c81c3203c743 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:24.617314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb14680c-06db-4581-b62f-c07a26ed4cdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:24.617933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb14680c-06db-4581-b62f-c07a26ed4cdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:24.618600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb14680c-06db-4581-b62f-c07a26ed4cdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:24.619534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb14680c-06db-4581-b62f-c07a26ed4cdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:24.620198 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb14680c-06db-4581-b62f-c07a26ed4cdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:24.621111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb14680c-06db-4581-b62f-c07a26ed4cdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:24.775908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-490d11ad-4670-41e1-bea9-c81c3203c743 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:24.784538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-490d11ad-4670-41e1-bea9-c81c3203c743 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.191149 Aug 30 14:44:24.785320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 114/225] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:24 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:24.798485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bb14680c-06db-4581-b62f-c07a26ed4cdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:24.806833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bb14680c-06db-4581-b62f-c07a26ed4cdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:24.808527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bb14680c-06db-4581-b62f-c07a26ed4cdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:24.809693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bb14680c-06db-4581-b62f-c07a26ed4cdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.205806 Aug 30 14:44:24.810263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 112/226] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:24 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:44:25.805724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c6026487-d5c6-49a4-bd94-f04b62c8994e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:25.806331 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c6026487-d5c6-49a4-bd94-f04b62c8994e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:25.812786 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6026487-d5c6-49a4-bd94-f04b62c8994e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:25.813262 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6026487-d5c6-49a4-bd94-f04b62c8994e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:25.813661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6026487-d5c6-49a4-bd94-f04b62c8994e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:25.814333 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6026487-d5c6-49a4-bd94-f04b62c8994e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:25.814776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6026487-d5c6-49a4-bd94-f04b62c8994e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:25.815188 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6026487-d5c6-49a4-bd94-f04b62c8994e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:25.833041 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f8841d42-a625-40a9-b458-7950ac395c2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:25.833698 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f8841d42-a625-40a9-b458-7950ac395c2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:25.840748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8841d42-a625-40a9-b458-7950ac395c2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:25.841326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8841d42-a625-40a9-b458-7950ac395c2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:25.841805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8841d42-a625-40a9-b458-7950ac395c2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:25.842518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8841d42-a625-40a9-b458-7950ac395c2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:25.842981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8841d42-a625-40a9-b458-7950ac395c2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:25.843434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8841d42-a625-40a9-b458-7950ac395c2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:25.950848 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c6026487-d5c6-49a4-bd94-f04b62c8994e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:25.954422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:25.960399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c6026487-d5c6-49a4-bd94-f04b62c8994e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.158655 Aug 30 14:44:25.960974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 115/227] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:25 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:25.985080 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f8841d42-a625-40a9-b458-7950ac395c2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:25.994881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f8841d42-a625-40a9-b458-7950ac395c2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:25.997224 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f8841d42-a625-40a9-b458-7950ac395c2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:25.998383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f8841d42-a625-40a9-b458-7950ac395c2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.169189 Aug 30 14:44:25.998954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 113/228] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:25 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:26.982223 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9d738efa-8223-4756-a3e1-744c7e66b374 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:26.982789 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9d738efa-8223-4756-a3e1-744c7e66b374 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:26.990725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d738efa-8223-4756-a3e1-744c7e66b374 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:26.991225 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d738efa-8223-4756-a3e1-744c7e66b374 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:26.991653 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d738efa-8223-4756-a3e1-744c7e66b374 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:26.992361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d738efa-8223-4756-a3e1-744c7e66b374 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:26.992812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d738efa-8223-4756-a3e1-744c7e66b374 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:26.993227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d738efa-8223-4756-a3e1-744c7e66b374 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:27.023344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f3f999ee-8954-4d9b-ac61-f1e606ee0389 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:27.023973 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f3f999ee-8954-4d9b-ac61-f1e606ee0389 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:27.031396 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3f999ee-8954-4d9b-ac61-f1e606ee0389 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:27.031889 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3f999ee-8954-4d9b-ac61-f1e606ee0389 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:27.032321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3f999ee-8954-4d9b-ac61-f1e606ee0389 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:27.033009 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3f999ee-8954-4d9b-ac61-f1e606ee0389 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:27.033455 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3f999ee-8954-4d9b-ac61-f1e606ee0389 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:27.033873 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3f999ee-8954-4d9b-ac61-f1e606ee0389 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:27.121462 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9d738efa-8223-4756-a3e1-744c7e66b374 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:27.129163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9d738efa-8223-4756-a3e1-744c7e66b374 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.150944 Aug 30 14:44:27.129967 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 116/229] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:26 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:27.166980 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f3f999ee-8954-4d9b-ac61-f1e606ee0389 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:27.175346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f3f999ee-8954-4d9b-ac61-f1e606ee0389 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:27.176817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f3f999ee-8954-4d9b-ac61-f1e606ee0389 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:27.177972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f3f999ee-8954-4d9b-ac61-f1e606ee0389 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.158478 Aug 30 14:44:27.178518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 114/230] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:27 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:44:28.150436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bd07eea6-e647-45eb-80f8-ca5efa6a8500 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:28.151083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bd07eea6-e647-45eb-80f8-ca5efa6a8500 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:28.157439 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd07eea6-e647-45eb-80f8-ca5efa6a8500 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:28.157919 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd07eea6-e647-45eb-80f8-ca5efa6a8500 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:28.158349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd07eea6-e647-45eb-80f8-ca5efa6a8500 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:28.159035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd07eea6-e647-45eb-80f8-ca5efa6a8500 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:28.159515 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd07eea6-e647-45eb-80f8-ca5efa6a8500 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:28.159940 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd07eea6-e647-45eb-80f8-ca5efa6a8500 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:28.201300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-875b8caf-0ad5-4d73-9d35-3c3e0206ee29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:28.201918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-875b8caf-0ad5-4d73-9d35-3c3e0206ee29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:28.204447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=38 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:28.209666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-875b8caf-0ad5-4d73-9d35-3c3e0206ee29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:28.210154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-875b8caf-0ad5-4d73-9d35-3c3e0206ee29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:28.210588 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-875b8caf-0ad5-4d73-9d35-3c3e0206ee29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:28.211324 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-875b8caf-0ad5-4d73-9d35-3c3e0206ee29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:28.211782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-875b8caf-0ad5-4d73-9d35-3c3e0206ee29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:28.212220 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-875b8caf-0ad5-4d73-9d35-3c3e0206ee29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:28.300487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bd07eea6-e647-45eb-80f8-ca5efa6a8500 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:28.308836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bd07eea6-e647-45eb-80f8-ca5efa6a8500 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.162309 Aug 30 14:44:28.309419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 117/231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:28 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:28.345750 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-875b8caf-0ad5-4d73-9d35-3c3e0206ee29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:28.354099 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-875b8caf-0ad5-4d73-9d35-3c3e0206ee29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:28.356201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-875b8caf-0ad5-4d73-9d35-3c3e0206ee29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:28.357304 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-875b8caf-0ad5-4d73-9d35-3c3e0206ee29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.160431 Aug 30 14:44:28.357869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 115/232] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:28 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:44:29.330170 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6ef99435-8c37-42f3-bfd1-4ad4bc16b346 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:29.330777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6ef99435-8c37-42f3-bfd1-4ad4bc16b346 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:29.337199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ef99435-8c37-42f3-bfd1-4ad4bc16b346 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:29.337718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ef99435-8c37-42f3-bfd1-4ad4bc16b346 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:29.338178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ef99435-8c37-42f3-bfd1-4ad4bc16b346 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:29.339021 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ef99435-8c37-42f3-bfd1-4ad4bc16b346 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:29.340615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ef99435-8c37-42f3-bfd1-4ad4bc16b346 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:29.341046 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ef99435-8c37-42f3-bfd1-4ad4bc16b346 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:29.380565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2806ea79-30bf-4ad6-af81-22ef806ee1c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:29.381247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2806ea79-30bf-4ad6-af81-22ef806ee1c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:29.389526 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2806ea79-30bf-4ad6-af81-22ef806ee1c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:29.390008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2806ea79-30bf-4ad6-af81-22ef806ee1c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:29.390437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2806ea79-30bf-4ad6-af81-22ef806ee1c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:29.391125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2806ea79-30bf-4ad6-af81-22ef806ee1c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:29.391608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2806ea79-30bf-4ad6-af81-22ef806ee1c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:29.392178 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2806ea79-30bf-4ad6-af81-22ef806ee1c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:29.472660 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6ef99435-8c37-42f3-bfd1-4ad4bc16b346 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:29.480745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6ef99435-8c37-42f3-bfd1-4ad4bc16b346 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.154322 Aug 30 14:44:29.481317 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 118/233] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:29 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:29.527019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2806ea79-30bf-4ad6-af81-22ef806ee1c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:29.535495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2806ea79-30bf-4ad6-af81-22ef806ee1c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:29.536951 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2806ea79-30bf-4ad6-af81-22ef806ee1c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:29.538133 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2806ea79-30bf-4ad6-af81-22ef806ee1c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.161462 Aug 30 14:44:29.538699 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 116/234] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:29 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:44:30.501190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0faafafa-4983-4d08-bd24-2e70fde90d3b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:30.501792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0faafafa-4983-4d08-bd24-2e70fde90d3b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:30.508134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0faafafa-4983-4d08-bd24-2e70fde90d3b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:30.508611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0faafafa-4983-4d08-bd24-2e70fde90d3b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:30.509035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0faafafa-4983-4d08-bd24-2e70fde90d3b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:30.509733 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0faafafa-4983-4d08-bd24-2e70fde90d3b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:30.510141 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0faafafa-4983-4d08-bd24-2e70fde90d3b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:30.514614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0faafafa-4983-4d08-bd24-2e70fde90d3b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:30.561894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f2c4898c-f41d-485e-a1b1-b83ce3cf97fd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:30.563025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f2c4898c-f41d-485e-a1b1-b83ce3cf97fd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:30.570015 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2c4898c-f41d-485e-a1b1-b83ce3cf97fd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:30.570672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2c4898c-f41d-485e-a1b1-b83ce3cf97fd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:30.571101 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2c4898c-f41d-485e-a1b1-b83ce3cf97fd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:30.572122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2c4898c-f41d-485e-a1b1-b83ce3cf97fd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:30.572574 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2c4898c-f41d-485e-a1b1-b83ce3cf97fd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:30.572993 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2c4898c-f41d-485e-a1b1-b83ce3cf97fd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:30.675651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0faafafa-4983-4d08-bd24-2e70fde90d3b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:30.683768 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0faafafa-4983-4d08-bd24-2e70fde90d3b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.186272 Aug 30 14:44:30.684504 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 119/235] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:30 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:30.721768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f2c4898c-f41d-485e-a1b1-b83ce3cf97fd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:30.730144 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f2c4898c-f41d-485e-a1b1-b83ce3cf97fd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:30.731631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f2c4898c-f41d-485e-a1b1-b83ce3cf97fd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:30.732827 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f2c4898c-f41d-485e-a1b1-b83ce3cf97fd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.176041 Aug 30 14:44:30.736413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 117/236] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:30 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:44:31.704881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bdd827f5-0ce4-4e6f-891a-b524df3ce2e9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:31.705488 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bdd827f5-0ce4-4e6f-891a-b524df3ce2e9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:31.711965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdd827f5-0ce4-4e6f-891a-b524df3ce2e9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:31.712444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdd827f5-0ce4-4e6f-891a-b524df3ce2e9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:31.712875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdd827f5-0ce4-4e6f-891a-b524df3ce2e9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:31.713560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdd827f5-0ce4-4e6f-891a-b524df3ce2e9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:31.714606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdd827f5-0ce4-4e6f-891a-b524df3ce2e9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:31.715026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdd827f5-0ce4-4e6f-891a-b524df3ce2e9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:31.755401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9d1f10be-1ac3-4f59-ac0d-c0aa6ab025e6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:31.756029 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9d1f10be-1ac3-4f59-ac0d-c0aa6ab025e6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:31.763156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d1f10be-1ac3-4f59-ac0d-c0aa6ab025e6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:31.763670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d1f10be-1ac3-4f59-ac0d-c0aa6ab025e6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:31.764094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d1f10be-1ac3-4f59-ac0d-c0aa6ab025e6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:31.764802 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d1f10be-1ac3-4f59-ac0d-c0aa6ab025e6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:31.765243 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d1f10be-1ac3-4f59-ac0d-c0aa6ab025e6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:31.765767 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d1f10be-1ac3-4f59-ac0d-c0aa6ab025e6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:31.850048 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bdd827f5-0ce4-4e6f-891a-b524df3ce2e9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:31.857856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bdd827f5-0ce4-4e6f-891a-b524df3ce2e9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.156771 Aug 30 14:44:31.858431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 120/237] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:31 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:31.896332 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9d1f10be-1ac3-4f59-ac0d-c0aa6ab025e6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:31.904658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9d1f10be-1ac3-4f59-ac0d-c0aa6ab025e6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:31.906118 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9d1f10be-1ac3-4f59-ac0d-c0aa6ab025e6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:31.907330 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9d1f10be-1ac3-4f59-ac0d-c0aa6ab025e6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.155795 Aug 30 14:44:31.907901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 118/238] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:31 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:44:32.878245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-681c1cdb-7153-4e74-81c7-08b377808377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:32.878855 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-681c1cdb-7153-4e74-81c7-08b377808377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:32.885507 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-681c1cdb-7153-4e74-81c7-08b377808377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:32.886515 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-681c1cdb-7153-4e74-81c7-08b377808377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:32.886932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-681c1cdb-7153-4e74-81c7-08b377808377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:32.887667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-681c1cdb-7153-4e74-81c7-08b377808377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:32.888123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-681c1cdb-7153-4e74-81c7-08b377808377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:32.888545 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-681c1cdb-7153-4e74-81c7-08b377808377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:32.930735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2cf23bd6-319e-43ae-81ea-55584673f11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:32.931355 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2cf23bd6-319e-43ae-81ea-55584673f11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:32.938647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2cf23bd6-319e-43ae-81ea-55584673f11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:32.939130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2cf23bd6-319e-43ae-81ea-55584673f11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:32.939591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2cf23bd6-319e-43ae-81ea-55584673f11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:32.940303 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2cf23bd6-319e-43ae-81ea-55584673f11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:32.941009 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2cf23bd6-319e-43ae-81ea-55584673f11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:32.941436 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2cf23bd6-319e-43ae-81ea-55584673f11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:33.028602 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-681c1cdb-7153-4e74-81c7-08b377808377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:33.036376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-681c1cdb-7153-4e74-81c7-08b377808377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.162160 Aug 30 14:44:33.037157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 121/239] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:32 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:33.100989 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2cf23bd6-319e-43ae-81ea-55584673f11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:33.103180 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:33.111337 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2cf23bd6-319e-43ae-81ea-55584673f11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:33.112791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2cf23bd6-319e-43ae-81ea-55584673f11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:33.113944 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2cf23bd6-319e-43ae-81ea-55584673f11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.187507 Aug 30 14:44:33.114508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 119/240] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:32 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:33.596190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-31425255-019b-4b9d-8df9-0657e511099a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:33.602152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31425255-019b-4b9d-8df9-0657e511099a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:33.602628 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31425255-019b-4b9d-8df9-0657e511099a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:33.603058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31425255-019b-4b9d-8df9-0657e511099a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:33.666160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-31425255-019b-4b9d-8df9-0657e511099a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Going to try to stop instance {{(pid=127088) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 14:44:33.708315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-31425255-019b-4b9d-8df9-0657e511099a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "POST /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/action" status: 202 len: 0 microversion: 2.1 time: 0.115844 Aug 30 14:44:33.708930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 122/241] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 14:44:33 2022] POST /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:44:33.718202 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b5ceca06-eaf8-4c58-aa17-3a6fa05b43a4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:33.718923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b5ceca06-eaf8-4c58-aa17-3a6fa05b43a4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:33.725919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5ceca06-eaf8-4c58-aa17-3a6fa05b43a4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:33.726446 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5ceca06-eaf8-4c58-aa17-3a6fa05b43a4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:33.726900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5ceca06-eaf8-4c58-aa17-3a6fa05b43a4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:33.727685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5ceca06-eaf8-4c58-aa17-3a6fa05b43a4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:33.728623 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5ceca06-eaf8-4c58-aa17-3a6fa05b43a4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:33.729053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5ceca06-eaf8-4c58-aa17-3a6fa05b43a4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:33.865067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b5ceca06-eaf8-4c58-aa17-3a6fa05b43a4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:33.877197 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b5ceca06-eaf8-4c58-aa17-3a6fa05b43a4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1722 microversion: 2.1 time: 0.163625 Aug 30 14:44:33.878121 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 120/242] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:33 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:34.070423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bcc2c3c9-e93b-47cb-8574-bace6fa3b7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:34.070423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bcc2c3c9-e93b-47cb-8574-bace6fa3b7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:34.070423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bcc2c3c9-e93b-47cb-8574-bace6fa3b7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:34.070423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bcc2c3c9-e93b-47cb-8574-bace6fa3b7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:34.071114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bcc2c3c9-e93b-47cb-8574-bace6fa3b7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:34.071114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bcc2c3c9-e93b-47cb-8574-bace6fa3b7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:34.071114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bcc2c3c9-e93b-47cb-8574-bace6fa3b7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:34.071114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bcc2c3c9-e93b-47cb-8574-bace6fa3b7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:34.137093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a220fbe5-b1ca-4f4f-a541-21ea49e712c7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:34.137938 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a220fbe5-b1ca-4f4f-a541-21ea49e712c7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:34.144806 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a220fbe5-b1ca-4f4f-a541-21ea49e712c7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:34.145289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a220fbe5-b1ca-4f4f-a541-21ea49e712c7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:34.145720 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a220fbe5-b1ca-4f4f-a541-21ea49e712c7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:34.146415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a220fbe5-b1ca-4f4f-a541-21ea49e712c7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:34.146861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a220fbe5-b1ca-4f4f-a541-21ea49e712c7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:34.147312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a220fbe5-b1ca-4f4f-a541-21ea49e712c7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:34.208704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bcc2c3c9-e93b-47cb-8574-bace6fa3b7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:34.217990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bcc2c3c9-e93b-47cb-8574-bace6fa3b7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.165016 Aug 30 14:44:34.218651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 123/243] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:34 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:34.279417 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a220fbe5-b1ca-4f4f-a541-21ea49e712c7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:34.287355 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a220fbe5-b1ca-4f4f-a541-21ea49e712c7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:34.288810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a220fbe5-b1ca-4f4f-a541-21ea49e712c7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:34.289943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a220fbe5-b1ca-4f4f-a541-21ea49e712c7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.157335 Aug 30 14:44:34.290493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 121/244] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:34 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:44:34.900345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9f990374-6d7a-454a-8986-977e53b8fa1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:34.901067 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9f990374-6d7a-454a-8986-977e53b8fa1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:34.908192 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f990374-6d7a-454a-8986-977e53b8fa1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:34.908691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f990374-6d7a-454a-8986-977e53b8fa1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:34.909105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f990374-6d7a-454a-8986-977e53b8fa1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:34.909799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f990374-6d7a-454a-8986-977e53b8fa1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:34.910245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f990374-6d7a-454a-8986-977e53b8fa1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:34.910662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f990374-6d7a-454a-8986-977e53b8fa1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:35.045669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9f990374-6d7a-454a-8986-977e53b8fa1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:35.053732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9f990374-6d7a-454a-8986-977e53b8fa1a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1722 microversion: 2.1 time: 0.157314 Aug 30 14:44:35.054266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 124/245] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:34 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:35.238261 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8bdc18a7-2b45-4b67-87e7-9ad1cafea89c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:35.238871 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8bdc18a7-2b45-4b67-87e7-9ad1cafea89c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:35.246443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bdc18a7-2b45-4b67-87e7-9ad1cafea89c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:35.246934 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bdc18a7-2b45-4b67-87e7-9ad1cafea89c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:35.247394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bdc18a7-2b45-4b67-87e7-9ad1cafea89c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:35.248076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bdc18a7-2b45-4b67-87e7-9ad1cafea89c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:35.248523 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bdc18a7-2b45-4b67-87e7-9ad1cafea89c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:35.248939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bdc18a7-2b45-4b67-87e7-9ad1cafea89c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:35.313793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-de561987-a50b-4446-8879-101bd3d9fcc2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:35.316634 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-de561987-a50b-4446-8879-101bd3d9fcc2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:35.326619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de561987-a50b-4446-8879-101bd3d9fcc2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:35.327679 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de561987-a50b-4446-8879-101bd3d9fcc2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:35.328436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de561987-a50b-4446-8879-101bd3d9fcc2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:35.329465 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de561987-a50b-4446-8879-101bd3d9fcc2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:35.330386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de561987-a50b-4446-8879-101bd3d9fcc2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:35.331817 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de561987-a50b-4446-8879-101bd3d9fcc2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:35.440141 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8bdc18a7-2b45-4b67-87e7-9ad1cafea89c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:35.458721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8bdc18a7-2b45-4b67-87e7-9ad1cafea89c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.223728 Aug 30 14:44:35.461437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 122/246] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:35 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:35.540053 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-de561987-a50b-4446-8879-101bd3d9fcc2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:35.555103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-de561987-a50b-4446-8879-101bd3d9fcc2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:35.556790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-de561987-a50b-4446-8879-101bd3d9fcc2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:35.559602 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-de561987-a50b-4446-8879-101bd3d9fcc2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.251058 Aug 30 14:44:35.560378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 125/247] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:35 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:44:36.076267 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a56c5d10-4350-463e-ba34-95a3e960f3a5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:36.077757 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a56c5d10-4350-463e-ba34-95a3e960f3a5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:36.085024 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a56c5d10-4350-463e-ba34-95a3e960f3a5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:36.085581 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a56c5d10-4350-463e-ba34-95a3e960f3a5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:36.086087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a56c5d10-4350-463e-ba34-95a3e960f3a5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:36.086849 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a56c5d10-4350-463e-ba34-95a3e960f3a5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:36.087404 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a56c5d10-4350-463e-ba34-95a3e960f3a5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:36.087894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a56c5d10-4350-463e-ba34-95a3e960f3a5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:36.243886 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a56c5d10-4350-463e-ba34-95a3e960f3a5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:36.256838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a56c5d10-4350-463e-ba34-95a3e960f3a5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1722 microversion: 2.1 time: 0.184387 Aug 30 14:44:36.257425 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 123/248] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:36 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:36.484459 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-648ce261-5408-4bed-a201-a42f1ca62921 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:36.485893 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-648ce261-5408-4bed-a201-a42f1ca62921 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:36.494232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-648ce261-5408-4bed-a201-a42f1ca62921 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:36.494793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-648ce261-5408-4bed-a201-a42f1ca62921 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:36.495858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-648ce261-5408-4bed-a201-a42f1ca62921 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:36.496650 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-648ce261-5408-4bed-a201-a42f1ca62921 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:36.497315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-648ce261-5408-4bed-a201-a42f1ca62921 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:36.497819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-648ce261-5408-4bed-a201-a42f1ca62921 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:36.585000 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-21e30d01-fa1f-419c-b88d-9c279f311424 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:36.585699 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-21e30d01-fa1f-419c-b88d-9c279f311424 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:36.592389 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-21e30d01-fa1f-419c-b88d-9c279f311424 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:36.592963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-21e30d01-fa1f-419c-b88d-9c279f311424 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:36.593471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-21e30d01-fa1f-419c-b88d-9c279f311424 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:36.594248 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-21e30d01-fa1f-419c-b88d-9c279f311424 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:36.594771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-21e30d01-fa1f-419c-b88d-9c279f311424 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:36.595313 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-21e30d01-fa1f-419c-b88d-9c279f311424 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:36.657991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-648ce261-5408-4bed-a201-a42f1ca62921 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:36.670340 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-648ce261-5408-4bed-a201-a42f1ca62921 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.191460 Aug 30 14:44:36.675263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 126/249] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:36 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:36.773197 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-21e30d01-fa1f-419c-b88d-9c279f311424 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:36.784488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-21e30d01-fa1f-419c-b88d-9c279f311424 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:36.786393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-21e30d01-fa1f-419c-b88d-9c279f311424 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:36.787833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-21e30d01-fa1f-419c-b88d-9c279f311424 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.206986 Aug 30 14:44:36.788612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 124/250] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:36 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:37.281342 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cdf6385b-02dc-4c29-b56b-7e5ba6f2a00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:37.282037 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cdf6385b-02dc-4c29-b56b-7e5ba6f2a00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:37.287941 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cdf6385b-02dc-4c29-b56b-7e5ba6f2a00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:37.288476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cdf6385b-02dc-4c29-b56b-7e5ba6f2a00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:37.288970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cdf6385b-02dc-4c29-b56b-7e5ba6f2a00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:37.289985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cdf6385b-02dc-4c29-b56b-7e5ba6f2a00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:37.290791 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cdf6385b-02dc-4c29-b56b-7e5ba6f2a00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:37.291302 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cdf6385b-02dc-4c29-b56b-7e5ba6f2a00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:37.429905 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cdf6385b-02dc-4c29-b56b-7e5ba6f2a00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:37.438280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cdf6385b-02dc-4c29-b56b-7e5ba6f2a00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1722 microversion: 2.1 time: 0.160945 Aug 30 14:44:37.438858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 127/251] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:37 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:37.692097 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e7a1c394-5f32-47c4-bf2c-504d9ac4fbf6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:37.692716 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e7a1c394-5f32-47c4-bf2c-504d9ac4fbf6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:37.699613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e7a1c394-5f32-47c4-bf2c-504d9ac4fbf6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:37.700130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e7a1c394-5f32-47c4-bf2c-504d9ac4fbf6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:37.700681 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e7a1c394-5f32-47c4-bf2c-504d9ac4fbf6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:37.701384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e7a1c394-5f32-47c4-bf2c-504d9ac4fbf6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:37.701838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e7a1c394-5f32-47c4-bf2c-504d9ac4fbf6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:37.702263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e7a1c394-5f32-47c4-bf2c-504d9ac4fbf6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:37.812524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-01ac9c95-e7eb-4e87-83f1-fd24282c6629 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:37.813132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-01ac9c95-e7eb-4e87-83f1-fd24282c6629 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:37.820333 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01ac9c95-e7eb-4e87-83f1-fd24282c6629 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:37.820815 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01ac9c95-e7eb-4e87-83f1-fd24282c6629 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:37.821240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01ac9c95-e7eb-4e87-83f1-fd24282c6629 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:37.821930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01ac9c95-e7eb-4e87-83f1-fd24282c6629 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:37.822377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01ac9c95-e7eb-4e87-83f1-fd24282c6629 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:37.822794 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01ac9c95-e7eb-4e87-83f1-fd24282c6629 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:37.836766 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e7a1c394-5f32-47c4-bf2c-504d9ac4fbf6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:37.846847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e7a1c394-5f32-47c4-bf2c-504d9ac4fbf6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.158821 Aug 30 14:44:37.847611 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 125/252] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:37 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:37.963345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-01ac9c95-e7eb-4e87-83f1-fd24282c6629 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:37.972217 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-01ac9c95-e7eb-4e87-83f1-fd24282c6629 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:37.973750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-01ac9c95-e7eb-4e87-83f1-fd24282c6629 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:37.974909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-01ac9c95-e7eb-4e87-83f1-fd24282c6629 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.167534 Aug 30 14:44:37.975512 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 128/253] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:37 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:44:38.460456 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3d52b100-1e15-4bba-be27-85bcfaa91b7f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:38.461064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3d52b100-1e15-4bba-be27-85bcfaa91b7f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:38.467227 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d52b100-1e15-4bba-be27-85bcfaa91b7f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:38.467743 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d52b100-1e15-4bba-be27-85bcfaa91b7f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:38.468174 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d52b100-1e15-4bba-be27-85bcfaa91b7f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:38.468867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d52b100-1e15-4bba-be27-85bcfaa91b7f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:38.469316 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d52b100-1e15-4bba-be27-85bcfaa91b7f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:38.469731 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d52b100-1e15-4bba-be27-85bcfaa91b7f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:38.688424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3d52b100-1e15-4bba-be27-85bcfaa91b7f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:38.697591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3d52b100-1e15-4bba-be27-85bcfaa91b7f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1722 microversion: 2.1 time: 0.241022 Aug 30 14:44:38.698339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 126/254] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:38 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:38.868204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c74a7805-4306-4957-8243-e0fae1fb42ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:38.868819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c74a7805-4306-4957-8243-e0fae1fb42ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:38.876313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c74a7805-4306-4957-8243-e0fae1fb42ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:38.876993 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c74a7805-4306-4957-8243-e0fae1fb42ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:38.877436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c74a7805-4306-4957-8243-e0fae1fb42ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:38.878296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c74a7805-4306-4957-8243-e0fae1fb42ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:38.878729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c74a7805-4306-4957-8243-e0fae1fb42ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:38.879151 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c74a7805-4306-4957-8243-e0fae1fb42ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:38.999414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1ffb5b16-2f08-418f-9348-b95e8c8b4391 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:39.000316 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1ffb5b16-2f08-418f-9348-b95e8c8b4391 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:39.009883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ffb5b16-2f08-418f-9348-b95e8c8b4391 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:39.010842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ffb5b16-2f08-418f-9348-b95e8c8b4391 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:39.011608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ffb5b16-2f08-418f-9348-b95e8c8b4391 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:39.012545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ffb5b16-2f08-418f-9348-b95e8c8b4391 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:39.013264 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ffb5b16-2f08-418f-9348-b95e8c8b4391 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:39.013914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ffb5b16-2f08-418f-9348-b95e8c8b4391 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:39.027061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c74a7805-4306-4957-8243-e0fae1fb42ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:39.035599 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c74a7805-4306-4957-8243-e0fae1fb42ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.171259 Aug 30 14:44:39.036465 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 129/255] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:38 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:39.153296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1ffb5b16-2f08-418f-9348-b95e8c8b4391 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:39.161629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1ffb5b16-2f08-418f-9348-b95e8c8b4391 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:39.163068 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1ffb5b16-2f08-418f-9348-b95e8c8b4391 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:39.164274 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1ffb5b16-2f08-418f-9348-b95e8c8b4391 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.170265 Aug 30 14:44:39.164819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 127/256] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:38 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:44:39.723403 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a696fc68-daa2-40c8-9d61-6d9b5f56b5ec tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:39.724467 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a696fc68-daa2-40c8-9d61-6d9b5f56b5ec tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:39.731229 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a696fc68-daa2-40c8-9d61-6d9b5f56b5ec tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:39.731724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a696fc68-daa2-40c8-9d61-6d9b5f56b5ec tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:39.732158 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a696fc68-daa2-40c8-9d61-6d9b5f56b5ec tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:39.732847 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a696fc68-daa2-40c8-9d61-6d9b5f56b5ec tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:39.733298 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a696fc68-daa2-40c8-9d61-6d9b5f56b5ec tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:39.733719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a696fc68-daa2-40c8-9d61-6d9b5f56b5ec tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:40.057675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ebbf935a-4907-478b-847e-f7eefa4faff1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:40.058300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ebbf935a-4907-478b-847e-f7eefa4faff1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:40.064448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ebbf935a-4907-478b-847e-f7eefa4faff1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:40.064936 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ebbf935a-4907-478b-847e-f7eefa4faff1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:40.065373 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ebbf935a-4907-478b-847e-f7eefa4faff1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:40.066328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ebbf935a-4907-478b-847e-f7eefa4faff1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:40.066781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ebbf935a-4907-478b-847e-f7eefa4faff1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:40.067236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ebbf935a-4907-478b-847e-f7eefa4faff1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:40.129661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a696fc68-daa2-40c8-9d61-6d9b5f56b5ec tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:40.147705 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a696fc68-daa2-40c8-9d61-6d9b5f56b5ec tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1722 microversion: 2.1 time: 0.421489 Aug 30 14:44:40.147705 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 130/257] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:39 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1722 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:40.186290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e29e352b-32ab-4d04-8fcf-fa84c9d257a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:40.187015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e29e352b-32ab-4d04-8fcf-fa84c9d257a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:40.195977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e29e352b-32ab-4d04-8fcf-fa84c9d257a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:40.198265 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e29e352b-32ab-4d04-8fcf-fa84c9d257a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:40.198981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e29e352b-32ab-4d04-8fcf-fa84c9d257a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:40.200916 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e29e352b-32ab-4d04-8fcf-fa84c9d257a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:40.201848 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e29e352b-32ab-4d04-8fcf-fa84c9d257a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:40.203438 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e29e352b-32ab-4d04-8fcf-fa84c9d257a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:40.256850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:40.277330 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ebbf935a-4907-478b-847e-f7eefa4faff1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:40.287922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ebbf935a-4907-478b-847e-f7eefa4faff1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.233960 Aug 30 14:44:40.290141 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 128/258] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:40 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:40.422668 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e29e352b-32ab-4d04-8fcf-fa84c9d257a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:40.430947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e29e352b-32ab-4d04-8fcf-fa84c9d257a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:40.432998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e29e352b-32ab-4d04-8fcf-fa84c9d257a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:40.434393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e29e352b-32ab-4d04-8fcf-fa84c9d257a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1721 microversion: 2.20 time: 0.252416 Aug 30 14:44:40.435071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 131/259] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:40 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:41.163613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-95fd5196-be10-4b20-9109-552d68452233 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:41.164220 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-95fd5196-be10-4b20-9109-552d68452233 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:41.170559 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95fd5196-be10-4b20-9109-552d68452233 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:41.171038 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95fd5196-be10-4b20-9109-552d68452233 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:41.171510 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95fd5196-be10-4b20-9109-552d68452233 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:41.172199 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95fd5196-be10-4b20-9109-552d68452233 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:41.172648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95fd5196-be10-4b20-9109-552d68452233 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:41.173067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95fd5196-be10-4b20-9109-552d68452233 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:41.314953 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9a534fc5-93b5-4dda-888b-5277b8f3dab7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:41.316415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9a534fc5-93b5-4dda-888b-5277b8f3dab7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:41.324791 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a534fc5-93b5-4dda-888b-5277b8f3dab7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:41.325459 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a534fc5-93b5-4dda-888b-5277b8f3dab7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:41.326083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a534fc5-93b5-4dda-888b-5277b8f3dab7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:41.326923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a534fc5-93b5-4dda-888b-5277b8f3dab7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:41.327411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a534fc5-93b5-4dda-888b-5277b8f3dab7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:41.327960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a534fc5-93b5-4dda-888b-5277b8f3dab7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:41.473420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-95fd5196-be10-4b20-9109-552d68452233 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:41.478549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-95fd5196-be10-4b20-9109-552d68452233 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1722 microversion: 2.1 time: 0.318828 Aug 30 14:44:41.479813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 129/260] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:41 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:41.484836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6f01827a-470c-465d-a2cf-f34bea397cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:41.485527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6f01827a-470c-465d-a2cf-f34bea397cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:41.491897 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f01827a-470c-465d-a2cf-f34bea397cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:41.492567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f01827a-470c-465d-a2cf-f34bea397cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:41.493345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f01827a-470c-465d-a2cf-f34bea397cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:41.493834 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f01827a-470c-465d-a2cf-f34bea397cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:41.494352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f01827a-470c-465d-a2cf-f34bea397cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:41.495338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f01827a-470c-465d-a2cf-f34bea397cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:41.505449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9a534fc5-93b5-4dda-888b-5277b8f3dab7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:41.514636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9a534fc5-93b5-4dda-888b-5277b8f3dab7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.203519 Aug 30 14:44:41.515354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 132/261] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:41 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:41.587466 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-632206113", "imageRef": "fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b", "flavorRef": "452"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:41.636340 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6f01827a-470c-465d-a2cf-f34bea397cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:41.641235 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] validate_networks() for None {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:44:41.644706 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6f01827a-470c-465d-a2cf-f34bea397cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:41.647838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6f01827a-470c-465d-a2cf-f34bea397cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:41.649092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6f01827a-470c-465d-a2cf-f34bea397cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1742 microversion: 2.20 time: 0.168127 Aug 30 14:44:41.649653 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 130/262] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:41 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1742 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:41.922595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:44:41.923032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:44:41.923525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:44:41.923923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:44:41.924345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:44:41.938271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:41.938831 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:41.939560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:41.940411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:41.941220 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:41.941719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:41.962711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Getting quotas for project fe47f61a4dbf4e669ff257d299e92ee4. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:44:41.967130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Getting quotas for user 08b4f8865dd14290ab714039a2e424fb and project fe47f61a4dbf4e669ff257d299e92ee4. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:44:41.978783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:44:41.981989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:44:42.036562 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4bd4613c-0d1c-4305-8be9-1a64d5ae712f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.453042 Aug 30 14:44:42.037413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 133/263] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 14:44:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 14:44:42.048672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-dc02aa0a-cf69-47b4-968f-c81b3b917376 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:42.049773 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-dc02aa0a-cf69-47b4-968f-c81b3b917376 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:42.143074 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-dc02aa0a-cf69-47b4-968f-c81b3b917376 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:42.143074 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-dc02aa0a-cf69-47b4-968f-c81b3b917376 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1214 microversion: 2.1 time: 0.096038 Aug 30 14:44:42.143074 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 131/264] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:42 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:42.505606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-81105708-c8f4-4090-b30c-c008c44f4cc7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:42.506228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-81105708-c8f4-4090-b30c-c008c44f4cc7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:42.513586 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81105708-c8f4-4090-b30c-c008c44f4cc7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:42.514073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81105708-c8f4-4090-b30c-c008c44f4cc7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:42.514680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81105708-c8f4-4090-b30c-c008c44f4cc7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:42.515416 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81105708-c8f4-4090-b30c-c008c44f4cc7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:42.515873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81105708-c8f4-4090-b30c-c008c44f4cc7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:42.516303 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81105708-c8f4-4090-b30c-c008c44f4cc7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:42.535153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-db646bee-d74e-4365-98dc-0835c7fb0328 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:42.535800 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-db646bee-d74e-4365-98dc-0835c7fb0328 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:42.544162 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db646bee-d74e-4365-98dc-0835c7fb0328 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:42.545049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db646bee-d74e-4365-98dc-0835c7fb0328 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:42.545573 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db646bee-d74e-4365-98dc-0835c7fb0328 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:42.546485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db646bee-d74e-4365-98dc-0835c7fb0328 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:42.547092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db646bee-d74e-4365-98dc-0835c7fb0328 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:42.547687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db646bee-d74e-4365-98dc-0835c7fb0328 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:42.690629 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-81105708-c8f4-4090-b30c-c008c44f4cc7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:42.700196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-81105708-c8f4-4090-b30c-c008c44f4cc7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1722 microversion: 2.1 time: 0.199317 Aug 30 14:44:42.700724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 134/265] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:42 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:42.705604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d1f429e2-4091-48da-8543-b89e52f86563 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:42.706414 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d1f429e2-4091-48da-8543-b89e52f86563 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:42.712441 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1f429e2-4091-48da-8543-b89e52f86563 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:42.713127 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1f429e2-4091-48da-8543-b89e52f86563 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:42.714933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1f429e2-4091-48da-8543-b89e52f86563 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:42.715881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1f429e2-4091-48da-8543-b89e52f86563 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:42.716335 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1f429e2-4091-48da-8543-b89e52f86563 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:42.716771 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1f429e2-4091-48da-8543-b89e52f86563 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:42.727164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-db646bee-d74e-4365-98dc-0835c7fb0328 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:42.735906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-db646bee-d74e-4365-98dc-0835c7fb0328 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.204622 Aug 30 14:44:42.736991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 132/266] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:42 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:42.862782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d1f429e2-4091-48da-8543-b89e52f86563 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:42.872547 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d1f429e2-4091-48da-8543-b89e52f86563 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:42.874244 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d1f429e2-4091-48da-8543-b89e52f86563 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:42.875545 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d1f429e2-4091-48da-8543-b89e52f86563 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1742 microversion: 2.20 time: 0.173515 Aug 30 14:44:42.876088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 135/267] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:42 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1742 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:43.161017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-676a3c1b-f087-4009-91bf-f0895473e0ca tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:43.161630 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-676a3c1b-f087-4009-91bf-f0895473e0ca tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:43.168661 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-676a3c1b-f087-4009-91bf-f0895473e0ca tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.168661 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-676a3c1b-f087-4009-91bf-f0895473e0ca tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.168838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-676a3c1b-f087-4009-91bf-f0895473e0ca tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.169514 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-676a3c1b-f087-4009-91bf-f0895473e0ca tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.169967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-676a3c1b-f087-4009-91bf-f0895473e0ca tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.170390 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-676a3c1b-f087-4009-91bf-f0895473e0ca tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.238114 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-676a3c1b-f087-4009-91bf-f0895473e0ca tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:43.246721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-676a3c1b-f087-4009-91bf-f0895473e0ca tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1266 microversion: 2.1 time: 0.089448 Aug 30 14:44:43.247303 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 133/268] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:43 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:43.722422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5eab35bd-375f-4798-b608-fc4848162c3e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:43.723255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5eab35bd-375f-4798-b608-fc4848162c3e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:43.730595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5eab35bd-375f-4798-b608-fc4848162c3e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.731076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5eab35bd-375f-4798-b608-fc4848162c3e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.731730 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5eab35bd-375f-4798-b608-fc4848162c3e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.732506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5eab35bd-375f-4798-b608-fc4848162c3e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.733179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5eab35bd-375f-4798-b608-fc4848162c3e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.733785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5eab35bd-375f-4798-b608-fc4848162c3e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.756935 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0741efa8-17e0-4889-8d00-56a069d6bbe6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:43.757519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0741efa8-17e0-4889-8d00-56a069d6bbe6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:43.768085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0741efa8-17e0-4889-8d00-56a069d6bbe6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.768742 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0741efa8-17e0-4889-8d00-56a069d6bbe6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.769198 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0741efa8-17e0-4889-8d00-56a069d6bbe6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.769896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0741efa8-17e0-4889-8d00-56a069d6bbe6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.770341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0741efa8-17e0-4889-8d00-56a069d6bbe6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.770754 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0741efa8-17e0-4889-8d00-56a069d6bbe6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.909865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0741efa8-17e0-4889-8d00-56a069d6bbe6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:43.919456 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0741efa8-17e0-4889-8d00-56a069d6bbe6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.166486 Aug 30 14:44:43.920149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 134/269] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:43 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:43.924918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f2dfaf92-5ecd-4604-8f46-07eb81c7e6fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:43.925587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f2dfaf92-5ecd-4604-8f46-07eb81c7e6fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:43.931542 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2dfaf92-5ecd-4604-8f46-07eb81c7e6fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.932031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2dfaf92-5ecd-4604-8f46-07eb81c7e6fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.932488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2dfaf92-5ecd-4604-8f46-07eb81c7e6fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.933271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2dfaf92-5ecd-4604-8f46-07eb81c7e6fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:43.933730 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2dfaf92-5ecd-4604-8f46-07eb81c7e6fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:43.934162 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2dfaf92-5ecd-4604-8f46-07eb81c7e6fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:43.960746 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5eab35bd-375f-4798-b608-fc4848162c3e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:43.974021 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5eab35bd-375f-4798-b608-fc4848162c3e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1722 microversion: 2.1 time: 0.255585 Aug 30 14:44:43.984142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 136/270] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:43 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:44.085396 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f2dfaf92-5ecd-4604-8f46-07eb81c7e6fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:44.086273 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-bc13727a-5b50-41d0-917c-e278dab3dc2c req-b8fdbf4f-2d0f-4f89-bfd8-4e546a9fbeaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df823286-f7fd-4dbf-acb5-7cd297f48da0", "name": "network-vif-plugged", "status": "completed", "tag": "356c248c-dbd2-4ea8-93cc-dd834560932d"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:44.096484 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f2dfaf92-5ecd-4604-8f46-07eb81c7e6fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:44.098694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f2dfaf92-5ecd-4604-8f46-07eb81c7e6fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:44.100124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f2dfaf92-5ecd-4604-8f46-07eb81c7e6fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1742 microversion: 2.20 time: 0.178777 Aug 30 14:44:44.100832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 135/271] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:43 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:44.105894 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bc13727a-5b50-41d0-917c-e278dab3dc2c req-b8fdbf4f-2d0f-4f89-bfd8-4e546a9fbeaa service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:44.107778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bc13727a-5b50-41d0-917c-e278dab3dc2c req-b8fdbf4f-2d0f-4f89-bfd8-4e546a9fbeaa service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:44.108367 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bc13727a-5b50-41d0-917c-e278dab3dc2c req-b8fdbf4f-2d0f-4f89-bfd8-4e546a9fbeaa service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:44.133552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-bc13727a-5b50-41d0-917c-e278dab3dc2c req-b8fdbf4f-2d0f-4f89-bfd8-4e546a9fbeaa service nova] Creating event network-vif-plugged:356c248c-dbd2-4ea8-93cc-dd834560932d for instance df823286-f7fd-4dbf-acb5-7cd297f48da0 on hv-cinder-82880 Aug 30 14:44:44.140190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-bc13727a-5b50-41d0-917c-e278dab3dc2c req-b8fdbf4f-2d0f-4f89-bfd8-4e546a9fbeaa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057571 Aug 30 14:44:44.140808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 137/272] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:44.267670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-74fb33c7-c3a5-4e23-9ad6-d84d1add0102 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:44.268328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-74fb33c7-c3a5-4e23-9ad6-d84d1add0102 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:44.274190 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-74fb33c7-c3a5-4e23-9ad6-d84d1add0102 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:44.274664 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-74fb33c7-c3a5-4e23-9ad6-d84d1add0102 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:44.275087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-74fb33c7-c3a5-4e23-9ad6-d84d1add0102 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:44.275799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-74fb33c7-c3a5-4e23-9ad6-d84d1add0102 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:44.277390 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-74fb33c7-c3a5-4e23-9ad6-d84d1add0102 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:44.277818 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-74fb33c7-c3a5-4e23-9ad6-d84d1add0102 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:44.346277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-74fb33c7-c3a5-4e23-9ad6-d84d1add0102 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:44.355957 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-74fb33c7-c3a5-4e23-9ad6-d84d1add0102 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1272 microversion: 2.1 time: 0.092353 Aug 30 14:44:44.357059 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 136/273] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:44 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:44.941234 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e552fcbd-390d-4208-877d-4315b937c2d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:44.942566 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e552fcbd-390d-4208-877d-4315b937c2d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:44.952387 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e552fcbd-390d-4208-877d-4315b937c2d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:44.953334 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e552fcbd-390d-4208-877d-4315b937c2d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:44.954065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e552fcbd-390d-4208-877d-4315b937c2d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:44.955094 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e552fcbd-390d-4208-877d-4315b937c2d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:44.955686 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e552fcbd-390d-4208-877d-4315b937c2d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:44.956237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e552fcbd-390d-4208-877d-4315b937c2d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:44.998168 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4085fa0c-7d12-4f13-adbd-63a514eb577f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:44.998777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4085fa0c-7d12-4f13-adbd-63a514eb577f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:45.009021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4085fa0c-7d12-4f13-adbd-63a514eb577f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:45.010026 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4085fa0c-7d12-4f13-adbd-63a514eb577f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:45.011137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4085fa0c-7d12-4f13-adbd-63a514eb577f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:45.011963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4085fa0c-7d12-4f13-adbd-63a514eb577f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:45.012415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4085fa0c-7d12-4f13-adbd-63a514eb577f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:45.013022 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4085fa0c-7d12-4f13-adbd-63a514eb577f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:45.036124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:45.232613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4085fa0c-7d12-4f13-adbd-63a514eb577f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:45.242903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4085fa0c-7d12-4f13-adbd-63a514eb577f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1722 microversion: 2.1 time: 0.249304 Aug 30 14:44:45.244592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 137/274] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:44 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:45.267466 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f5f52a7a-8bdb-4358-a402-a9b4c785511a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:45.268646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f5f52a7a-8bdb-4358-a402-a9b4c785511a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:45.276529 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5f52a7a-8bdb-4358-a402-a9b4c785511a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:45.277900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5f52a7a-8bdb-4358-a402-a9b4c785511a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:45.278856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5f52a7a-8bdb-4358-a402-a9b4c785511a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:45.280125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5f52a7a-8bdb-4358-a402-a9b4c785511a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:45.281031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5f52a7a-8bdb-4358-a402-a9b4c785511a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:45.281906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5f52a7a-8bdb-4358-a402-a9b4c785511a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:45.343024 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e552fcbd-390d-4208-877d-4315b937c2d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:45.360245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e552fcbd-390d-4208-877d-4315b937c2d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.422961 Aug 30 14:44:45.361402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 138/275] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:44 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:45.378826 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d173d5fa-8651-41ce-98a5-477a414def73 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:45.379732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d173d5fa-8651-41ce-98a5-477a414def73 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:45.387025 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d173d5fa-8651-41ce-98a5-477a414def73 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:45.387762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d173d5fa-8651-41ce-98a5-477a414def73 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:45.388404 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d173d5fa-8651-41ce-98a5-477a414def73 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:45.389298 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d173d5fa-8651-41ce-98a5-477a414def73 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:45.389856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d173d5fa-8651-41ce-98a5-477a414def73 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:45.390581 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d173d5fa-8651-41ce-98a5-477a414def73 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:45.456025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f5f52a7a-8bdb-4358-a402-a9b4c785511a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:45.466830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f5f52a7a-8bdb-4358-a402-a9b4c785511a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:45.468612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f5f52a7a-8bdb-4358-a402-a9b4c785511a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:45.470655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f5f52a7a-8bdb-4358-a402-a9b4c785511a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1737 microversion: 2.20 time: 0.224497 Aug 30 14:44:45.474112 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 138/276] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:45 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:45.479246 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-835a5cb7-94d8-4bdd-9d84-e2b7df7925a1 req-89d6b409-12ba-4ffe-88df-cbc05eff1248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6067cd2e-5a5e-462f-b00e-c3cf228513f2", "tag": "baeefbfc-782a-437d-a485-b61f631579a3"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:45.490792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-835a5cb7-94d8-4bdd-9d84-e2b7df7925a1 req-89d6b409-12ba-4ffe-88df-cbc05eff1248 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:45.491672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-835a5cb7-94d8-4bdd-9d84-e2b7df7925a1 req-89d6b409-12ba-4ffe-88df-cbc05eff1248 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:45.492431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-835a5cb7-94d8-4bdd-9d84-e2b7df7925a1 req-89d6b409-12ba-4ffe-88df-cbc05eff1248 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:45.513882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-835a5cb7-94d8-4bdd-9d84-e2b7df7925a1 req-89d6b409-12ba-4ffe-88df-cbc05eff1248 service nova] Creating event network-changed:baeefbfc-782a-437d-a485-b61f631579a3 for instance 6067cd2e-5a5e-462f-b00e-c3cf228513f2 on hv-cinder-82880 Aug 30 14:44:45.519303 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-835a5cb7-94d8-4bdd-9d84-e2b7df7925a1 req-89d6b409-12ba-4ffe-88df-cbc05eff1248 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043658 Aug 30 14:44:45.520061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 139/277] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:45.586530 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d173d5fa-8651-41ce-98a5-477a414def73 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:45.595957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d173d5fa-8651-41ce-98a5-477a414def73 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1314 microversion: 2.1 time: 0.222059 Aug 30 14:44:45.596757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 139/278] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:45 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:46.268674 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0a8bf69e-f8aa-4d2f-984b-18589f0057df tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:46.269451 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0a8bf69e-f8aa-4d2f-984b-18589f0057df tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:46.277939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a8bf69e-f8aa-4d2f-984b-18589f0057df tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:46.278439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a8bf69e-f8aa-4d2f-984b-18589f0057df tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:46.278880 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a8bf69e-f8aa-4d2f-984b-18589f0057df tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:46.279671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a8bf69e-f8aa-4d2f-984b-18589f0057df tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:46.280262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a8bf69e-f8aa-4d2f-984b-18589f0057df tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:46.280879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a8bf69e-f8aa-4d2f-984b-18589f0057df tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:46.382407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0f3c57c6-a30a-445c-8d5f-5c273819decf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:46.383106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0f3c57c6-a30a-445c-8d5f-5c273819decf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:46.390655 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f3c57c6-a30a-445c-8d5f-5c273819decf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:46.391514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f3c57c6-a30a-445c-8d5f-5c273819decf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:46.392323 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f3c57c6-a30a-445c-8d5f-5c273819decf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:46.393750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f3c57c6-a30a-445c-8d5f-5c273819decf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:46.394423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f3c57c6-a30a-445c-8d5f-5c273819decf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:46.395581 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f3c57c6-a30a-445c-8d5f-5c273819decf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:46.561259 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0a8bf69e-f8aa-4d2f-984b-18589f0057df tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:46.580171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0a8bf69e-f8aa-4d2f-984b-18589f0057df tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1722 microversion: 2.1 time: 0.316923 Aug 30 14:44:46.581125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 140/279] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:46 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:46.600398 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ae4d8756-c047-43c1-93fa-ce3892fe78f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:46.601781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ae4d8756-c047-43c1-93fa-ce3892fe78f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:46.614341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae4d8756-c047-43c1-93fa-ce3892fe78f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:46.621012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae4d8756-c047-43c1-93fa-ce3892fe78f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:46.621901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae4d8756-c047-43c1-93fa-ce3892fe78f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:46.622831 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae4d8756-c047-43c1-93fa-ce3892fe78f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:46.623509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae4d8756-c047-43c1-93fa-ce3892fe78f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:46.624131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae4d8756-c047-43c1-93fa-ce3892fe78f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:46.850337 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ae4d8756-c047-43c1-93fa-ce3892fe78f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:46.854681 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0f3c57c6-a30a-445c-8d5f-5c273819decf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:46.871568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0f3c57c6-a30a-445c-8d5f-5c273819decf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.491459 Aug 30 14:44:46.874639 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ae4d8756-c047-43c1-93fa-ce3892fe78f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:46.875714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 140/280] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:46 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:46.878514 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ae4d8756-c047-43c1-93fa-ce3892fe78f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:46.882331 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ae4d8756-c047-43c1-93fa-ce3892fe78f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1737 microversion: 2.20 time: 0.297916 Aug 30 14:44:46.884671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 141/281] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:46 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1737 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:46.892412 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3e02850d-d266-4c31-b89b-783cead3fb35 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:46.893522 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3e02850d-d266-4c31-b89b-783cead3fb35 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:46.904403 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e02850d-d266-4c31-b89b-783cead3fb35 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:46.904881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e02850d-d266-4c31-b89b-783cead3fb35 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:46.905474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e02850d-d266-4c31-b89b-783cead3fb35 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:46.906694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e02850d-d266-4c31-b89b-783cead3fb35 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:46.907146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e02850d-d266-4c31-b89b-783cead3fb35 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:46.907682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e02850d-d266-4c31-b89b-783cead3fb35 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:47.085945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3e02850d-d266-4c31-b89b-783cead3fb35 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:47.094913 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3e02850d-d266-4c31-b89b-783cead3fb35 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1314 microversion: 2.1 time: 0.218149 Aug 30 14:44:47.095694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 141/282] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:46 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:47.602411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-820bed00-c0f5-45f5-a9f4-471e271aaa91 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:47.603912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-820bed00-c0f5-45f5-a9f4-471e271aaa91 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:47.614615 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-820bed00-c0f5-45f5-a9f4-471e271aaa91 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:47.615244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-820bed00-c0f5-45f5-a9f4-471e271aaa91 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:47.615746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-820bed00-c0f5-45f5-a9f4-471e271aaa91 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:47.621433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-820bed00-c0f5-45f5-a9f4-471e271aaa91 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:47.621972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-820bed00-c0f5-45f5-a9f4-471e271aaa91 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:47.623244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-820bed00-c0f5-45f5-a9f4-471e271aaa91 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:47.821345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-820bed00-c0f5-45f5-a9f4-471e271aaa91 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:47.831074 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-820bed00-c0f5-45f5-a9f4-471e271aaa91 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1722 microversion: 2.1 time: 0.233331 Aug 30 14:44:47.832500 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 142/283] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:47 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:47.920941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0f1b10fa-b48f-4952-963a-f5df1b19b341 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:47.921466 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ce9286a4-cbe5-43cf-b838-b803c62b3695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:47.923738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ce9286a4-cbe5-43cf-b838-b803c62b3695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:47.924593 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0f1b10fa-b48f-4952-963a-f5df1b19b341 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:47.942364 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f1b10fa-b48f-4952-963a-f5df1b19b341 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:47.944489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f1b10fa-b48f-4952-963a-f5df1b19b341 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:47.945167 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f1b10fa-b48f-4952-963a-f5df1b19b341 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:47.946007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce9286a4-cbe5-43cf-b838-b803c62b3695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:47.947330 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f1b10fa-b48f-4952-963a-f5df1b19b341 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:47.952490 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce9286a4-cbe5-43cf-b838-b803c62b3695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:47.953265 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f1b10fa-b48f-4952-963a-f5df1b19b341 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:47.954248 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce9286a4-cbe5-43cf-b838-b803c62b3695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:47.956109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f1b10fa-b48f-4952-963a-f5df1b19b341 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:47.957405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce9286a4-cbe5-43cf-b838-b803c62b3695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:47.958727 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce9286a4-cbe5-43cf-b838-b803c62b3695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:47.961075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce9286a4-cbe5-43cf-b838-b803c62b3695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:48.221781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0f1b10fa-b48f-4952-963a-f5df1b19b341 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:48.229910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ce9286a4-cbe5-43cf-b838-b803c62b3695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:48.233353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0f1b10fa-b48f-4952-963a-f5df1b19b341 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:48.235531 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0f1b10fa-b48f-4952-963a-f5df1b19b341 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:48.237380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0f1b10fa-b48f-4952-963a-f5df1b19b341 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1737 microversion: 2.20 time: 0.328789 Aug 30 14:44:48.238234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 143/284] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:47 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1737 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:48.248440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ce9286a4-cbe5-43cf-b838-b803c62b3695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.338374 Aug 30 14:44:48.249863 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 142/285] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:47 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:48.256702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8ba019e2-74b3-41c8-bbef-b8a572ed8df4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:48.258448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8ba019e2-74b3-41c8-bbef-b8a572ed8df4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:48.274347 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ba019e2-74b3-41c8-bbef-b8a572ed8df4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:48.274830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ba019e2-74b3-41c8-bbef-b8a572ed8df4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:48.275294 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ba019e2-74b3-41c8-bbef-b8a572ed8df4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:48.276114 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ba019e2-74b3-41c8-bbef-b8a572ed8df4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:48.279779 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ba019e2-74b3-41c8-bbef-b8a572ed8df4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:48.280301 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ba019e2-74b3-41c8-bbef-b8a572ed8df4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:48.444648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8ba019e2-74b3-41c8-bbef-b8a572ed8df4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:48.458313 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8ba019e2-74b3-41c8-bbef-b8a572ed8df4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1314 microversion: 2.1 time: 0.219159 Aug 30 14:44:48.459358 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 144/286] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:48 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:48.855515 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a25f9e73-08b3-4ac1-96b3-2ef008247eb2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:48.856186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a25f9e73-08b3-4ac1-96b3-2ef008247eb2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:48.874143 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a25f9e73-08b3-4ac1-96b3-2ef008247eb2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:48.880711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a25f9e73-08b3-4ac1-96b3-2ef008247eb2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:48.883186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a25f9e73-08b3-4ac1-96b3-2ef008247eb2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:48.888570 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a25f9e73-08b3-4ac1-96b3-2ef008247eb2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:48.895256 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a25f9e73-08b3-4ac1-96b3-2ef008247eb2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:48.896892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a25f9e73-08b3-4ac1-96b3-2ef008247eb2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.172196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a25f9e73-08b3-4ac1-96b3-2ef008247eb2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:49.194178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a25f9e73-08b3-4ac1-96b3-2ef008247eb2 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1722 microversion: 2.1 time: 0.344143 Aug 30 14:44:49.207242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 143/287] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:48 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1722 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:49.276256 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cc910902-7513-4b8d-811a-ebf43a237a28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:49.277487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-45bf3d68-54b8-4605-9416-c7eec43b4e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:49.278385 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-45bf3d68-54b8-4605-9416-c7eec43b4e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:49.280768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cc910902-7513-4b8d-811a-ebf43a237a28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:49.286352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45bf3d68-54b8-4605-9416-c7eec43b4e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.287141 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45bf3d68-54b8-4605-9416-c7eec43b4e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.287858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45bf3d68-54b8-4605-9416-c7eec43b4e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.288822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45bf3d68-54b8-4605-9416-c7eec43b4e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.289626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc910902-7513-4b8d-811a-ebf43a237a28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.289746 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45bf3d68-54b8-4605-9416-c7eec43b4e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.290164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc910902-7513-4b8d-811a-ebf43a237a28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.290598 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc910902-7513-4b8d-811a-ebf43a237a28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.290862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45bf3d68-54b8-4605-9416-c7eec43b4e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.291624 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc910902-7513-4b8d-811a-ebf43a237a28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.292108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc910902-7513-4b8d-811a-ebf43a237a28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.292634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc910902-7513-4b8d-811a-ebf43a237a28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.491321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cc910902-7513-4b8d-811a-ebf43a237a28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:49.497482 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45bf3d68-54b8-4605-9416-c7eec43b4e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:49.507772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cc910902-7513-4b8d-811a-ebf43a237a28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:49.509364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-45bf3d68-54b8-4605-9416-c7eec43b4e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1502 microversion: 2.1 time: 0.237338 Aug 30 14:44:49.509947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 144/288] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:49 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1502 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:49.510773 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cc910902-7513-4b8d-811a-ebf43a237a28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:49.512350 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cc910902-7513-4b8d-811a-ebf43a237a28 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1737 microversion: 2.20 time: 0.242409 Aug 30 14:44:49.527571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-29958008-2fbd-4ae6-88e5-296258bdaa1f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:49.528437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-29958008-2fbd-4ae6-88e5-296258bdaa1f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:49.529485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 145/289] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:49 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1737 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:49.535598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29958008-2fbd-4ae6-88e5-296258bdaa1f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.536397 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29958008-2fbd-4ae6-88e5-296258bdaa1f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.537101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29958008-2fbd-4ae6-88e5-296258bdaa1f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.538104 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29958008-2fbd-4ae6-88e5-296258bdaa1f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.538735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29958008-2fbd-4ae6-88e5-296258bdaa1f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.539357 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29958008-2fbd-4ae6-88e5-296258bdaa1f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.541245 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-95fd370a-b8e0-4fd3-af4f-2c72bf9c0c71 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91ebad0d-ec97-42d1-823d-eb3ed261f649"}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:49.548823 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-95fd370a-b8e0-4fd3-af4f-2c72bf9c0c71 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:49.561937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95fd370a-b8e0-4fd3-af4f-2c72bf9c0c71 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.562527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95fd370a-b8e0-4fd3-af4f-2c72bf9c0c71 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.563107 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95fd370a-b8e0-4fd3-af4f-2c72bf9c0c71 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.563936 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95fd370a-b8e0-4fd3-af4f-2c72bf9c0c71 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.565303 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95fd370a-b8e0-4fd3-af4f-2c72bf9c0c71 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.565303 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95fd370a-b8e0-4fd3-af4f-2c72bf9c0c71 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.595719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-95fd370a-b8e0-4fd3-af4f-2c72bf9c0c71 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] HTTP exception thrown: Cannot 'attach_volume' instance d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 while it is in vm_state rescued Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-95fd370a-b8e0-4fd3-af4f-2c72bf9c0c71 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Request method failure captured: Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: POST /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6/os-volume_attachments HTTP/1.1 Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 74 Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHV8l34OZZHwNsM6lH1lEq9yVrUpRfBmeZovqeGZdHzP-i2fdi3fDhAn1Yn4OqxAY-c8j3adWS2dsfjLxxuH2lkmuX086z2M_u_ap-gLP6YJy1Q6J4kjuRWRTjpojkyG-eVDtFa0STcuNEHUUsJRYwLv6xBXQ1t71A68FFQivqPRdQ Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: 65bab38256b44ad6b4b573a2441eb6d3 Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-420783002 Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 14:44:49.597424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 14:44:49.598749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65bab38256b44ad6b4b573a2441eb6d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_65bab38256b44ad6b4b573a2441eb6d3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65bab38256b44ad6b4b573a2441eb6d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/65bab38256b44ad6b4b573a2441eb6d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:44:49.598749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-ServerRescueNegativeTestJSON-420783002 Aug 30 14:44:49.598749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: 65bab38256b44ad6b4b573a2441eb6d3 Aug 30 14:44:49.598749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-420783002 Aug 30 14:44:49.598749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-ServerRescueNegativeTestJSON-420783002-project Aug 30 14:44:49.598749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 14:44:49.598749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 14:44:49.598749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: 35f28006916040c3b988de6c15093166 Aug 30 14:44:49.598749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-ServerRescueNegativeTestJSON-420783002-project Aug 30 14:44:49.598749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Aug 30 14:44:49.598749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {"volumeAttachment": {"volumeId": "91ebad0d-ec97-42d1-823d-eb3ed261f649"}} Aug 30 14:44:49.598749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Cannot 'attach_volume' instance d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 while it is in vm_state rescued Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'server_id': 'd9a82dfc-22d1-4a29-8457-b2ddb14fa0e6', 'body': {'volumeAttachment': {'volumeId': '91ebad0d-ec97-42d1-823d-eb3ed261f649'}}} Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:44:49.599561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 while it is in vm_state rescued Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:44:49.600945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:44:49.602230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:44:49.602230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 while it is in vm_state rescued Aug 30 14:44:49.602230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:44:49.602230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-95fd370a-b8e0-4fd3-af4f-2c72bf9c0c71 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Returning 409 to user: Cannot 'attach_volume' instance d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 while it is in vm_state rescued {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:44:49.602230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-95fd370a-b8e0-4fd3-af4f-2c72bf9c0c71 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "POST /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.068235 Aug 30 14:44:49.603460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 146/290] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 14:44:49 2022] POST /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6/os-volume_attachments => generated 152 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 14:44:49.608863 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ab6fc875-bb0b-4be3-8f09-f6b90712c934 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:49.609390 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ab6fc875-bb0b-4be3-8f09-f6b90712c934 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:49.618046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ab6fc875-bb0b-4be3-8f09-f6b90712c934 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.618536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ab6fc875-bb0b-4be3-8f09-f6b90712c934 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.618973 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ab6fc875-bb0b-4be3-8f09-f6b90712c934 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.619793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ab6fc875-bb0b-4be3-8f09-f6b90712c934 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.620249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ab6fc875-bb0b-4be3-8f09-f6b90712c934 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.620700 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ab6fc875-bb0b-4be3-8f09-f6b90712c934 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.709175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ab6fc875-bb0b-4be3-8f09-f6b90712c934 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "POST /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6/action" status: 202 len: 0 microversion: 2.1 time: 0.103960 Aug 30 14:44:49.710266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 147/291] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 14:44:49 2022] POST /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:44:49.717547 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-29958008-2fbd-4ae6-88e5-296258bdaa1f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:49.721013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4307c6be-0719-41d2-9b30-cb40b49502cc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:49.721869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4307c6be-0719-41d2-9b30-cb40b49502cc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:49.728286 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4307c6be-0719-41d2-9b30-cb40b49502cc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.728771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4307c6be-0719-41d2-9b30-cb40b49502cc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.729825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4307c6be-0719-41d2-9b30-cb40b49502cc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.730558 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4307c6be-0719-41d2-9b30-cb40b49502cc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:49.730957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-29958008-2fbd-4ae6-88e5-296258bdaa1f tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1314 microversion: 2.1 time: 0.215041 Aug 30 14:44:49.731087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4307c6be-0719-41d2-9b30-cb40b49502cc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:49.731440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4307c6be-0719-41d2-9b30-cb40b49502cc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:49.733714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 145/292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:49 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:49.904035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4307c6be-0719-41d2-9b30-cb40b49502cc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:49.912295 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4307c6be-0719-41d2-9b30-cb40b49502cc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1510 microversion: 2.1 time: 0.196377 Aug 30 14:44:49.913206 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 148/293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:49 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:50.217475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1448fe9a-f02d-4a37-9159-27271b77c47d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:50.218648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1448fe9a-f02d-4a37-9159-27271b77c47d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:50.228412 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1448fe9a-f02d-4a37-9159-27271b77c47d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.229340 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1448fe9a-f02d-4a37-9159-27271b77c47d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.230026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1448fe9a-f02d-4a37-9159-27271b77c47d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.230738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1448fe9a-f02d-4a37-9159-27271b77c47d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.231829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1448fe9a-f02d-4a37-9159-27271b77c47d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.232270 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1448fe9a-f02d-4a37-9159-27271b77c47d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.486220 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1448fe9a-f02d-4a37-9159-27271b77c47d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:50.505878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1448fe9a-f02d-4a37-9159-27271b77c47d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1699 microversion: 2.1 time: 0.290455 Aug 30 14:44:50.506656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 146/294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:50 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1699 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:50.528515 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ea784ac3-38f5-4718-b3a8-913a28d86cdf tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:50.537774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9b139636-0b57-4dfc-a35d-ce008824e410 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:50.538587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9b139636-0b57-4dfc-a35d-ce008824e410 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:50.546270 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b139636-0b57-4dfc-a35d-ce008824e410 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.547409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b139636-0b57-4dfc-a35d-ce008824e410 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.547612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ea784ac3-38f5-4718-b3a8-913a28d86cdf tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.548133 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b139636-0b57-4dfc-a35d-ce008824e410 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.548431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ea784ac3-38f5-4718-b3a8-913a28d86cdf tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.548937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ea784ac3-38f5-4718-b3a8-913a28d86cdf tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.549938 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b139636-0b57-4dfc-a35d-ce008824e410 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.550590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b139636-0b57-4dfc-a35d-ce008824e410 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.551313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b139636-0b57-4dfc-a35d-ce008824e410 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.648177 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ea784ac3-38f5-4718-b3a8-913a28d86cdf tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Going to try to start instance {{(pid=127089) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 14:44:50.719711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ea784ac3-38f5-4718-b3a8-913a28d86cdf tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "POST /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/action" status: 202 len: 0 microversion: 2.1 time: 0.196491 Aug 30 14:44:50.720841 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 149/295] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 14:44:50 2022] POST /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:44:50.729898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e3c3f023-f638-405d-a650-c28101fd5e9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:50.730732 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e3c3f023-f638-405d-a650-c28101fd5e9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:50.738064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3c3f023-f638-405d-a650-c28101fd5e9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.738450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3c3f023-f638-405d-a650-c28101fd5e9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.738950 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3c3f023-f638-405d-a650-c28101fd5e9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.739765 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3c3f023-f638-405d-a650-c28101fd5e9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.740593 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3c3f023-f638-405d-a650-c28101fd5e9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.741179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3c3f023-f638-405d-a650-c28101fd5e9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.872907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b139636-0b57-4dfc-a35d-ce008824e410 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:50.884979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b139636-0b57-4dfc-a35d-ce008824e410 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:50.887287 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b139636-0b57-4dfc-a35d-ce008824e410 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:50.888740 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9b139636-0b57-4dfc-a35d-ce008824e410 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1737 microversion: 2.20 time: 0.356157 Aug 30 14:44:50.889382 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 147/296] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:50 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1737 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:44:50.898820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9a32f5a8-b011-45c5-af63-20c26120b813 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:50.909682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9a32f5a8-b011-45c5-af63-20c26120b813 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:50.926749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a32f5a8-b011-45c5-af63-20c26120b813 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.927332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a32f5a8-b011-45c5-af63-20c26120b813 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.927835 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a32f5a8-b011-45c5-af63-20c26120b813 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.928825 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a32f5a8-b011-45c5-af63-20c26120b813 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.929425 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a32f5a8-b011-45c5-af63-20c26120b813 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.930135 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a32f5a8-b011-45c5-af63-20c26120b813 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.937705 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e3c3f023-f638-405d-a650-c28101fd5e9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:50.950741 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e3c3f023-f638-405d-a650-c28101fd5e9a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1708 microversion: 2.1 time: 0.225856 Aug 30 14:44:50.969590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 150/297] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:50 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1708 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:50.975348 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-926e5e5c-99b7-4328-81ff-084a472c81d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:50.976398 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-926e5e5c-99b7-4328-81ff-084a472c81d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:50.983760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-926e5e5c-99b7-4328-81ff-084a472c81d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.984688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-926e5e5c-99b7-4328-81ff-084a472c81d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.985383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-926e5e5c-99b7-4328-81ff-084a472c81d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:50.986398 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-926e5e5c-99b7-4328-81ff-084a472c81d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:50.987238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-926e5e5c-99b7-4328-81ff-084a472c81d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:50.987936 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-926e5e5c-99b7-4328-81ff-084a472c81d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:51.176309 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-926e5e5c-99b7-4328-81ff-084a472c81d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:51.185078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-926e5e5c-99b7-4328-81ff-084a472c81d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1510 microversion: 2.1 time: 0.213895 Aug 30 14:44:51.186015 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 151/298] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:50 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:51.496812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9a32f5a8-b011-45c5-af63-20c26120b813 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:51.506508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9a32f5a8-b011-45c5-af63-20c26120b813 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1314 microversion: 2.1 time: 0.611647 Aug 30 14:44:51.507441 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 148/299] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:50 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1314 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:51.914418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0ff58e1e-ea0a-4c25-9f41-580d1fef567a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:51.915222 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0ff58e1e-ea0a-4c25-9f41-580d1fef567a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:51.922637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ff58e1e-ea0a-4c25-9f41-580d1fef567a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:51.923495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ff58e1e-ea0a-4c25-9f41-580d1fef567a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:51.924423 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ff58e1e-ea0a-4c25-9f41-580d1fef567a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:51.925403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ff58e1e-ea0a-4c25-9f41-580d1fef567a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:51.926339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ff58e1e-ea0a-4c25-9f41-580d1fef567a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:51.926958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ff58e1e-ea0a-4c25-9f41-580d1fef567a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:51.976399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1b245311-eabe-43b4-a401-addc9dff216e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:51.977341 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1b245311-eabe-43b4-a401-addc9dff216e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:51.991758 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:52.001031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:52.005904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b245311-eabe-43b4-a401-addc9dff216e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:52.006551 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b245311-eabe-43b4-a401-addc9dff216e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:52.007172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b245311-eabe-43b4-a401-addc9dff216e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:52.008248 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b245311-eabe-43b4-a401-addc9dff216e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:52.008842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b245311-eabe-43b4-a401-addc9dff216e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:52.009408 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b245311-eabe-43b4-a401-addc9dff216e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:52.040289 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:52.142884 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:52.307763 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1b245311-eabe-43b4-a401-addc9dff216e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:52.308078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0ff58e1e-ea0a-4c25-9f41-580d1fef567a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:52.318614 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0ff58e1e-ea0a-4c25-9f41-580d1fef567a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:52.320295 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0ff58e1e-ea0a-4c25-9f41-580d1fef567a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:52.321526 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0ff58e1e-ea0a-4c25-9f41-580d1fef567a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1737 microversion: 2.20 time: 0.410974 Aug 30 14:44:52.337617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 152/300] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:51 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1737 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:52.348244 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1b245311-eabe-43b4-a401-addc9dff216e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1708 microversion: 2.1 time: 0.345927 Aug 30 14:44:52.350672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d357ef0c-7f6b-4d2a-b793-06bd2a816588 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:52.353102 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 149/301] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:51 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1708 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:52.353364 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d357ef0c-7f6b-4d2a-b793-06bd2a816588 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:52.384103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d357ef0c-7f6b-4d2a-b793-06bd2a816588 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:52.385856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d357ef0c-7f6b-4d2a-b793-06bd2a816588 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:52.386444 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d357ef0c-7f6b-4d2a-b793-06bd2a816588 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:52.387477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d357ef0c-7f6b-4d2a-b793-06bd2a816588 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:52.388004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d357ef0c-7f6b-4d2a-b793-06bd2a816588 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:52.393159 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d357ef0c-7f6b-4d2a-b793-06bd2a816588 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:52.413846 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:52.528874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8dd63080-aec1-4462-8416-4678e1eb49f4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:52.529467 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8dd63080-aec1-4462-8416-4678e1eb49f4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:52.536837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dd63080-aec1-4462-8416-4678e1eb49f4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:52.537322 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dd63080-aec1-4462-8416-4678e1eb49f4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:52.537751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dd63080-aec1-4462-8416-4678e1eb49f4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:52.541269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dd63080-aec1-4462-8416-4678e1eb49f4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:52.544627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dd63080-aec1-4462-8416-4678e1eb49f4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:52.545959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dd63080-aec1-4462-8416-4678e1eb49f4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:52.624862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d357ef0c-7f6b-4d2a-b793-06bd2a816588 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:52.633495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d357ef0c-7f6b-4d2a-b793-06bd2a816588 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1510 microversion: 2.1 time: 0.293762 Aug 30 14:44:52.634645 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 153/302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:52 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:52.719169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8dd63080-aec1-4462-8416-4678e1eb49f4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:52.728004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8dd63080-aec1-4462-8416-4678e1eb49f4 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1314 microversion: 2.1 time: 0.203578 Aug 30 14:44:52.728911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 150/303] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:52 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:53.345484 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c5575939-14d8-4b27-b4c1-b9c70117af7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:53.346604 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c5575939-14d8-4b27-b4c1-b9c70117af7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:53.353153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5575939-14d8-4b27-b4c1-b9c70117af7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:53.354032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5575939-14d8-4b27-b4c1-b9c70117af7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:53.354400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5575939-14d8-4b27-b4c1-b9c70117af7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:53.355314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5575939-14d8-4b27-b4c1-b9c70117af7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:53.355929 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5575939-14d8-4b27-b4c1-b9c70117af7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:53.356512 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5575939-14d8-4b27-b4c1-b9c70117af7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:53.373648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f789918f-61e8-4995-964d-49576480cbe1 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:53.376982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f789918f-61e8-4995-964d-49576480cbe1 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:53.383687 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:53.393128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f789918f-61e8-4995-964d-49576480cbe1 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:53.394974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f789918f-61e8-4995-964d-49576480cbe1 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:53.396145 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f789918f-61e8-4995-964d-49576480cbe1 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:53.399226 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f789918f-61e8-4995-964d-49576480cbe1 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:53.400006 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f789918f-61e8-4995-964d-49576480cbe1 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:53.401259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f789918f-61e8-4995-964d-49576480cbe1 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:53.566796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c5575939-14d8-4b27-b4c1-b9c70117af7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:53.577486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c5575939-14d8-4b27-b4c1-b9c70117af7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:53.579538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c5575939-14d8-4b27-b4c1-b9c70117af7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:53.580769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c5575939-14d8-4b27-b4c1-b9c70117af7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1737 microversion: 2.20 time: 0.239140 Aug 30 14:44:53.592480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 154/304] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:53 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1737 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:53.640818 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f789918f-61e8-4995-964d-49576480cbe1 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:53.653073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f789918f-61e8-4995-964d-49576480cbe1 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1708 microversion: 2.1 time: 0.283334 Aug 30 14:44:53.653938 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 151/305] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:53 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1708 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:53.656729 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3e561244-1b98-451e-b148-bcbb75b124d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:53.657646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3e561244-1b98-451e-b148-bcbb75b124d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:53.666024 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e561244-1b98-451e-b148-bcbb75b124d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:53.667039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e561244-1b98-451e-b148-bcbb75b124d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:53.668189 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e561244-1b98-451e-b148-bcbb75b124d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:53.669553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e561244-1b98-451e-b148-bcbb75b124d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:53.670335 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e561244-1b98-451e-b148-bcbb75b124d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:53.671114 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e561244-1b98-451e-b148-bcbb75b124d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:53.754009 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-61e4fd06-7a35-4096-9130-b1ceea8d9310 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:53.754978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-61e4fd06-7a35-4096-9130-b1ceea8d9310 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:53.772417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61e4fd06-7a35-4096-9130-b1ceea8d9310 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:53.773057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61e4fd06-7a35-4096-9130-b1ceea8d9310 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:53.774042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61e4fd06-7a35-4096-9130-b1ceea8d9310 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:53.774976 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61e4fd06-7a35-4096-9130-b1ceea8d9310 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:53.775854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61e4fd06-7a35-4096-9130-b1ceea8d9310 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:53.776574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61e4fd06-7a35-4096-9130-b1ceea8d9310 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:53.891733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3e561244-1b98-451e-b148-bcbb75b124d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:53.904448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3e561244-1b98-451e-b148-bcbb75b124d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1510 microversion: 2.1 time: 0.250513 Aug 30 14:44:53.905347 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 155/306] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:53 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:54.034105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-61e4fd06-7a35-4096-9130-b1ceea8d9310 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:54.047143 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-61e4fd06-7a35-4096-9130-b1ceea8d9310 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1314 microversion: 2.1 time: 0.300743 Aug 30 14:44:54.060529 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 152/307] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:53 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:54.297812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-268ad782-076b-4972-b2ff-d17ba4ed93f9 req-732e3c67-e698-4460-a2f8-bf5eba2d1193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6067cd2e-5a5e-462f-b00e-c3cf228513f2", "name": "network-vif-plugged", "status": "completed", "tag": "baeefbfc-782a-437d-a485-b61f631579a3"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:54.320986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-268ad782-076b-4972-b2ff-d17ba4ed93f9 req-732e3c67-e698-4460-a2f8-bf5eba2d1193 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:54.320986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-268ad782-076b-4972-b2ff-d17ba4ed93f9 req-732e3c67-e698-4460-a2f8-bf5eba2d1193 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:54.320986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-268ad782-076b-4972-b2ff-d17ba4ed93f9 req-732e3c67-e698-4460-a2f8-bf5eba2d1193 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:54.337780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-268ad782-076b-4972-b2ff-d17ba4ed93f9 req-732e3c67-e698-4460-a2f8-bf5eba2d1193 service nova] Creating event network-vif-plugged:baeefbfc-782a-437d-a485-b61f631579a3 for instance 6067cd2e-5a5e-462f-b00e-c3cf228513f2 on hv-cinder-82880 Aug 30 14:44:54.343454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-268ad782-076b-4972-b2ff-d17ba4ed93f9 req-732e3c67-e698-4460-a2f8-bf5eba2d1193 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049502 Aug 30 14:44:54.344468 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 156/308] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:54.605665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-536c8ec3-649e-4970-8beb-51c958447cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:54.609770 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-536c8ec3-649e-4970-8beb-51c958447cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:54.617376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-536c8ec3-649e-4970-8beb-51c958447cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:54.618296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-536c8ec3-649e-4970-8beb-51c958447cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:54.618998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-536c8ec3-649e-4970-8beb-51c958447cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:54.619921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-536c8ec3-649e-4970-8beb-51c958447cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:54.620534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-536c8ec3-649e-4970-8beb-51c958447cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:54.621162 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-536c8ec3-649e-4970-8beb-51c958447cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:54.678691 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-17feb9ab-4ead-4290-a627-634006c2d50e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:54.679438 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-17feb9ab-4ead-4290-a627-634006c2d50e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:54.690945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17feb9ab-4ead-4290-a627-634006c2d50e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:54.691460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17feb9ab-4ead-4290-a627-634006c2d50e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:54.691900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17feb9ab-4ead-4290-a627-634006c2d50e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:54.692713 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17feb9ab-4ead-4290-a627-634006c2d50e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:54.693174 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17feb9ab-4ead-4290-a627-634006c2d50e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:54.693669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17feb9ab-4ead-4290-a627-634006c2d50e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:54.862317 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-536c8ec3-649e-4970-8beb-51c958447cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:54.872137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-536c8ec3-649e-4970-8beb-51c958447cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:54.873929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-536c8ec3-649e-4970-8beb-51c958447cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:54.875465 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-536c8ec3-649e-4970-8beb-51c958447cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1737 microversion: 2.20 time: 0.274770 Aug 30 14:44:54.891012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 153/309] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:54 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1737 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:54.896207 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-17feb9ab-4ead-4290-a627-634006c2d50e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:54.905660 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-17feb9ab-4ead-4290-a627-634006c2d50e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1708 microversion: 2.1 time: 0.233451 Aug 30 14:44:54.919607 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 157/310] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:54 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1708 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:54.928968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d1c44045-6dde-4b2c-b3b7-f488512ef3a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:54.929669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d1c44045-6dde-4b2c-b3b7-f488512ef3a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:54.941448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1c44045-6dde-4b2c-b3b7-f488512ef3a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:54.942622 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1c44045-6dde-4b2c-b3b7-f488512ef3a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:54.943575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1c44045-6dde-4b2c-b3b7-f488512ef3a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:54.945890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1c44045-6dde-4b2c-b3b7-f488512ef3a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:54.946959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1c44045-6dde-4b2c-b3b7-f488512ef3a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:54.948138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1c44045-6dde-4b2c-b3b7-f488512ef3a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:55.072260 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fbc0926b-6621-4e4f-97d1-74d9cca3c267 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:55.073437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fbc0926b-6621-4e4f-97d1-74d9cca3c267 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:55.081132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fbc0926b-6621-4e4f-97d1-74d9cca3c267 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:55.081659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fbc0926b-6621-4e4f-97d1-74d9cca3c267 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:55.082095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fbc0926b-6621-4e4f-97d1-74d9cca3c267 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:55.086817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fbc0926b-6621-4e4f-97d1-74d9cca3c267 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:55.087741 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fbc0926b-6621-4e4f-97d1-74d9cca3c267 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:55.088745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fbc0926b-6621-4e4f-97d1-74d9cca3c267 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:55.118091 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d1c44045-6dde-4b2c-b3b7-f488512ef3a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:55.132979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d1c44045-6dde-4b2c-b3b7-f488512ef3a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1516 microversion: 2.1 time: 0.208402 Aug 30 14:44:55.133563 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 154/311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:54 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:55.240918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fbc0926b-6621-4e4f-97d1-74d9cca3c267 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:55.252045 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fbc0926b-6621-4e4f-97d1-74d9cca3c267 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1314 microversion: 2.1 time: 0.184290 Aug 30 14:44:55.253795 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 158/312] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:55 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:55.898411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-efacde5b-6386-464f-a15d-a2832ff010c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:55.899353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-efacde5b-6386-464f-a15d-a2832ff010c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:55.907515 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efacde5b-6386-464f-a15d-a2832ff010c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:55.908008 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efacde5b-6386-464f-a15d-a2832ff010c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:55.908644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efacde5b-6386-464f-a15d-a2832ff010c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:55.911677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efacde5b-6386-464f-a15d-a2832ff010c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:55.911924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efacde5b-6386-464f-a15d-a2832ff010c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:55.912651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efacde5b-6386-464f-a15d-a2832ff010c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:55.957349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0225d4a8-4c12-40a1-b791-0649663ec6aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:55.957996 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0225d4a8-4c12-40a1-b791-0649663ec6aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:55.965066 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0225d4a8-4c12-40a1-b791-0649663ec6aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:55.965553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0225d4a8-4c12-40a1-b791-0649663ec6aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:55.966252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0225d4a8-4c12-40a1-b791-0649663ec6aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:55.967132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0225d4a8-4c12-40a1-b791-0649663ec6aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:55.967731 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0225d4a8-4c12-40a1-b791-0649663ec6aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:55.968316 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0225d4a8-4c12-40a1-b791-0649663ec6aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:56.153044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0225d4a8-4c12-40a1-b791-0649663ec6aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:56.163495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0225d4a8-4c12-40a1-b791-0649663ec6aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1712 microversion: 2.1 time: 0.221478 Aug 30 14:44:56.175862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 159/313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:55 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1712 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:56.279510 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c6f6f08b-0041-4abe-958c-db7f662f8a4e tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:56.280921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c6f6f08b-0041-4abe-958c-db7f662f8a4e tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:56.306878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6f6f08b-0041-4abe-958c-db7f662f8a4e tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:56.309328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6f6f08b-0041-4abe-958c-db7f662f8a4e tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:56.310057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6f6f08b-0041-4abe-958c-db7f662f8a4e tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:56.311494 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6f6f08b-0041-4abe-958c-db7f662f8a4e tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:56.312156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6f6f08b-0041-4abe-958c-db7f662f8a4e tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:56.312820 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6f6f08b-0041-4abe-958c-db7f662f8a4e tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:56.392183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-efacde5b-6386-464f-a15d-a2832ff010c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:56.401364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-efacde5b-6386-464f-a15d-a2832ff010c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:56.407852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-efacde5b-6386-464f-a15d-a2832ff010c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:56.411023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-efacde5b-6386-464f-a15d-a2832ff010c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1737 microversion: 2.20 time: 0.516631 Aug 30 14:44:56.423240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 155/314] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:55 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1737 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:56.557228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c6f6f08b-0041-4abe-958c-db7f662f8a4e tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:56.565959 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c6f6f08b-0041-4abe-958c-db7f662f8a4e tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1314 microversion: 2.1 time: 0.292524 Aug 30 14:44:56.567255 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 160/315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:56 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:56.703198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-beac57f3-af40-4f8a-800b-12d868ee20ba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Action: 'create', calling method: .version_select at 0x7f5cbacacc10>, body: {"keypair": {"name": "tempest-keypair-780605970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFstsADlcHtaM9Jr3qzH8G2tzJwfjsmnp5Vqjiwf/0alukAhjlfyu5MI0ALt6hG7PB50w5F+c3/F2d+U1Z7oRaRTp6IfGQC87EFcJWPXFmPCM+rd2j6Hup5WLdpRTFf3/g=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:56.722009 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-beac57f3-af40-4f8a-800b-12d868ee20ba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Getting quotas for project 65bab38256b44ad6b4b573a2441eb6d3. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:44:56.726224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-beac57f3-af40-4f8a-800b-12d868ee20ba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Getting quotas for user 35f28006916040c3b988de6c15093166 and project 65bab38256b44ad6b4b573a2441eb6d3. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:44:56.753768 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-beac57f3-af40-4f8a-800b-12d868ee20ba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054946 Aug 30 14:44:56.756302 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 156/316] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 14:44:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:44:57.440072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c5849bb1-fe43-4a0f-92d9-027b57ebe59e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:57.441972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c5849bb1-fe43-4a0f-92d9-027b57ebe59e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:57.449087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5849bb1-fe43-4a0f-92d9-027b57ebe59e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:57.449770 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5849bb1-fe43-4a0f-92d9-027b57ebe59e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:57.450382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5849bb1-fe43-4a0f-92d9-027b57ebe59e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:57.451594 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5849bb1-fe43-4a0f-92d9-027b57ebe59e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:57.452300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5849bb1-fe43-4a0f-92d9-027b57ebe59e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:57.452881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5849bb1-fe43-4a0f-92d9-027b57ebe59e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:57.586035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-52ab2dfc-f5f1-4ba1-851c-b9749adbdfee tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:57.588494 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-52ab2dfc-f5f1-4ba1-851c-b9749adbdfee tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:57.598328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52ab2dfc-f5f1-4ba1-851c-b9749adbdfee tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:57.599035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52ab2dfc-f5f1-4ba1-851c-b9749adbdfee tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:57.599677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52ab2dfc-f5f1-4ba1-851c-b9749adbdfee tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:57.600564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52ab2dfc-f5f1-4ba1-851c-b9749adbdfee tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:57.601174 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52ab2dfc-f5f1-4ba1-851c-b9749adbdfee tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:57.601757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52ab2dfc-f5f1-4ba1-851c-b9749adbdfee tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:57.635515 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c5849bb1-fe43-4a0f-92d9-027b57ebe59e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:57.651409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c5849bb1-fe43-4a0f-92d9-027b57ebe59e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:57.653087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c5849bb1-fe43-4a0f-92d9-027b57ebe59e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:57.654289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c5849bb1-fe43-4a0f-92d9-027b57ebe59e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1737 microversion: 2.20 time: 0.219442 Aug 30 14:44:57.654903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 161/317] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:57 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:44:57.889099 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-52ab2dfc-f5f1-4ba1-851c-b9749adbdfee tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:57.898759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-52ab2dfc-f5f1-4ba1-851c-b9749adbdfee tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1463 microversion: 2.1 time: 0.316582 Aug 30 14:44:57.899715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 157/318] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:57 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1463 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:57.946150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-70d75492-1eb2-4f7c-b74e-81631df0eb45 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:57.946645 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-70d75492-1eb2-4f7c-b74e-81631df0eb45 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:57.953596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-70d75492-1eb2-4f7c-b74e-81631df0eb45 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:57.954086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-70d75492-1eb2-4f7c-b74e-81631df0eb45 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:57.954527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-70d75492-1eb2-4f7c-b74e-81631df0eb45 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:57.955249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-70d75492-1eb2-4f7c-b74e-81631df0eb45 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:57.955697 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-70d75492-1eb2-4f7c-b74e-81631df0eb45 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:57.956122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-70d75492-1eb2-4f7c-b74e-81631df0eb45 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:57.984062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-70d75492-1eb2-4f7c-b74e-81631df0eb45 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Going to try to terminate instance {{(pid=127089) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:44:58.077019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:44:58.094594 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-70d75492-1eb2-4f7c-b74e-81631df0eb45 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 204 len: 0 microversion: 2.1 time: 0.150880 Aug 30 14:44:58.095569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 162/319] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 14:44:57 2022] DELETE /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:44:58.106917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bd78fd84-8927-42c2-853e-54821bab0f86 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:58.108284 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bd78fd84-8927-42c2-853e-54821bab0f86 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:58.118862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd78fd84-8927-42c2-853e-54821bab0f86 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:58.119475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd78fd84-8927-42c2-853e-54821bab0f86 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:58.119915 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd78fd84-8927-42c2-853e-54821bab0f86 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:58.120635 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd78fd84-8927-42c2-853e-54821bab0f86 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:58.121092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd78fd84-8927-42c2-853e-54821bab0f86 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:58.121516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd78fd84-8927-42c2-853e-54821bab0f86 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:58.362444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bd78fd84-8927-42c2-853e-54821bab0f86 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:58.371702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bd78fd84-8927-42c2-853e-54821bab0f86 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1469 microversion: 2.1 time: 0.272186 Aug 30 14:44:58.372506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 158/320] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:58 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1469 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:44:58.642584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1645393519", "imageRef": "fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8fd5a316-a8cc-40db-9c3d-7092a23676cb"}], "security_groups": [{"name": "tempest-securitygroup--993872741"}], "key_name": "tempest-keypair-780605970", "user_data": "}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:44:58.678504 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7ac61edb-e029-4608-a26d-263557dba734 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:58.679346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7ac61edb-e029-4608-a26d-263557dba734 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:58.686204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ac61edb-e029-4608-a26d-263557dba734 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:58.686695 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ac61edb-e029-4608-a26d-263557dba734 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:58.687134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ac61edb-e029-4608-a26d-263557dba734 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:58.688031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ac61edb-e029-4608-a26d-263557dba734 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:58.688509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ac61edb-e029-4608-a26d-263557dba734 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:58.688984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ac61edb-e029-4608-a26d-263557dba734 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:58.779587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.network.neutron [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] validate_networks() for [('8fd5a316-a8cc-40db-9c3d-7092a23676cb', None, None, None, None, None)] {{(pid=127089) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:44:58.881075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7ac61edb-e029-4608-a26d-263557dba734 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:58.890370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7ac61edb-e029-4608-a26d-263557dba734 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:58.892226 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7ac61edb-e029-4608-a26d-263557dba734 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:58.893748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7ac61edb-e029-4608-a26d-263557dba734 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1719 microversion: 2.20 time: 0.219527 Aug 30 14:44:58.894291 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 159/321] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:58 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1719 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:44:59.395172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c2d1c8fd-b778-44cc-b70e-a8b5967b8b17 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:59.396113 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c2d1c8fd-b778-44cc-b70e-a8b5967b8b17 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:59.402555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2d1c8fd-b778-44cc-b70e-a8b5967b8b17 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:59.403185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2d1c8fd-b778-44cc-b70e-a8b5967b8b17 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:59.403737 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2d1c8fd-b778-44cc-b70e-a8b5967b8b17 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:59.404652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2d1c8fd-b778-44cc-b70e-a8b5967b8b17 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:59.405243 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2d1c8fd-b778-44cc-b70e-a8b5967b8b17 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:59.405867 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2d1c8fd-b778-44cc-b70e-a8b5967b8b17 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:59.446854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Flavor limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:44:59.447592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Image limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:44:59.448349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Flavor pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:44:59.448984 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Image pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:44:59.449935 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:44:59.460905 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:59.461532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:59.462192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:59.463358 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:59.464038 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:59.464694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:59.485258 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Getting quotas for project 65bab38256b44ad6b4b573a2441eb6d3. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:44:59.489852 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Getting quotas for user 35f28006916040c3b988de6c15093166 and project 65bab38256b44ad6b4b573a2441eb6d3. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:44:59.508758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Going to run 1 instances... {{(pid=127089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:44:59.511332 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:44:59.553237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c2d1c8fd-b778-44cc-b70e-a8b5967b8b17 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:59.563058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c2d1c8fd-b778-44cc-b70e-a8b5967b8b17 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1469 microversion: 2.1 time: 0.171541 Aug 30 14:44:59.577313 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d1e41c54-02cd-4ac0-8f50-4fb882dec83e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.939231 Aug 30 14:44:59.577536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 160/322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:59 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:59.578336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 163/323] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 14:44:58 2022] POST /compute/v2.1/servers => generated 408 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:44:59.593647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8b3b9792-8306-4340-aa0d-0e5cc5d5cd9a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:59.595474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8b3b9792-8306-4340-aa0d-0e5cc5d5cd9a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:59.661671 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8b3b9792-8306-4340-aa0d-0e5cc5d5cd9a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:44:59.674954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8b3b9792-8306-4340-aa0d-0e5cc5d5cd9a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1245 microversion: 2.1 time: 0.088345 Aug 30 14:44:59.675905 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 161/324] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:44:59 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:44:59.917603 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6d576653-deb5-4e15-9619-7340197d8f8c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:44:59.918416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6d576653-deb5-4e15-9619-7340197d8f8c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:44:59.930785 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d576653-deb5-4e15-9619-7340197d8f8c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:59.931295 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d576653-deb5-4e15-9619-7340197d8f8c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:59.932908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d576653-deb5-4e15-9619-7340197d8f8c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:44:59.934715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d576653-deb5-4e15-9619-7340197d8f8c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:44:59.936648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d576653-deb5-4e15-9619-7340197d8f8c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:44:59.937868 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d576653-deb5-4e15-9619-7340197d8f8c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:00.101341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6d576653-deb5-4e15-9619-7340197d8f8c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:00.109986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6d576653-deb5-4e15-9619-7340197d8f8c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:00.112040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6d576653-deb5-4e15-9619-7340197d8f8c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:00.113222 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6d576653-deb5-4e15-9619-7340197d8f8c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1719 microversion: 2.20 time: 0.200347 Aug 30 14:45:00.114082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 164/325] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:44:59 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1719 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:00.594715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7d180ac9-0144-468e-965a-752fb7202d95 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:00.595474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7d180ac9-0144-468e-965a-752fb7202d95 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:00.606314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d180ac9-0144-468e-965a-752fb7202d95 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:00.606807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d180ac9-0144-468e-965a-752fb7202d95 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:00.607265 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d180ac9-0144-468e-965a-752fb7202d95 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:00.608850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d180ac9-0144-468e-965a-752fb7202d95 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:00.609310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d180ac9-0144-468e-965a-752fb7202d95 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:00.609736 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d180ac9-0144-468e-965a-752fb7202d95 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:00.697079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7faa18ee-5db6-4b09-ab07-f6d1b8fee947 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:00.698255 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7faa18ee-5db6-4b09-ab07-f6d1b8fee947 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:00.705434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7faa18ee-5db6-4b09-ab07-f6d1b8fee947 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:00.705934 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7faa18ee-5db6-4b09-ab07-f6d1b8fee947 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:00.706372 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7faa18ee-5db6-4b09-ab07-f6d1b8fee947 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:00.707297 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7faa18ee-5db6-4b09-ab07-f6d1b8fee947 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:00.707902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7faa18ee-5db6-4b09-ab07-f6d1b8fee947 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:00.708473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7faa18ee-5db6-4b09-ab07-f6d1b8fee947 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:00.790792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7faa18ee-5db6-4b09-ab07-f6d1b8fee947 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:00.798996 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7faa18ee-5db6-4b09-ab07-f6d1b8fee947 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1297 microversion: 2.1 time: 0.105869 Aug 30 14:45:00.799609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 165/326] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:00 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1297 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:01.139433 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7d180ac9-0144-468e-965a-752fb7202d95 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:01.140295 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d92aaaee-bf2f-4fa1-ae2a-d6f1ab306813 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:01.141597 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d92aaaee-bf2f-4fa1-ae2a-d6f1ab306813 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:01.152717 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7d180ac9-0144-468e-965a-752fb7202d95 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1469 microversion: 2.1 time: 0.569194 Aug 30 14:45:01.153691 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d92aaaee-bf2f-4fa1-ae2a-d6f1ab306813 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:01.155777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d92aaaee-bf2f-4fa1-ae2a-d6f1ab306813 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:01.156790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d92aaaee-bf2f-4fa1-ae2a-d6f1ab306813 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:01.157822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d92aaaee-bf2f-4fa1-ae2a-d6f1ab306813 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:01.158498 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d92aaaee-bf2f-4fa1-ae2a-d6f1ab306813 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:01.159147 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d92aaaee-bf2f-4fa1-ae2a-d6f1ab306813 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:01.171511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 162/327] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:00 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1469 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:01.403474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d92aaaee-bf2f-4fa1-ae2a-d6f1ab306813 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:01.419910 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d92aaaee-bf2f-4fa1-ae2a-d6f1ab306813 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:01.421469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d92aaaee-bf2f-4fa1-ae2a-d6f1ab306813 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:01.423565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d92aaaee-bf2f-4fa1-ae2a-d6f1ab306813 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1719 microversion: 2.20 time: 0.290366 Aug 30 14:45:01.424593 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 166/328] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:01 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1719 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:01.444157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-00c00f31-f998-482f-95ee-1da1be9f6221 req-1adf2817-9286-4dad-b230-9f9058ec8a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6067cd2e-5a5e-462f-b00e-c3cf228513f2", "name": "network-vif-deleted", "tag": "baeefbfc-782a-437d-a485-b61f631579a3"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:01.457780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-00c00f31-f998-482f-95ee-1da1be9f6221 req-1adf2817-9286-4dad-b230-9f9058ec8a89 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:01.458673 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-00c00f31-f998-482f-95ee-1da1be9f6221 req-1adf2817-9286-4dad-b230-9f9058ec8a89 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:01.459349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-00c00f31-f998-482f-95ee-1da1be9f6221 req-1adf2817-9286-4dad-b230-9f9058ec8a89 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:01.472829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-00c00f31-f998-482f-95ee-1da1be9f6221 req-1adf2817-9286-4dad-b230-9f9058ec8a89 service nova] Creating event network-vif-deleted:baeefbfc-782a-437d-a485-b61f631579a3 for instance 6067cd2e-5a5e-462f-b00e-c3cf228513f2 on hv-cinder-82880 Aug 30 14:45:01.478246 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-00c00f31-f998-482f-95ee-1da1be9f6221 req-1adf2817-9286-4dad-b230-9f9058ec8a89 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048517 Aug 30 14:45:01.479618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 163/329] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:45:01.820978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8abb2111-3fdd-438c-a35a-acad00624e67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:01.821594 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8abb2111-3fdd-438c-a35a-acad00624e67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:01.828608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8abb2111-3fdd-438c-a35a-acad00624e67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:01.829069 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8abb2111-3fdd-438c-a35a-acad00624e67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:01.829499 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8abb2111-3fdd-438c-a35a-acad00624e67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:01.830192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8abb2111-3fdd-438c-a35a-acad00624e67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:01.830637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8abb2111-3fdd-438c-a35a-acad00624e67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:01.831055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8abb2111-3fdd-438c-a35a-acad00624e67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:01.910899 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8abb2111-3fdd-438c-a35a-acad00624e67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:01.919199 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8abb2111-3fdd-438c-a35a-acad00624e67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1303 microversion: 2.1 time: 0.101827 Aug 30 14:45:01.919637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 167/330] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:01 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:02.177096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-851414ba-5a84-492c-9f14-b060d73a9a94 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:02.178618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-851414ba-5a84-492c-9f14-b060d73a9a94 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:02.186282 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-851414ba-5a84-492c-9f14-b060d73a9a94 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.186999 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-851414ba-5a84-492c-9f14-b060d73a9a94 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.187456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-851414ba-5a84-492c-9f14-b060d73a9a94 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:02.188300 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-851414ba-5a84-492c-9f14-b060d73a9a94 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.188896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-851414ba-5a84-492c-9f14-b060d73a9a94 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.189480 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-851414ba-5a84-492c-9f14-b060d73a9a94 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:02.253259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-851414ba-5a84-492c-9f14-b060d73a9a94 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.253737 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-851414ba-5a84-492c-9f14-b060d73a9a94 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.254164 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-851414ba-5a84-492c-9f14-b060d73a9a94 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:02.254604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-851414ba-5a84-492c-9f14-b060d73a9a94 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lazy-loading 'fault' on Instance uuid 6067cd2e-5a5e-462f-b00e-c3cf228513f2 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:45:02.286891 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-d5873872-f2a0-4246-ab3c-80b7d6d908d8 req-ee6a2686-76ea-43fe-a6cb-11d0f631681c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df823286-f7fd-4dbf-acb5-7cd297f48da0", "name": "network-vif-unplugged", "status": "completed", "tag": "356c248c-dbd2-4ea8-93cc-dd834560932d"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:02.301455 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-d5873872-f2a0-4246-ab3c-80b7d6d908d8 req-ee6a2686-76ea-43fe-a6cb-11d0f631681c service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.302646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-d5873872-f2a0-4246-ab3c-80b7d6d908d8 req-ee6a2686-76ea-43fe-a6cb-11d0f631681c service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.303306 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-d5873872-f2a0-4246-ab3c-80b7d6d908d8 req-ee6a2686-76ea-43fe-a6cb-11d0f631681c service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:02.306141 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-851414ba-5a84-492c-9f14-b060d73a9a94 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:02.320892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-851414ba-5a84-492c-9f14-b060d73a9a94 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1304 microversion: 2.1 time: 0.146100 Aug 30 14:45:02.321100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-d5873872-f2a0-4246-ab3c-80b7d6d908d8 req-ee6a2686-76ea-43fe-a6cb-11d0f631681c service nova] Creating event network-vif-unplugged:356c248c-dbd2-4ea8-93cc-dd834560932d for instance df823286-f7fd-4dbf-acb5-7cd297f48da0 on hv-cinder-82880 Aug 30 14:45:02.333052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 164/331] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:02 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:02.334811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-d5873872-f2a0-4246-ab3c-80b7d6d908d8 req-ee6a2686-76ea-43fe-a6cb-11d0f631681c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056811 Aug 30 14:45:02.335621 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 168/332] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:45:02.447648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-abf3f3ab-b42a-48d9-bb36-a4932621cc16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:02.448392 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-abf3f3ab-b42a-48d9-bb36-a4932621cc16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:02.454204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abf3f3ab-b42a-48d9-bb36-a4932621cc16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.454686 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abf3f3ab-b42a-48d9-bb36-a4932621cc16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.455116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abf3f3ab-b42a-48d9-bb36-a4932621cc16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:02.455905 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abf3f3ab-b42a-48d9-bb36-a4932621cc16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.456457 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abf3f3ab-b42a-48d9-bb36-a4932621cc16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.456959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abf3f3ab-b42a-48d9-bb36-a4932621cc16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:02.591282 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-abf3f3ab-b42a-48d9-bb36-a4932621cc16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:02.600089 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-abf3f3ab-b42a-48d9-bb36-a4932621cc16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:02.601611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-abf3f3ab-b42a-48d9-bb36-a4932621cc16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:02.602834 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-abf3f3ab-b42a-48d9-bb36-a4932621cc16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1719 microversion: 2.20 time: 0.159186 Aug 30 14:45:02.603557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 165/333] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:02 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:02.940631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-91139287-8b2c-4737-8f90-76086e889889 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:02.941580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-91139287-8b2c-4737-8f90-76086e889889 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:02.947732 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-91139287-8b2c-4737-8f90-76086e889889 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.948198 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-91139287-8b2c-4737-8f90-76086e889889 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.948626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-91139287-8b2c-4737-8f90-76086e889889 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:02.949299 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-91139287-8b2c-4737-8f90-76086e889889 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:02.949745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-91139287-8b2c-4737-8f90-76086e889889 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:02.950156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-91139287-8b2c-4737-8f90-76086e889889 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:03.012096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-91139287-8b2c-4737-8f90-76086e889889 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:03.019928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-91139287-8b2c-4737-8f90-76086e889889 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1303 microversion: 2.1 time: 0.083614 Aug 30 14:45:03.020485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 169/334] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:02 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1303 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:03.345030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-00533855-e0eb-450a-a4f9-8e5eb0cf35e7 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:03.345635 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-00533855-e0eb-450a-a4f9-8e5eb0cf35e7 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:03.351958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00533855-e0eb-450a-a4f9-8e5eb0cf35e7 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:03.352432 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00533855-e0eb-450a-a4f9-8e5eb0cf35e7 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:03.352873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00533855-e0eb-450a-a4f9-8e5eb0cf35e7 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:03.354159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00533855-e0eb-450a-a4f9-8e5eb0cf35e7 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:03.354713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00533855-e0eb-450a-a4f9-8e5eb0cf35e7 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:03.355139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00533855-e0eb-450a-a4f9-8e5eb0cf35e7 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:03.385138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00533855-e0eb-450a-a4f9-8e5eb0cf35e7 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:03.385611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00533855-e0eb-450a-a4f9-8e5eb0cf35e7 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:03.386040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00533855-e0eb-450a-a4f9-8e5eb0cf35e7 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:03.386478 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-00533855-e0eb-450a-a4f9-8e5eb0cf35e7 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lazy-loading 'fault' on Instance uuid 6067cd2e-5a5e-462f-b00e-c3cf228513f2 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:45:03.426195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-00533855-e0eb-450a-a4f9-8e5eb0cf35e7 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:03.434013 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-00533855-e0eb-450a-a4f9-8e5eb0cf35e7 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1304 microversion: 2.1 time: 0.092834 Aug 30 14:45:03.434577 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 166/335] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:03 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:03.626057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-38b0c919-0e81-4bb0-997d-8a672b14b7f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:03.626736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-38b0c919-0e81-4bb0-997d-8a672b14b7f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:03.633186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-38b0c919-0e81-4bb0-997d-8a672b14b7f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:03.633676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-38b0c919-0e81-4bb0-997d-8a672b14b7f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:03.634110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-38b0c919-0e81-4bb0-997d-8a672b14b7f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:03.635385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-38b0c919-0e81-4bb0-997d-8a672b14b7f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:03.635879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-38b0c919-0e81-4bb0-997d-8a672b14b7f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:03.636336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-38b0c919-0e81-4bb0-997d-8a672b14b7f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:03.640696 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:03.800576 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1322308328", "imageRef": "fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b", "flavorRef": "452", "networks": [{"uuid": "582043b5-356e-4f2d-aa71-583f5445bff6"}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:03.856038 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-38b0c919-0e81-4bb0-997d-8a672b14b7f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:03.863456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] validate_networks() for [('582043b5-356e-4f2d-aa71-583f5445bff6', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:45:03.873820 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-38b0c919-0e81-4bb0-997d-8a672b14b7f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:03.875527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-38b0c919-0e81-4bb0-997d-8a672b14b7f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:03.877724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-38b0c919-0e81-4bb0-997d-8a672b14b7f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1719 microversion: 2.20 time: 0.255367 Aug 30 14:45:03.879062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 170/336] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:03 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1719 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:04.040686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a8ae73a8-e965-4f08-b162-40cb0720fab8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:04.041644 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a8ae73a8-e965-4f08-b162-40cb0720fab8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:04.048756 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a8ae73a8-e965-4f08-b162-40cb0720fab8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:04.049480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a8ae73a8-e965-4f08-b162-40cb0720fab8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:04.050013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a8ae73a8-e965-4f08-b162-40cb0720fab8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:04.050834 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a8ae73a8-e965-4f08-b162-40cb0720fab8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:04.051597 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a8ae73a8-e965-4f08-b162-40cb0720fab8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:04.052127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a8ae73a8-e965-4f08-b162-40cb0720fab8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:04.117788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a8ae73a8-e965-4f08-b162-40cb0720fab8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:04.125970 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a8ae73a8-e965-4f08-b162-40cb0720fab8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1303 microversion: 2.1 time: 0.089807 Aug 30 14:45:04.126528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 171/337] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:04 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:04.456916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fc8b6d62-b265-4d01-b6ad-626231570da0 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:04.457516 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fc8b6d62-b265-4d01-b6ad-626231570da0 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:04.464095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc8b6d62-b265-4d01-b6ad-626231570da0 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:04.465021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc8b6d62-b265-4d01-b6ad-626231570da0 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:04.465021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc8b6d62-b265-4d01-b6ad-626231570da0 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:04.465718 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc8b6d62-b265-4d01-b6ad-626231570da0 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:04.466168 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc8b6d62-b265-4d01-b6ad-626231570da0 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:04.466584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc8b6d62-b265-4d01-b6ad-626231570da0 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:04.504419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc8b6d62-b265-4d01-b6ad-626231570da0 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:04.504986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc8b6d62-b265-4d01-b6ad-626231570da0 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:04.505497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc8b6d62-b265-4d01-b6ad-626231570da0 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:04.506033 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.objects.instance [None req-fc8b6d62-b265-4d01-b6ad-626231570da0 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lazy-loading 'fault' on Instance uuid 6067cd2e-5a5e-462f-b00e-c3cf228513f2 {{(pid=127089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:45:04.511537 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:45:04.512023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:45:04.512586 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:45:04.513245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:45:04.514089 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:45:04.526127 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:04.527966 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:04.529260 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:04.532616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:04.533548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:04.534507 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:04.552519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fc8b6d62-b265-4d01-b6ad-626231570da0 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b4f8865dd14290ab714039a2e424fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe47f61a4dbf4e669ff257d299e92ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:04.561608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fc8b6d62-b265-4d01-b6ad-626231570da0 tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 200 len: 1304 microversion: 2.1 time: 0.108642 Aug 30 14:45:04.562312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Getting quotas for project e67c28ec4d3949dc9d00e70f61b5657f. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:45:04.562909 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 172/338] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:04 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:04.567427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Getting quotas for user a5dd8cf0a16345c5b2973552f0881893 and project e67c28ec4d3949dc9d00e70f61b5657f. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:45:04.579919 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:45:04.582288 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:45:04.628926 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0a7eaee5-7f5f-4d5e-921f-e56d23e9bf63 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835008 Aug 30 14:45:04.629748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 167/339] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 14:45:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:45:04.640335 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2ec96665-79f7-4a02-b90b-89ed5947c366 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:04.641595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2ec96665-79f7-4a02-b90b-89ed5947c366 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:04.720842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2ec96665-79f7-4a02-b90b-89ed5947c366 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:04.733282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2ec96665-79f7-4a02-b90b-89ed5947c366 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1214 microversion: 2.1 time: 0.096221 Aug 30 14:45:04.736086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 173/340] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:04 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:04.903034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f703328f-8027-4334-a436-0fbd057b1c49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:04.903765 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f703328f-8027-4334-a436-0fbd057b1c49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:04.910059 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f703328f-8027-4334-a436-0fbd057b1c49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:04.910544 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f703328f-8027-4334-a436-0fbd057b1c49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:04.911003 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f703328f-8027-4334-a436-0fbd057b1c49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:04.911890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f703328f-8027-4334-a436-0fbd057b1c49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:04.912598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f703328f-8027-4334-a436-0fbd057b1c49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:04.913030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f703328f-8027-4334-a436-0fbd057b1c49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.139661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f703328f-8027-4334-a436-0fbd057b1c49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:05.139661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:05.147148 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9d36a748-36f1-4b43-92f8-b75f289937e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:05.147862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9d36a748-36f1-4b43-92f8-b75f289937e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:05.155269 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d36a748-36f1-4b43-92f8-b75f289937e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.155994 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d36a748-36f1-4b43-92f8-b75f289937e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.156227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f703328f-8027-4334-a436-0fbd057b1c49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:05.156779 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d36a748-36f1-4b43-92f8-b75f289937e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.157749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f703328f-8027-4334-a436-0fbd057b1c49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:05.158080 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d36a748-36f1-4b43-92f8-b75f289937e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.158614 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d36a748-36f1-4b43-92f8-b75f289937e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.158901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f703328f-8027-4334-a436-0fbd057b1c49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1662 microversion: 2.20 time: 0.261125 Aug 30 14:45:05.159171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d36a748-36f1-4b43-92f8-b75f289937e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.159611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 168/341] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:04 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1662 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:05.181534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dda842d5-81d6-4f51-b2f7-9841a3824740 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72ce0953-f5c8-4724-a213-770f060618b4"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:05.184301 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dda842d5-81d6-4f51-b2f7-9841a3824740 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:05.199537 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dda842d5-81d6-4f51-b2f7-9841a3824740 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.200565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dda842d5-81d6-4f51-b2f7-9841a3824740 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.201197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dda842d5-81d6-4f51-b2f7-9841a3824740 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.201974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dda842d5-81d6-4f51-b2f7-9841a3824740 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.202496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dda842d5-81d6-4f51-b2f7-9841a3824740 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.202987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dda842d5-81d6-4f51-b2f7-9841a3824740 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.308091 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9d36a748-36f1-4b43-92f8-b75f289937e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:05.317530 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9d36a748-36f1-4b43-92f8-b75f289937e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.175154 Aug 30 14:45:05.318608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 174/342] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:05 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:05.341968 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-a84041d9-f92b-41d1-84c9-9a4a2632ecd6 req-eb0f1165-834a-4186-b443-829dc1fec27c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42a99ef-987b-4b7f-a6ef-5458fccc5c52", "tag": "de9192f0-7fd0-49c1-8393-b52baf316782"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:05.353486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-a84041d9-f92b-41d1-84c9-9a4a2632ecd6 req-eb0f1165-834a-4186-b443-829dc1fec27c service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.354115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-a84041d9-f92b-41d1-84c9-9a4a2632ecd6 req-eb0f1165-834a-4186-b443-829dc1fec27c service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.354845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-a84041d9-f92b-41d1-84c9-9a4a2632ecd6 req-eb0f1165-834a-4186-b443-829dc1fec27c service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.375788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-a84041d9-f92b-41d1-84c9-9a4a2632ecd6 req-eb0f1165-834a-4186-b443-829dc1fec27c service nova] Creating event network-changed:de9192f0-7fd0-49c1-8393-b52baf316782 for instance e42a99ef-987b-4b7f-a6ef-5458fccc5c52 on hv-cinder-82880 Aug 30 14:45:05.381465 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-a84041d9-f92b-41d1-84c9-9a4a2632ecd6 req-eb0f1165-834a-4186-b443-829dc1fec27c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044857 Aug 30 14:45:05.382256 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 175/343] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:45:05.549579 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dda842d5-81d6-4f51-b2f7-9841a3824740 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "POST /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.372099 Aug 30 14:45:05.550523 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 169/344] 10.222.0.30 () {62 vars in 1364 bytes} [Tue Aug 30 14:45:05 2022] POST /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 188 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:45:05.584225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6fa4f8f5-d57d-4760-8959-c5ddcec0eeea tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:05.584784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6fa4f8f5-d57d-4760-8959-c5ddcec0eeea tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] [instance: 6067cd2e-5a5e-462f-b00e-c3cf228513f2] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:05.591967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6fa4f8f5-d57d-4760-8959-c5ddcec0eeea tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.592631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6fa4f8f5-d57d-4760-8959-c5ddcec0eeea tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.593062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6fa4f8f5-d57d-4760-8959-c5ddcec0eeea tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.595552 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6fa4f8f5-d57d-4760-8959-c5ddcec0eeea tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.596265 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6fa4f8f5-d57d-4760-8959-c5ddcec0eeea tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.596925 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6fa4f8f5-d57d-4760-8959-c5ddcec0eeea tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.612179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-6fa4f8f5-d57d-4760-8959-c5ddcec0eeea tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] HTTP exception thrown: Instance 6067cd2e-5a5e-462f-b00e-c3cf228513f2 could not be found. Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6fa4f8f5-d57d-4760-8959-c5ddcec0eeea tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Request method failure captured: Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 HTTP/1.1 Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiJU_b_qhNx6rVS938h6vsvV9AtI4i-XR5yAdXdU6OOoZd-Z4kDCSRoS58PwPQ2kAKxxwCEsSBTc9TUfQD5kEplQTGiSYPTLOal712i7HgLK-XrCq-mnXrtvM7PXrWctSEAhIHEpEfwyORDxHJ1UDiLWO2KpEY2Q0T3b4hRMe3d4gF8 Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: fe47f61a4dbf4e669ff257d299e92ee4 Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-VolumesNegativeTest-375547146 Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 14:45:05.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 14:45:05.615693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe47f61a4dbf4e669ff257d299e92ee4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fe47f61a4dbf4e669ff257d299e92ee4", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fe47f61a4dbf4e669ff257d299e92ee4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fe47f61a4dbf4e669ff257d299e92ee4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:45:05.615693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-VolumesNegativeTest-375547146 Aug 30 14:45:05.615693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: fe47f61a4dbf4e669ff257d299e92ee4 Aug 30 14:45:05.615693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-VolumesNegativeTest-375547146 Aug 30 14:45:05.615693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-VolumesNegativeTest-375547146-project Aug 30 14:45:05.615693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 14:45:05.615693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 14:45:05.615693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: 08b4f8865dd14290ab714039a2e424fb Aug 30 14:45:05.615693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-VolumesNegativeTest-375547146-project Aug 30 14:45:05.615693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 14:45:05.615693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance 6067cd2e-5a5e-462f-b00e-c3cf228513f2 could not be found. Aug 30 14:45:05.615693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': '6067cd2e-5a5e-462f-b00e-c3cf228513f2'} Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6067cd2e-5a5e-462f-b00e-c3cf228513f2 could not be found. Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:45:05.616477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6067cd2e-5a5e-462f-b00e-c3cf228513f2 could not be found. Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6067cd2e-5a5e-462f-b00e-c3cf228513f2 could not be found. Aug 30 14:45:05.617790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:45:05.619788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6fa4f8f5-d57d-4760-8959-c5ddcec0eeea tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] Returning 404 to user: Instance 6067cd2e-5a5e-462f-b00e-c3cf228513f2 could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:45:05.619788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6fa4f8f5-d57d-4760-8959-c5ddcec0eeea tempest-VolumesNegativeTest-375547146 tempest-VolumesNegativeTest-375547146-project] 10.222.0.30 "GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2" status: 404 len: 111 microversion: 2.1 time: 0.036332 Aug 30 14:45:05.623348 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 176/345] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:05 2022] GET /compute/v2.1/servers/6067cd2e-5a5e-462f-b00e-c3cf228513f2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:45:05.699456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bd02f676-5d88-42b7-b649-c4cea93264c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:05.700055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bd02f676-5d88-42b7-b649-c4cea93264c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:05.707430 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd02f676-5d88-42b7-b649-c4cea93264c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.707915 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd02f676-5d88-42b7-b649-c4cea93264c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.708662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd02f676-5d88-42b7-b649-c4cea93264c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.709512 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd02f676-5d88-42b7-b649-c4cea93264c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.710109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd02f676-5d88-42b7-b649-c4cea93264c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.710691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd02f676-5d88-42b7-b649-c4cea93264c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.760842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-aca9606a-1fb6-4e4d-a917-988ea32dcecc tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:05.761479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-aca9606a-1fb6-4e4d-a917-988ea32dcecc tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:05.773633 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aca9606a-1fb6-4e4d-a917-988ea32dcecc tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.775104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aca9606a-1fb6-4e4d-a917-988ea32dcecc tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.776152 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aca9606a-1fb6-4e4d-a917-988ea32dcecc tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.777570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aca9606a-1fb6-4e4d-a917-988ea32dcecc tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.778180 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aca9606a-1fb6-4e4d-a917-988ea32dcecc tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.778754 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aca9606a-1fb6-4e4d-a917-988ea32dcecc tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.778970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bd02f676-5d88-42b7-b649-c4cea93264c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127088) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 14:45:05.861008 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bd02f676-5d88-42b7-b649-c4cea93264c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "POST /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/action" status: 202 len: 0 microversion: 2.20 time: 0.168089 Aug 30 14:45:05.861744 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 170/346] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 14:45:05 2022] POST /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:45:05.871026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ab492a8c-d924-4780-bd11-f7c0b5a7ab1f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:05.871960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ab492a8c-d924-4780-bd11-f7c0b5a7ab1f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:05.876503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-aca9606a-1fb6-4e4d-a917-988ea32dcecc tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:05.878604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab492a8c-d924-4780-bd11-f7c0b5a7ab1f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.879083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab492a8c-d924-4780-bd11-f7c0b5a7ab1f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.879611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab492a8c-d924-4780-bd11-f7c0b5a7ab1f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.880576 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab492a8c-d924-4780-bd11-f7c0b5a7ab1f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:05.881030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab492a8c-d924-4780-bd11-f7c0b5a7ab1f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:05.881605 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab492a8c-d924-4780-bd11-f7c0b5a7ab1f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:05.885475 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-aca9606a-1fb6-4e4d-a917-988ea32dcecc tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1266 microversion: 2.1 time: 0.131091 Aug 30 14:45:05.887153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 177/347] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:05 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:06.023769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ab492a8c-d924-4780-bd11-f7c0b5a7ab1f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:06.033702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ab492a8c-d924-4780-bd11-f7c0b5a7ab1f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:06.035131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ab492a8c-d924-4780-bd11-f7c0b5a7ab1f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:06.039538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ab492a8c-d924-4780-bd11-f7c0b5a7ab1f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1748 microversion: 2.20 time: 0.170407 Aug 30 14:45:06.040352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 171/348] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:05 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1748 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:06.341029 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f4f91633-f4fa-4b73-aef9-dc736f11db6a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:06.341673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f4f91633-f4fa-4b73-aef9-dc736f11db6a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:06.347906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4f91633-f4fa-4b73-aef9-dc736f11db6a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:06.348393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4f91633-f4fa-4b73-aef9-dc736f11db6a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:06.348819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4f91633-f4fa-4b73-aef9-dc736f11db6a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:06.349521 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4f91633-f4fa-4b73-aef9-dc736f11db6a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:06.349967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4f91633-f4fa-4b73-aef9-dc736f11db6a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:06.350390 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4f91633-f4fa-4b73-aef9-dc736f11db6a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:06.534936 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f4f91633-f4fa-4b73-aef9-dc736f11db6a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:06.545425 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f4f91633-f4fa-4b73-aef9-dc736f11db6a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.211308 Aug 30 14:45:06.545997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 178/349] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:06 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:06.907201 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1342c649-72d8-4e6d-88ea-3e2da45dcc88 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:06.907685 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1342c649-72d8-4e6d-88ea-3e2da45dcc88 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:06.914465 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1342c649-72d8-4e6d-88ea-3e2da45dcc88 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:06.915236 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1342c649-72d8-4e6d-88ea-3e2da45dcc88 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:06.916202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1342c649-72d8-4e6d-88ea-3e2da45dcc88 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:06.916967 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1342c649-72d8-4e6d-88ea-3e2da45dcc88 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:06.917415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1342c649-72d8-4e6d-88ea-3e2da45dcc88 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:06.917833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1342c649-72d8-4e6d-88ea-3e2da45dcc88 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:06.985668 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1342c649-72d8-4e6d-88ea-3e2da45dcc88 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:06.995561 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1342c649-72d8-4e6d-88ea-3e2da45dcc88 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1274 microversion: 2.1 time: 0.092204 Aug 30 14:45:06.997500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 172/350] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:06 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:07.065336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c0e3eece-b06e-4163-8875-cf07d29ed9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:07.066566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c0e3eece-b06e-4163-8875-cf07d29ed9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:07.073411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0e3eece-b06e-4163-8875-cf07d29ed9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:07.073901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0e3eece-b06e-4163-8875-cf07d29ed9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:07.074331 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0e3eece-b06e-4163-8875-cf07d29ed9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:07.075185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0e3eece-b06e-4163-8875-cf07d29ed9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:07.075952 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0e3eece-b06e-4163-8875-cf07d29ed9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:07.076446 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0e3eece-b06e-4163-8875-cf07d29ed9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:07.242725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c0e3eece-b06e-4163-8875-cf07d29ed9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:07.253682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c0e3eece-b06e-4163-8875-cf07d29ed9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:07.255139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c0e3eece-b06e-4163-8875-cf07d29ed9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:07.256364 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c0e3eece-b06e-4163-8875-cf07d29ed9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1748 microversion: 2.20 time: 0.196161 Aug 30 14:45:07.256916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 179/351] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:07 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1748 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:45:07.571396 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c4fb6800-fa82-469f-8075-e567dcaf925c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:07.572936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c4fb6800-fa82-469f-8075-e567dcaf925c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:07.584070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c4fb6800-fa82-469f-8075-e567dcaf925c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:07.584543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c4fb6800-fa82-469f-8075-e567dcaf925c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:07.584969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c4fb6800-fa82-469f-8075-e567dcaf925c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:07.585670 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c4fb6800-fa82-469f-8075-e567dcaf925c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:07.586087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c4fb6800-fa82-469f-8075-e567dcaf925c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:07.586504 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c4fb6800-fa82-469f-8075-e567dcaf925c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:07.784045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c4fb6800-fa82-469f-8075-e567dcaf925c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:07.792859 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c4fb6800-fa82-469f-8075-e567dcaf925c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.225378 Aug 30 14:45:07.805715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 173/352] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:07 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:08.023087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f7beba98-01b3-4871-9e21-43804dc5bee5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:08.023932 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f7beba98-01b3-4871-9e21-43804dc5bee5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:08.031185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7beba98-01b3-4871-9e21-43804dc5bee5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:08.031705 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7beba98-01b3-4871-9e21-43804dc5bee5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:08.032182 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7beba98-01b3-4871-9e21-43804dc5bee5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:08.034225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7beba98-01b3-4871-9e21-43804dc5bee5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:08.034225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7beba98-01b3-4871-9e21-43804dc5bee5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:08.034225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7beba98-01b3-4871-9e21-43804dc5bee5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:08.113081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f7beba98-01b3-4871-9e21-43804dc5bee5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:08.124341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f7beba98-01b3-4871-9e21-43804dc5bee5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1272 microversion: 2.1 time: 0.106781 Aug 30 14:45:08.125274 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 180/353] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:08 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:08.283918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bff4d729-12f6-4e1f-a25e-f0dc16244e8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:08.284517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bff4d729-12f6-4e1f-a25e-f0dc16244e8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:08.293448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bff4d729-12f6-4e1f-a25e-f0dc16244e8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:08.294247 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bff4d729-12f6-4e1f-a25e-f0dc16244e8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:08.295033 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bff4d729-12f6-4e1f-a25e-f0dc16244e8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:08.295956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bff4d729-12f6-4e1f-a25e-f0dc16244e8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:08.297045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bff4d729-12f6-4e1f-a25e-f0dc16244e8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:08.297668 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bff4d729-12f6-4e1f-a25e-f0dc16244e8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:08.662226 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bff4d729-12f6-4e1f-a25e-f0dc16244e8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:08.679699 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bff4d729-12f6-4e1f-a25e-f0dc16244e8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:08.684922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bff4d729-12f6-4e1f-a25e-f0dc16244e8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:08.688179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bff4d729-12f6-4e1f-a25e-f0dc16244e8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1750 microversion: 2.20 time: 0.408212 Aug 30 14:45:08.688830 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 174/354] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:08 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1750 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:08.816874 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-36c14ac4-2147-4812-9ff1-a65dd6240c67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:08.817491 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-36c14ac4-2147-4812-9ff1-a65dd6240c67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:08.826717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36c14ac4-2147-4812-9ff1-a65dd6240c67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:08.830184 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36c14ac4-2147-4812-9ff1-a65dd6240c67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:08.831160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36c14ac4-2147-4812-9ff1-a65dd6240c67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:08.833333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36c14ac4-2147-4812-9ff1-a65dd6240c67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:08.834142 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36c14ac4-2147-4812-9ff1-a65dd6240c67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:08.835824 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36c14ac4-2147-4812-9ff1-a65dd6240c67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:09.061058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-36c14ac4-2147-4812-9ff1-a65dd6240c67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:09.072374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-36c14ac4-2147-4812-9ff1-a65dd6240c67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.259371 Aug 30 14:45:09.073018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 181/355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:08 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:09.149363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5bc5b1e1-d70e-4309-909f-c0cc52dd6781 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:09.151172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5bc5b1e1-d70e-4309-909f-c0cc52dd6781 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:09.183822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5bc5b1e1-d70e-4309-909f-c0cc52dd6781 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:09.184315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5bc5b1e1-d70e-4309-909f-c0cc52dd6781 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:09.184745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5bc5b1e1-d70e-4309-909f-c0cc52dd6781 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:09.185448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5bc5b1e1-d70e-4309-909f-c0cc52dd6781 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:09.191802 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5bc5b1e1-d70e-4309-909f-c0cc52dd6781 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:09.192252 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5bc5b1e1-d70e-4309-909f-c0cc52dd6781 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:09.496997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5bc5b1e1-d70e-4309-909f-c0cc52dd6781 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:09.504731 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5bc5b1e1-d70e-4309-909f-c0cc52dd6781 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.359315 Aug 30 14:45:09.505300 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 175/356] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:09 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:09.717146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5ccd2729-8049-430e-a274-179ad34c9c76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:09.717794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5ccd2729-8049-430e-a274-179ad34c9c76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:09.720269 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:09.730402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ccd2729-8049-430e-a274-179ad34c9c76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:09.731475 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ccd2729-8049-430e-a274-179ad34c9c76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:09.731922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ccd2729-8049-430e-a274-179ad34c9c76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:09.732824 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ccd2729-8049-430e-a274-179ad34c9c76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:09.733292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ccd2729-8049-430e-a274-179ad34c9c76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:09.733719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ccd2729-8049-430e-a274-179ad34c9c76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:09.878981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5ccd2729-8049-430e-a274-179ad34c9c76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:09.888237 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5ccd2729-8049-430e-a274-179ad34c9c76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:09.890476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5ccd2729-8049-430e-a274-179ad34c9c76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:09.892031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5ccd2729-8049-430e-a274-179ad34c9c76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.179933 Aug 30 14:45:09.892596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 182/357] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:09 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:10.092812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-148bb44b-0829-4212-9315-6234e9c45a34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:10.093632 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-148bb44b-0829-4212-9315-6234e9c45a34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:10.116974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-148bb44b-0829-4212-9315-6234e9c45a34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:10.117457 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-148bb44b-0829-4212-9315-6234e9c45a34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:10.117895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-148bb44b-0829-4212-9315-6234e9c45a34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:10.118604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-148bb44b-0829-4212-9315-6234e9c45a34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:10.119147 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-148bb44b-0829-4212-9315-6234e9c45a34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:10.119933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-148bb44b-0829-4212-9315-6234e9c45a34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:10.154966 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-6386e772-2dda-4aad-a13a-afeb07da369b req-73e35aec-67d2-4b04-bc70-1b4dfafeeb8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42bd75a4-4d0a-4ff5-92e6-0b6c222a3744", "tag": "4bb27bf9-4d67-42eb-ae1a-3b416edc85fb"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:10.175415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-6386e772-2dda-4aad-a13a-afeb07da369b req-73e35aec-67d2-4b04-bc70-1b4dfafeeb8a service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:10.180546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-6386e772-2dda-4aad-a13a-afeb07da369b req-73e35aec-67d2-4b04-bc70-1b4dfafeeb8a service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:10.181008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-6386e772-2dda-4aad-a13a-afeb07da369b req-73e35aec-67d2-4b04-bc70-1b4dfafeeb8a service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:10.194023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-6386e772-2dda-4aad-a13a-afeb07da369b req-73e35aec-67d2-4b04-bc70-1b4dfafeeb8a service nova] Creating event network-changed:4bb27bf9-4d67-42eb-ae1a-3b416edc85fb for instance 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 on hv-cinder-82880 Aug 30 14:45:10.200179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-6386e772-2dda-4aad-a13a-afeb07da369b req-73e35aec-67d2-4b04-bc70-1b4dfafeeb8a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048934 Aug 30 14:45:10.201663 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 183/358] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:45:10.284184 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-ee2e7d40-0a8f-4696-a561-4774e26d9055 req-e204b950-364f-40a4-b884-92fc3f20949b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42a99ef-987b-4b7f-a6ef-5458fccc5c52", "name": "network-vif-plugged", "status": "completed", "tag": "de9192f0-7fd0-49c1-8393-b52baf316782"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:10.299391 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-ee2e7d40-0a8f-4696-a561-4774e26d9055 req-e204b950-364f-40a4-b884-92fc3f20949b service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:10.300687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-ee2e7d40-0a8f-4696-a561-4774e26d9055 req-e204b950-364f-40a4-b884-92fc3f20949b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:10.301357 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-ee2e7d40-0a8f-4696-a561-4774e26d9055 req-e204b950-364f-40a4-b884-92fc3f20949b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:10.316953 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-ee2e7d40-0a8f-4696-a561-4774e26d9055 req-e204b950-364f-40a4-b884-92fc3f20949b service nova] Creating event network-vif-plugged:de9192f0-7fd0-49c1-8393-b52baf316782 for instance e42a99ef-987b-4b7f-a6ef-5458fccc5c52 on hv-cinder-82880 Aug 30 14:45:10.322501 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-ee2e7d40-0a8f-4696-a561-4774e26d9055 req-e204b950-364f-40a4-b884-92fc3f20949b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042399 Aug 30 14:45:10.323460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 184/359] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:45:10.527608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-20cf44ca-a586-4ec6-8a16-f0846653467b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:10.528967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-20cf44ca-a586-4ec6-8a16-f0846653467b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:10.538229 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20cf44ca-a586-4ec6-8a16-f0846653467b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:10.540992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20cf44ca-a586-4ec6-8a16-f0846653467b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:10.541843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20cf44ca-a586-4ec6-8a16-f0846653467b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:10.542968 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20cf44ca-a586-4ec6-8a16-f0846653467b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:10.543856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20cf44ca-a586-4ec6-8a16-f0846653467b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:10.544299 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-148bb44b-0829-4212-9315-6234e9c45a34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:10.545567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20cf44ca-a586-4ec6-8a16-f0846653467b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:10.559782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-148bb44b-0829-4212-9315-6234e9c45a34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.468407 Aug 30 14:45:10.560804 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 176/360] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:10 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:10.782348 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-20cf44ca-a586-4ec6-8a16-f0846653467b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:10.790816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-20cf44ca-a586-4ec6-8a16-f0846653467b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.268516 Aug 30 14:45:10.791755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 185/361] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:10 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:10.915016 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-91045c42-e9f1-4a65-b62e-35e659b6a80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:10.915759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-91045c42-e9f1-4a65-b62e-35e659b6a80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:10.921763 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91045c42-e9f1-4a65-b62e-35e659b6a80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:10.922262 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91045c42-e9f1-4a65-b62e-35e659b6a80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:10.922680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91045c42-e9f1-4a65-b62e-35e659b6a80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:10.923404 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91045c42-e9f1-4a65-b62e-35e659b6a80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:10.923860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91045c42-e9f1-4a65-b62e-35e659b6a80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:10.924281 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91045c42-e9f1-4a65-b62e-35e659b6a80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:11.090277 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-91045c42-e9f1-4a65-b62e-35e659b6a80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:11.100443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-91045c42-e9f1-4a65-b62e-35e659b6a80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:11.101874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-91045c42-e9f1-4a65-b62e-35e659b6a80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:11.103545 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-91045c42-e9f1-4a65-b62e-35e659b6a80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.191902 Aug 30 14:45:11.104322 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 177/362] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:10 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:11.581681 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-da5e95e5-446a-42bb-a885-02101594ecb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:11.582293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-da5e95e5-446a-42bb-a885-02101594ecb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:11.588836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da5e95e5-446a-42bb-a885-02101594ecb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:11.589322 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da5e95e5-446a-42bb-a885-02101594ecb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:11.589754 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da5e95e5-446a-42bb-a885-02101594ecb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:11.590487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da5e95e5-446a-42bb-a885-02101594ecb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:11.590942 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da5e95e5-446a-42bb-a885-02101594ecb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:11.591392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da5e95e5-446a-42bb-a885-02101594ecb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:11.731550 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-da5e95e5-446a-42bb-a885-02101594ecb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:11.739233 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-da5e95e5-446a-42bb-a885-02101594ecb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.161369 Aug 30 14:45:11.739883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 186/363] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:11 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:11.811450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-07be05c3-f213-4c69-a9e3-dd098c163261 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:11.812063 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-07be05c3-f213-4c69-a9e3-dd098c163261 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:11.818652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07be05c3-f213-4c69-a9e3-dd098c163261 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:11.819137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07be05c3-f213-4c69-a9e3-dd098c163261 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:11.819594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07be05c3-f213-4c69-a9e3-dd098c163261 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:11.820280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07be05c3-f213-4c69-a9e3-dd098c163261 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:11.820725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07be05c3-f213-4c69-a9e3-dd098c163261 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:11.821142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07be05c3-f213-4c69-a9e3-dd098c163261 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:11.998157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-07be05c3-f213-4c69-a9e3-dd098c163261 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:12.006820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-07be05c3-f213-4c69-a9e3-dd098c163261 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.198993 Aug 30 14:45:12.007506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 178/364] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:11 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:12.127399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1dcc5c50-8b13-4fe9-9aef-ebff1c74671c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:12.128007 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1dcc5c50-8b13-4fe9-9aef-ebff1c74671c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:12.134930 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1dcc5c50-8b13-4fe9-9aef-ebff1c74671c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:12.136179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1dcc5c50-8b13-4fe9-9aef-ebff1c74671c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:12.136648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1dcc5c50-8b13-4fe9-9aef-ebff1c74671c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:12.137349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1dcc5c50-8b13-4fe9-9aef-ebff1c74671c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:12.137797 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1dcc5c50-8b13-4fe9-9aef-ebff1c74671c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:12.138225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1dcc5c50-8b13-4fe9-9aef-ebff1c74671c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:12.276343 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1dcc5c50-8b13-4fe9-9aef-ebff1c74671c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:12.286702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1dcc5c50-8b13-4fe9-9aef-ebff1c74671c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:12.288704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1dcc5c50-8b13-4fe9-9aef-ebff1c74671c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:12.290436 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1dcc5c50-8b13-4fe9-9aef-ebff1c74671c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.167132 Aug 30 14:45:12.291395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 187/365] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:12 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:12.760911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-44c73b05-491c-4025-a4e1-eca5fb7bf2a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:12.761679 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-44c73b05-491c-4025-a4e1-eca5fb7bf2a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:12.767657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-44c73b05-491c-4025-a4e1-eca5fb7bf2a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:12.768142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-44c73b05-491c-4025-a4e1-eca5fb7bf2a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:12.768575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-44c73b05-491c-4025-a4e1-eca5fb7bf2a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:12.769267 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-44c73b05-491c-4025-a4e1-eca5fb7bf2a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:12.769780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-44c73b05-491c-4025-a4e1-eca5fb7bf2a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:12.770209 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-44c73b05-491c-4025-a4e1-eca5fb7bf2a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:12.908682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-44c73b05-491c-4025-a4e1-eca5fb7bf2a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:12.917034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-44c73b05-491c-4025-a4e1-eca5fb7bf2a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.161119 Aug 30 14:45:12.917601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 179/366] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:12 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:13.028828 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-95bbdac9-e0cb-4283-a4de-0d0998e34353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:13.029746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-95bbdac9-e0cb-4283-a4de-0d0998e34353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:13.036660 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95bbdac9-e0cb-4283-a4de-0d0998e34353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:13.037330 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95bbdac9-e0cb-4283-a4de-0d0998e34353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:13.037734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95bbdac9-e0cb-4283-a4de-0d0998e34353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:13.038497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95bbdac9-e0cb-4283-a4de-0d0998e34353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:13.039028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95bbdac9-e0cb-4283-a4de-0d0998e34353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:13.039585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95bbdac9-e0cb-4283-a4de-0d0998e34353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:13.177420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-95bbdac9-e0cb-4283-a4de-0d0998e34353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:13.184895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-95bbdac9-e0cb-4283-a4de-0d0998e34353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.160923 Aug 30 14:45:13.185463 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 188/367] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:13 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:13.314226 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-45329c2c-f0e9-4fb1-9845-6097896741e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:13.314821 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-45329c2c-f0e9-4fb1-9845-6097896741e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:13.321017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45329c2c-f0e9-4fb1-9845-6097896741e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:13.321518 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45329c2c-f0e9-4fb1-9845-6097896741e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:13.321978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45329c2c-f0e9-4fb1-9845-6097896741e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:13.322661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45329c2c-f0e9-4fb1-9845-6097896741e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:13.323097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45329c2c-f0e9-4fb1-9845-6097896741e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:13.323547 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45329c2c-f0e9-4fb1-9845-6097896741e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:13.452809 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45329c2c-f0e9-4fb1-9845-6097896741e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:13.461293 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45329c2c-f0e9-4fb1-9845-6097896741e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:13.463610 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45329c2c-f0e9-4fb1-9845-6097896741e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:13.464823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-45329c2c-f0e9-4fb1-9845-6097896741e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.154458 Aug 30 14:45:13.465383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 180/368] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:13 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:13.937380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4aa26c9a-b96f-473d-be2b-615ea7b3b03b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:13.937981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4aa26c9a-b96f-473d-be2b-615ea7b3b03b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:13.944226 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4aa26c9a-b96f-473d-be2b-615ea7b3b03b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:13.944702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4aa26c9a-b96f-473d-be2b-615ea7b3b03b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:13.945127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4aa26c9a-b96f-473d-be2b-615ea7b3b03b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:13.945806 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4aa26c9a-b96f-473d-be2b-615ea7b3b03b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:13.946251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4aa26c9a-b96f-473d-be2b-615ea7b3b03b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:13.946699 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4aa26c9a-b96f-473d-be2b-615ea7b3b03b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:14.079950 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4aa26c9a-b96f-473d-be2b-615ea7b3b03b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:14.088172 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4aa26c9a-b96f-473d-be2b-615ea7b3b03b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.154645 Aug 30 14:45:14.088864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 189/369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:13 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:14.181166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1990234993", "imageRef": "fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b", "flavorRef": "452", "networks": [{"uuid": "96f6001b-c30d-4387-9146-9de54fd2f128"}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:14.205984 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d660bea3-2ad9-4bd3-8cec-12a9e4140212 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:14.206669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d660bea3-2ad9-4bd3-8cec-12a9e4140212 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:14.212648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d660bea3-2ad9-4bd3-8cec-12a9e4140212 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:14.213987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d660bea3-2ad9-4bd3-8cec-12a9e4140212 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:14.214591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d660bea3-2ad9-4bd3-8cec-12a9e4140212 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:14.215490 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d660bea3-2ad9-4bd3-8cec-12a9e4140212 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:14.215945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d660bea3-2ad9-4bd3-8cec-12a9e4140212 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:14.216527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d660bea3-2ad9-4bd3-8cec-12a9e4140212 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:14.219521 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:14.252279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] validate_networks() for [('96f6001b-c30d-4387-9146-9de54fd2f128', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:45:14.366246 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d660bea3-2ad9-4bd3-8cec-12a9e4140212 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:14.374745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d660bea3-2ad9-4bd3-8cec-12a9e4140212 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.172484 Aug 30 14:45:14.375345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 190/370] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:14 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:14.487921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e15d1c16-56a4-48fd-9b59-577b7c58f824 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:14.488537 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e15d1c16-56a4-48fd-9b59-577b7c58f824 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:14.496487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e15d1c16-56a4-48fd-9b59-577b7c58f824 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:14.497251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e15d1c16-56a4-48fd-9b59-577b7c58f824 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:14.497894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e15d1c16-56a4-48fd-9b59-577b7c58f824 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:14.498811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e15d1c16-56a4-48fd-9b59-577b7c58f824 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:14.499535 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e15d1c16-56a4-48fd-9b59-577b7c58f824 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:14.500178 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e15d1c16-56a4-48fd-9b59-577b7c58f824 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:14.545015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:14.576514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=12 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:14.674179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:45:14.674593 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:45:14.675066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:45:14.675483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:45:14.675883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:45:14.688431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e15d1c16-56a4-48fd-9b59-577b7c58f824 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:14.696105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:14.696597 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:14.697802 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:14.698742 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:14.699240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:14.699669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:14.700853 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e15d1c16-56a4-48fd-9b59-577b7c58f824 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:14.703093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e15d1c16-56a4-48fd-9b59-577b7c58f824 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:14.704675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e15d1c16-56a4-48fd-9b59-577b7c58f824 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.220712 Aug 30 14:45:14.705691 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 191/371] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:14 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:45:14.715082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:14.722489 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Getting quotas for project 1bfe11f6c0da4508b94a01afb80c8483. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:45:14.727060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Getting quotas for user 6fac2f6b6c124ddf99a888aa0c30f83b and project 1bfe11f6c0da4508b94a01afb80c8483. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:45:14.739350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:45:14.741488 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:45:14.787564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cb7fb89f-9bcb-4cff-9678-10612acd3c44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610035 Aug 30 14:45:14.788380 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 181/372] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 14:45:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:45:14.800124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-192ed518-7a48-407f-a1fe-76d5020d58af tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:14.800571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-192ed518-7a48-407f-a1fe-76d5020d58af tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:14.802413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=8 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:14.859378 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-192ed518-7a48-407f-a1fe-76d5020d58af tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:14.866871 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-192ed518-7a48-407f-a1fe-76d5020d58af tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1219 microversion: 2.1 time: 0.071156 Aug 30 14:45:14.867766 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 192/373] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:14 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:15.108785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-68876939-5b44-41d6-9e7b-8840096de9f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:15.109398 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-68876939-5b44-41d6-9e7b-8840096de9f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:15.115884 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68876939-5b44-41d6-9e7b-8840096de9f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:15.116367 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68876939-5b44-41d6-9e7b-8840096de9f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:15.116799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68876939-5b44-41d6-9e7b-8840096de9f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:15.117489 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68876939-5b44-41d6-9e7b-8840096de9f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:15.117938 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68876939-5b44-41d6-9e7b-8840096de9f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:15.118372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68876939-5b44-41d6-9e7b-8840096de9f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:15.137292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:15.255694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-68876939-5b44-41d6-9e7b-8840096de9f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:15.264153 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-68876939-5b44-41d6-9e7b-8840096de9f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.159464 Aug 30 14:45:15.264723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 182/374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:15 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:15.395192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ecbc12f4-8848-4457-a47d-867620d05d8b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:15.395753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ecbc12f4-8848-4457-a47d-867620d05d8b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:15.401900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ecbc12f4-8848-4457-a47d-867620d05d8b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:15.402372 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ecbc12f4-8848-4457-a47d-867620d05d8b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:15.402801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ecbc12f4-8848-4457-a47d-867620d05d8b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:15.403519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ecbc12f4-8848-4457-a47d-867620d05d8b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:15.403966 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ecbc12f4-8848-4457-a47d-867620d05d8b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:15.404381 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ecbc12f4-8848-4457-a47d-867620d05d8b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:15.559532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ecbc12f4-8848-4457-a47d-867620d05d8b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:15.568493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ecbc12f4-8848-4457-a47d-867620d05d8b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.177236 Aug 30 14:45:15.569635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 193/375] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:15 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:15.729928 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-92ffd3ca-6ac4-414c-9170-1200922bc286 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:15.730820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-92ffd3ca-6ac4-414c-9170-1200922bc286 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:15.737033 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92ffd3ca-6ac4-414c-9170-1200922bc286 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:15.737515 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92ffd3ca-6ac4-414c-9170-1200922bc286 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:15.737944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92ffd3ca-6ac4-414c-9170-1200922bc286 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:15.738876 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92ffd3ca-6ac4-414c-9170-1200922bc286 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:15.739532 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92ffd3ca-6ac4-414c-9170-1200922bc286 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:15.740092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92ffd3ca-6ac4-414c-9170-1200922bc286 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:15.879194 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-92ffd3ca-6ac4-414c-9170-1200922bc286 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:15.887795 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b9d9d804-2b13-4c79-8262-6cab8f41a046 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:15.888502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-92ffd3ca-6ac4-414c-9170-1200922bc286 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:15.888633 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b9d9d804-2b13-4c79-8262-6cab8f41a046 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:15.889957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-92ffd3ca-6ac4-414c-9170-1200922bc286 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:15.891320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-92ffd3ca-6ac4-414c-9170-1200922bc286 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.166027 Aug 30 14:45:15.891878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 183/376] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:15 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:15.894823 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b9d9d804-2b13-4c79-8262-6cab8f41a046 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:15.895410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b9d9d804-2b13-4c79-8262-6cab8f41a046 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:15.895923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b9d9d804-2b13-4c79-8262-6cab8f41a046 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:15.896606 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b9d9d804-2b13-4c79-8262-6cab8f41a046 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:15.897216 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b9d9d804-2b13-4c79-8262-6cab8f41a046 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:15.897788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b9d9d804-2b13-4c79-8262-6cab8f41a046 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:15.968912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b9d9d804-2b13-4c79-8262-6cab8f41a046 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:15.977105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b9d9d804-2b13-4c79-8262-6cab8f41a046 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1223 microversion: 2.1 time: 0.093464 Aug 30 14:45:15.990042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 194/377] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:15 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:16.284981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3e30f37a-cf0d-4efd-8676-47f11e2eb303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:16.286091 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3e30f37a-cf0d-4efd-8676-47f11e2eb303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:16.293483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e30f37a-cf0d-4efd-8676-47f11e2eb303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:16.294852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e30f37a-cf0d-4efd-8676-47f11e2eb303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:16.295638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e30f37a-cf0d-4efd-8676-47f11e2eb303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:16.297236 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e30f37a-cf0d-4efd-8676-47f11e2eb303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:16.298020 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e30f37a-cf0d-4efd-8676-47f11e2eb303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:16.298684 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e30f37a-cf0d-4efd-8676-47f11e2eb303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:16.494103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3e30f37a-cf0d-4efd-8676-47f11e2eb303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:16.503471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3e30f37a-cf0d-4efd-8676-47f11e2eb303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.222350 Aug 30 14:45:16.505260 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 184/378] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:16 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:16.590268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-eb2436b1-f555-41ec-8190-30535bf8198f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:16.590923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-eb2436b1-f555-41ec-8190-30535bf8198f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:16.597510 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eb2436b1-f555-41ec-8190-30535bf8198f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:16.597995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eb2436b1-f555-41ec-8190-30535bf8198f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:16.598426 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eb2436b1-f555-41ec-8190-30535bf8198f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:16.599117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eb2436b1-f555-41ec-8190-30535bf8198f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:16.599721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eb2436b1-f555-41ec-8190-30535bf8198f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:16.600145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eb2436b1-f555-41ec-8190-30535bf8198f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:16.750639 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-eb2436b1-f555-41ec-8190-30535bf8198f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:16.758442 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-eb2436b1-f555-41ec-8190-30535bf8198f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.172390 Aug 30 14:45:16.759014 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 195/379] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:16 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:16.921500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1adb5f80-00d4-44c0-9ba7-2e850f21ab68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:16.922492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1adb5f80-00d4-44c0-9ba7-2e850f21ab68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:16.928982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1adb5f80-00d4-44c0-9ba7-2e850f21ab68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:16.929841 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1adb5f80-00d4-44c0-9ba7-2e850f21ab68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:16.930632 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1adb5f80-00d4-44c0-9ba7-2e850f21ab68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:16.932118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1adb5f80-00d4-44c0-9ba7-2e850f21ab68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:16.933052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1adb5f80-00d4-44c0-9ba7-2e850f21ab68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:16.933772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1adb5f80-00d4-44c0-9ba7-2e850f21ab68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:16.999301 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-caf19176-611d-4c0a-b35b-c72bb094484d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:17.000393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-caf19176-611d-4c0a-b35b-c72bb094484d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:17.006755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-caf19176-611d-4c0a-b35b-c72bb094484d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:17.007502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-caf19176-611d-4c0a-b35b-c72bb094484d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:17.008653 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-caf19176-611d-4c0a-b35b-c72bb094484d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:17.009437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-caf19176-611d-4c0a-b35b-c72bb094484d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:17.010131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-caf19176-611d-4c0a-b35b-c72bb094484d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:17.010451 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-caf19176-611d-4c0a-b35b-c72bb094484d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:17.079509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-caf19176-611d-4c0a-b35b-c72bb094484d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:17.080798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1adb5f80-00d4-44c0-9ba7-2e850f21ab68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:17.087779 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-caf19176-611d-4c0a-b35b-c72bb094484d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1223 microversion: 2.1 time: 0.092177 Aug 30 14:45:17.088353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 196/380] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:16 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:17.090408 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1adb5f80-00d4-44c0-9ba7-2e850f21ab68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:17.091906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1adb5f80-00d4-44c0-9ba7-2e850f21ab68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:17.093056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1adb5f80-00d4-44c0-9ba7-2e850f21ab68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.181645 Aug 30 14:45:17.093600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 185/381] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:16 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:17.526469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-523e4883-c0e4-4168-a418-9b96fd112afa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:17.526991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-523e4883-c0e4-4168-a418-9b96fd112afa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:17.533976 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-523e4883-c0e4-4168-a418-9b96fd112afa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:17.534474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-523e4883-c0e4-4168-a418-9b96fd112afa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:17.534878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-523e4883-c0e4-4168-a418-9b96fd112afa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:17.535612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-523e4883-c0e4-4168-a418-9b96fd112afa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:17.536032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-523e4883-c0e4-4168-a418-9b96fd112afa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:17.536444 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-523e4883-c0e4-4168-a418-9b96fd112afa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:17.668135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-523e4883-c0e4-4168-a418-9b96fd112afa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:17.678866 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-523e4883-c0e4-4168-a418-9b96fd112afa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.156404 Aug 30 14:45:17.679670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 197/382] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:17 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:17.780115 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7f503b75-ffb2-4b32-81dc-51b57112191b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:17.781576 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7f503b75-ffb2-4b32-81dc-51b57112191b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:17.788493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f503b75-ffb2-4b32-81dc-51b57112191b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:17.789007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f503b75-ffb2-4b32-81dc-51b57112191b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:17.789443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f503b75-ffb2-4b32-81dc-51b57112191b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:17.790138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f503b75-ffb2-4b32-81dc-51b57112191b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:17.790836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f503b75-ffb2-4b32-81dc-51b57112191b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:17.791386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f503b75-ffb2-4b32-81dc-51b57112191b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:18.161634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-73344103-f953-4bd6-8ba9-4c145f954c1e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:18.169169 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-73344103-f953-4bd6-8ba9-4c145f954c1e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:18.186235 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7f503b75-ffb2-4b32-81dc-51b57112191b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:18.187047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73344103-f953-4bd6-8ba9-4c145f954c1e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:18.194645 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73344103-f953-4bd6-8ba9-4c145f954c1e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:18.194946 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7f503b75-ffb2-4b32-81dc-51b57112191b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.418817 Aug 30 14:45:18.195467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73344103-f953-4bd6-8ba9-4c145f954c1e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:18.196240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 186/383] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:17 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:18.196506 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73344103-f953-4bd6-8ba9-4c145f954c1e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:18.197399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73344103-f953-4bd6-8ba9-4c145f954c1e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:18.197829 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73344103-f953-4bd6-8ba9-4c145f954c1e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:18.201502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c0c80412-ac0b-4c9e-bb54-09cb93345846 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:18.202284 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c0c80412-ac0b-4c9e-bb54-09cb93345846 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:18.217197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0c80412-ac0b-4c9e-bb54-09cb93345846 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:18.217889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0c80412-ac0b-4c9e-bb54-09cb93345846 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:18.226649 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0c80412-ac0b-4c9e-bb54-09cb93345846 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:18.227728 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0c80412-ac0b-4c9e-bb54-09cb93345846 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:18.228878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0c80412-ac0b-4c9e-bb54-09cb93345846 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:18.229462 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0c80412-ac0b-4c9e-bb54-09cb93345846 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:18.322576 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-73344103-f953-4bd6-8ba9-4c145f954c1e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:18.337050 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-73344103-f953-4bd6-8ba9-4c145f954c1e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1223 microversion: 2.1 time: 0.219832 Aug 30 14:45:18.344610 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 198/384] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:18 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1223 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:18.507745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0c80412-ac0b-4c9e-bb54-09cb93345846 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:18.544814 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0c80412-ac0b-4c9e-bb54-09cb93345846 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:18.548171 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0c80412-ac0b-4c9e-bb54-09cb93345846 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:18.549391 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c0c80412-ac0b-4c9e-bb54-09cb93345846 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.351871 Aug 30 14:45:18.549965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 187/385] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:18 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:18.570513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-72a89058-0899-48cb-ac3c-62ed5bef8608 req-443c7386-fa01-49e1-ab07-4eb811570f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bd75a4-4d0a-4ff5-92e6-0b6c222a3744", "name": "network-vif-plugged", "status": "completed", "tag": "4bb27bf9-4d67-42eb-ae1a-3b416edc85fb"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:18.608799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-72a89058-0899-48cb-ac3c-62ed5bef8608 req-443c7386-fa01-49e1-ab07-4eb811570f2b service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:18.610489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-72a89058-0899-48cb-ac3c-62ed5bef8608 req-443c7386-fa01-49e1-ab07-4eb811570f2b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:18.611565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-72a89058-0899-48cb-ac3c-62ed5bef8608 req-443c7386-fa01-49e1-ab07-4eb811570f2b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:18.635613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-72a89058-0899-48cb-ac3c-62ed5bef8608 req-443c7386-fa01-49e1-ab07-4eb811570f2b service nova] Creating event network-vif-plugged:4bb27bf9-4d67-42eb-ae1a-3b416edc85fb for instance 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 on hv-cinder-82880 Aug 30 14:45:18.664675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-72a89058-0899-48cb-ac3c-62ed5bef8608 req-443c7386-fa01-49e1-ab07-4eb811570f2b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102518 Aug 30 14:45:18.665826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 199/386] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:45:18.701353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1a83de84-c516-41ab-852a-50bde24b91fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:18.702035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1a83de84-c516-41ab-852a-50bde24b91fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:18.709862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a83de84-c516-41ab-852a-50bde24b91fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:18.710360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a83de84-c516-41ab-852a-50bde24b91fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:18.710803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a83de84-c516-41ab-852a-50bde24b91fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:18.711592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a83de84-c516-41ab-852a-50bde24b91fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:18.712051 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a83de84-c516-41ab-852a-50bde24b91fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:18.713596 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a83de84-c516-41ab-852a-50bde24b91fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:18.848143 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1a83de84-c516-41ab-852a-50bde24b91fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:18.855986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1a83de84-c516-41ab-852a-50bde24b91fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.159388 Aug 30 14:45:18.856753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 188/387] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:18 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:19.230634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d7d996a6-f16e-4d55-854c-93c4a9abf206 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:19.231355 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d7d996a6-f16e-4d55-854c-93c4a9abf206 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:19.233345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:19.238805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d7d996a6-f16e-4d55-854c-93c4a9abf206 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:19.239279 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d7d996a6-f16e-4d55-854c-93c4a9abf206 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:19.239734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d7d996a6-f16e-4d55-854c-93c4a9abf206 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:19.240418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d7d996a6-f16e-4d55-854c-93c4a9abf206 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:19.240875 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d7d996a6-f16e-4d55-854c-93c4a9abf206 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:19.241293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d7d996a6-f16e-4d55-854c-93c4a9abf206 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:19.365945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8dd468f6-0f75-4a42-ba92-2a7473493f3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:19.366943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8dd468f6-0f75-4a42-ba92-2a7473493f3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:19.375042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dd468f6-0f75-4a42-ba92-2a7473493f3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:19.375915 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dd468f6-0f75-4a42-ba92-2a7473493f3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:19.376593 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dd468f6-0f75-4a42-ba92-2a7473493f3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:19.377508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dd468f6-0f75-4a42-ba92-2a7473493f3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:19.378324 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dd468f6-0f75-4a42-ba92-2a7473493f3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:19.378967 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dd468f6-0f75-4a42-ba92-2a7473493f3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:19.401755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d7d996a6-f16e-4d55-854c-93c4a9abf206 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:19.410694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d7d996a6-f16e-4d55-854c-93c4a9abf206 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.184024 Aug 30 14:45:19.411757 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 200/388] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:19 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:19.445137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8dd468f6-0f75-4a42-ba92-2a7473493f3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:19.452799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8dd468f6-0f75-4a42-ba92-2a7473493f3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1223 microversion: 2.1 time: 0.091120 Aug 30 14:45:19.453368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 189/389] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:19 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:19.594279 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4665ce06-d520-4dc5-ad65-02f5cded3236 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:19.594890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4665ce06-d520-4dc5-ad65-02f5cded3236 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:19.600815 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4665ce06-d520-4dc5-ad65-02f5cded3236 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:19.601298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4665ce06-d520-4dc5-ad65-02f5cded3236 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:19.601738 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4665ce06-d520-4dc5-ad65-02f5cded3236 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:19.602422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4665ce06-d520-4dc5-ad65-02f5cded3236 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:19.603446 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4665ce06-d520-4dc5-ad65-02f5cded3236 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:19.604027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4665ce06-d520-4dc5-ad65-02f5cded3236 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:19.743322 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4665ce06-d520-4dc5-ad65-02f5cded3236 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:19.776763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4665ce06-d520-4dc5-ad65-02f5cded3236 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:19.778225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4665ce06-d520-4dc5-ad65-02f5cded3236 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:19.783508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4665ce06-d520-4dc5-ad65-02f5cded3236 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.189153 Aug 30 14:45:19.785533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 201/390] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:19 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:19.878162 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-44ab8e11-2c34-4850-a9f0-81655f415538 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:19.878868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-44ab8e11-2c34-4850-a9f0-81655f415538 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:19.885231 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-44ab8e11-2c34-4850-a9f0-81655f415538 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:19.885806 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-44ab8e11-2c34-4850-a9f0-81655f415538 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:19.886317 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-44ab8e11-2c34-4850-a9f0-81655f415538 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:19.887109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-44ab8e11-2c34-4850-a9f0-81655f415538 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:19.887654 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-44ab8e11-2c34-4850-a9f0-81655f415538 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:19.888152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-44ab8e11-2c34-4850-a9f0-81655f415538 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:20.037856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-44ab8e11-2c34-4850-a9f0-81655f415538 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:20.050682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-44ab8e11-2c34-4850-a9f0-81655f415538 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.176481 Aug 30 14:45:20.052577 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 190/391] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:19 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:20.432425 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f60ce0e5-3231-4ac6-b782-188503809af4 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:20.433100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f60ce0e5-3231-4ac6-b782-188503809af4 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:20.442027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f60ce0e5-3231-4ac6-b782-188503809af4 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:20.442511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f60ce0e5-3231-4ac6-b782-188503809af4 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:20.442939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f60ce0e5-3231-4ac6-b782-188503809af4 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:20.451460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f60ce0e5-3231-4ac6-b782-188503809af4 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:20.452102 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f60ce0e5-3231-4ac6-b782-188503809af4 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:20.452621 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f60ce0e5-3231-4ac6-b782-188503809af4 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:20.476817 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-25b43bd9-c577-4bff-b8e7-559183d70bf5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:20.478030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-25b43bd9-c577-4bff-b8e7-559183d70bf5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:20.486735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25b43bd9-c577-4bff-b8e7-559183d70bf5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:20.487615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25b43bd9-c577-4bff-b8e7-559183d70bf5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:20.488281 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25b43bd9-c577-4bff-b8e7-559183d70bf5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:20.489579 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25b43bd9-c577-4bff-b8e7-559183d70bf5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:20.490236 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25b43bd9-c577-4bff-b8e7-559183d70bf5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:20.490868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25b43bd9-c577-4bff-b8e7-559183d70bf5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:20.594200 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-25b43bd9-c577-4bff-b8e7-559183d70bf5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:20.605421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-25b43bd9-c577-4bff-b8e7-559183d70bf5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1223 microversion: 2.1 time: 0.134937 Aug 30 14:45:20.619170 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 191/392] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:20 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1223 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:20.637085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f60ce0e5-3231-4ac6-b782-188503809af4 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:20.645288 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f60ce0e5-3231-4ac6-b782-188503809af4 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.216629 Aug 30 14:45:20.645881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 202/393] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:20 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:20.811098 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fdc9efe3-c9e2-4520-8cb8-29a8d482a76c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:20.812105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fdc9efe3-c9e2-4520-8cb8-29a8d482a76c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:20.818488 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdc9efe3-c9e2-4520-8cb8-29a8d482a76c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:20.819044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdc9efe3-c9e2-4520-8cb8-29a8d482a76c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:20.819580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdc9efe3-c9e2-4520-8cb8-29a8d482a76c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:20.820268 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdc9efe3-c9e2-4520-8cb8-29a8d482a76c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:20.820714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdc9efe3-c9e2-4520-8cb8-29a8d482a76c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:20.821129 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdc9efe3-c9e2-4520-8cb8-29a8d482a76c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:20.950927 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fdc9efe3-c9e2-4520-8cb8-29a8d482a76c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:20.959326 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fdc9efe3-c9e2-4520-8cb8-29a8d482a76c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:20.960752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fdc9efe3-c9e2-4520-8cb8-29a8d482a76c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:20.961982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fdc9efe3-c9e2-4520-8cb8-29a8d482a76c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.155841 Aug 30 14:45:20.962835 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 192/394] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:20 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:21.073441 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-dc31e162-ef64-446d-978f-9c54293936fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:21.074054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-dc31e162-ef64-446d-978f-9c54293936fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:21.080028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc31e162-ef64-446d-978f-9c54293936fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.080517 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc31e162-ef64-446d-978f-9c54293936fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.080957 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc31e162-ef64-446d-978f-9c54293936fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:21.081648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc31e162-ef64-446d-978f-9c54293936fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.082100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc31e162-ef64-446d-978f-9c54293936fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.082524 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc31e162-ef64-446d-978f-9c54293936fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:21.218068 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-dc31e162-ef64-446d-978f-9c54293936fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:21.227358 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-dc31e162-ef64-446d-978f-9c54293936fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.157777 Aug 30 14:45:21.241265 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 203/395] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:21 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:21.626937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-13a3f505-b917-42ac-afdd-b5ac734105e3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:21.627578 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-13a3f505-b917-42ac-afdd-b5ac734105e3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:21.633738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a3f505-b917-42ac-afdd-b5ac734105e3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.634741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a3f505-b917-42ac-afdd-b5ac734105e3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.635176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a3f505-b917-42ac-afdd-b5ac734105e3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:21.635897 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a3f505-b917-42ac-afdd-b5ac734105e3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.636345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a3f505-b917-42ac-afdd-b5ac734105e3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.636765 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13a3f505-b917-42ac-afdd-b5ac734105e3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:21.666196 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-08a321da-ee48-407d-a895-efe04240bf56 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:21.666793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-08a321da-ee48-407d-a895-efe04240bf56 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:21.673641 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08a321da-ee48-407d-a895-efe04240bf56 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.674138 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08a321da-ee48-407d-a895-efe04240bf56 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.678683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08a321da-ee48-407d-a895-efe04240bf56 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:21.679472 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08a321da-ee48-407d-a895-efe04240bf56 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.679943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08a321da-ee48-407d-a895-efe04240bf56 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.680376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08a321da-ee48-407d-a895-efe04240bf56 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:21.718122 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-13a3f505-b917-42ac-afdd-b5ac734105e3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:21.728587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-13a3f505-b917-42ac-afdd-b5ac734105e3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1223 microversion: 2.1 time: 0.106210 Aug 30 14:45:21.742459 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 193/396] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:21 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:21.831518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-08a321da-ee48-407d-a895-efe04240bf56 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:21.840282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-08a321da-ee48-407d-a895-efe04240bf56 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.177879 Aug 30 14:45:21.840872 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 204/397] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:21 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:21.984785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6e920d76-0b40-4a02-b919-f13360b98b6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:21.985321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6e920d76-0b40-4a02-b919-f13360b98b6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:21.991829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e920d76-0b40-4a02-b919-f13360b98b6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.992314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e920d76-0b40-4a02-b919-f13360b98b6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.992776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e920d76-0b40-4a02-b919-f13360b98b6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:21.994024 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e920d76-0b40-4a02-b919-f13360b98b6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:21.994627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e920d76-0b40-4a02-b919-f13360b98b6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:21.995058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e920d76-0b40-4a02-b919-f13360b98b6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:22.126349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6e920d76-0b40-4a02-b919-f13360b98b6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:22.137417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6e920d76-0b40-4a02-b919-f13360b98b6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:22.139039 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6e920d76-0b40-4a02-b919-f13360b98b6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:22.140331 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6e920d76-0b40-4a02-b919-f13360b98b6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.159537 Aug 30 14:45:22.141011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 194/398] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:21 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:22.249616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ebca4efc-fd5f-41d3-a42a-cefb52c102d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:22.250273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ebca4efc-fd5f-41d3-a42a-cefb52c102d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:22.256656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ebca4efc-fd5f-41d3-a42a-cefb52c102d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:22.257138 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ebca4efc-fd5f-41d3-a42a-cefb52c102d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:22.257575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ebca4efc-fd5f-41d3-a42a-cefb52c102d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:22.258270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ebca4efc-fd5f-41d3-a42a-cefb52c102d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:22.258719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ebca4efc-fd5f-41d3-a42a-cefb52c102d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:22.259763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ebca4efc-fd5f-41d3-a42a-cefb52c102d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:22.388939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ebca4efc-fd5f-41d3-a42a-cefb52c102d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:22.396534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ebca4efc-fd5f-41d3-a42a-cefb52c102d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.150957 Aug 30 14:45:22.397102 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 205/399] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:22 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:22.750627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f8f63623-85f4-41f4-96ec-ad84c3f947a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:22.751250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f8f63623-85f4-41f4-96ec-ad84c3f947a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:22.757137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8f63623-85f4-41f4-96ec-ad84c3f947a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:22.757614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8f63623-85f4-41f4-96ec-ad84c3f947a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:22.758044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8f63623-85f4-41f4-96ec-ad84c3f947a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:22.758729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8f63623-85f4-41f4-96ec-ad84c3f947a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:22.759336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8f63623-85f4-41f4-96ec-ad84c3f947a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:22.759757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8f63623-85f4-41f4-96ec-ad84c3f947a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:22.822318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f8f63623-85f4-41f4-96ec-ad84c3f947a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:22.830016 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f8f63623-85f4-41f4-96ec-ad84c3f947a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1223 microversion: 2.1 time: 0.083313 Aug 30 14:45:22.830589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 195/400] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:22 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:22.860318 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b555d870-d103-40d3-a97e-960efd2db933 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:22.860932 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b555d870-d103-40d3-a97e-960efd2db933 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:22.867364 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b555d870-d103-40d3-a97e-960efd2db933 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:22.867843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b555d870-d103-40d3-a97e-960efd2db933 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:22.868420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b555d870-d103-40d3-a97e-960efd2db933 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:22.869203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b555d870-d103-40d3-a97e-960efd2db933 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:22.869649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b555d870-d103-40d3-a97e-960efd2db933 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:22.870073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b555d870-d103-40d3-a97e-960efd2db933 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:22.997631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b555d870-d103-40d3-a97e-960efd2db933 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:23.005299 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b555d870-d103-40d3-a97e-960efd2db933 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.148743 Aug 30 14:45:23.005800 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 206/401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:22 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:23.163981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c0b2775f-87cd-4362-9656-a641cfa77ef2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:23.164773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c0b2775f-87cd-4362-9656-a641cfa77ef2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:23.171471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0b2775f-87cd-4362-9656-a641cfa77ef2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:23.171948 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0b2775f-87cd-4362-9656-a641cfa77ef2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:23.172374 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0b2775f-87cd-4362-9656-a641cfa77ef2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:23.173056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0b2775f-87cd-4362-9656-a641cfa77ef2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:23.173498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0b2775f-87cd-4362-9656-a641cfa77ef2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:23.173908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0b2775f-87cd-4362-9656-a641cfa77ef2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:23.306074 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0b2775f-87cd-4362-9656-a641cfa77ef2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:23.314502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0b2775f-87cd-4362-9656-a641cfa77ef2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:23.316310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0b2775f-87cd-4362-9656-a641cfa77ef2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:23.317453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c0b2775f-87cd-4362-9656-a641cfa77ef2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.157356 Aug 30 14:45:23.317996 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 196/402] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:23 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:23.418327 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b69655cd-9746-441d-93a1-94f0d7f7b067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:23.418965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b69655cd-9746-441d-93a1-94f0d7f7b067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:23.424883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b69655cd-9746-441d-93a1-94f0d7f7b067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:23.425356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b69655cd-9746-441d-93a1-94f0d7f7b067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:23.425780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b69655cd-9746-441d-93a1-94f0d7f7b067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:23.426464 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b69655cd-9746-441d-93a1-94f0d7f7b067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:23.426909 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b69655cd-9746-441d-93a1-94f0d7f7b067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:23.427355 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b69655cd-9746-441d-93a1-94f0d7f7b067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:23.560165 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b69655cd-9746-441d-93a1-94f0d7f7b067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:23.564527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b69655cd-9746-441d-93a1-94f0d7f7b067 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.151190 Aug 30 14:45:23.567542 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 207/403] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:23 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:23.851414 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e285ce18-bd27-4cc4-a02f-30fdad7759a0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:23.852023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e285ce18-bd27-4cc4-a02f-30fdad7759a0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:23.859095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e285ce18-bd27-4cc4-a02f-30fdad7759a0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:23.860202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e285ce18-bd27-4cc4-a02f-30fdad7759a0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:23.860639 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e285ce18-bd27-4cc4-a02f-30fdad7759a0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:23.861360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e285ce18-bd27-4cc4-a02f-30fdad7759a0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:23.861925 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e285ce18-bd27-4cc4-a02f-30fdad7759a0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:23.862345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e285ce18-bd27-4cc4-a02f-30fdad7759a0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:23.923232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e285ce18-bd27-4cc4-a02f-30fdad7759a0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:23.930781 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e285ce18-bd27-4cc4-a02f-30fdad7759a0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1223 microversion: 2.1 time: 0.083225 Aug 30 14:45:23.932459 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 197/404] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:23 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:24.025650 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-63d1f863-78ab-40c5-835a-97eb91df77f2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:24.026452 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-63d1f863-78ab-40c5-835a-97eb91df77f2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:24.037733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63d1f863-78ab-40c5-835a-97eb91df77f2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:24.038405 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63d1f863-78ab-40c5-835a-97eb91df77f2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:24.039161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63d1f863-78ab-40c5-835a-97eb91df77f2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:24.052262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63d1f863-78ab-40c5-835a-97eb91df77f2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:24.052759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63d1f863-78ab-40c5-835a-97eb91df77f2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:24.053193 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63d1f863-78ab-40c5-835a-97eb91df77f2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:24.071750 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:24.187134 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-63d1f863-78ab-40c5-835a-97eb91df77f2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:24.194856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-63d1f863-78ab-40c5-835a-97eb91df77f2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.173278 Aug 30 14:45:24.195453 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 208/405] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:24 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:24.341360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b83699e7-e5da-4567-8ed7-33f4524963e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:24.341968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b83699e7-e5da-4567-8ed7-33f4524963e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:24.348482 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b83699e7-e5da-4567-8ed7-33f4524963e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:24.348958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b83699e7-e5da-4567-8ed7-33f4524963e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:24.349388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b83699e7-e5da-4567-8ed7-33f4524963e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:24.350063 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b83699e7-e5da-4567-8ed7-33f4524963e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:24.350509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b83699e7-e5da-4567-8ed7-33f4524963e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:24.350924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b83699e7-e5da-4567-8ed7-33f4524963e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:24.511629 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b83699e7-e5da-4567-8ed7-33f4524963e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:24.522019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b83699e7-e5da-4567-8ed7-33f4524963e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:24.523649 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b83699e7-e5da-4567-8ed7-33f4524963e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:24.525510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b83699e7-e5da-4567-8ed7-33f4524963e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.188655 Aug 30 14:45:24.526347 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 198/406] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:24 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:24.586477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a90f3660-386d-487a-81b3-1cafa4825e89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:24.587184 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a90f3660-386d-487a-81b3-1cafa4825e89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:24.593090 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a90f3660-386d-487a-81b3-1cafa4825e89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:24.593568 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a90f3660-386d-487a-81b3-1cafa4825e89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:24.593997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a90f3660-386d-487a-81b3-1cafa4825e89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:24.594711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a90f3660-386d-487a-81b3-1cafa4825e89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:24.595158 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a90f3660-386d-487a-81b3-1cafa4825e89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:24.595598 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a90f3660-386d-487a-81b3-1cafa4825e89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:24.753371 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a90f3660-386d-487a-81b3-1cafa4825e89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:24.765339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a90f3660-386d-487a-81b3-1cafa4825e89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.182549 Aug 30 14:45:24.767243 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 209/407] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:24 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:24.956022 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4d808933-a2b9-4e8f-b711-2700ff75b081 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:24.956840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4d808933-a2b9-4e8f-b711-2700ff75b081 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:24.959864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:24.960650 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:24.966462 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d808933-a2b9-4e8f-b711-2700ff75b081 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:24.966947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d808933-a2b9-4e8f-b711-2700ff75b081 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:24.967404 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d808933-a2b9-4e8f-b711-2700ff75b081 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:24.968135 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d808933-a2b9-4e8f-b711-2700ff75b081 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:24.968576 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d808933-a2b9-4e8f-b711-2700ff75b081 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:24.968988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d808933-a2b9-4e8f-b711-2700ff75b081 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:24.973359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:25.031231 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4d808933-a2b9-4e8f-b711-2700ff75b081 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:25.039817 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4d808933-a2b9-4e8f-b711-2700ff75b081 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1223 microversion: 2.1 time: 0.090038 Aug 30 14:45:25.041149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 199/408] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:24 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:25.218503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6090019c-72cf-42b8-a5e0-ddfaaa5429d9 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:25.219108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6090019c-72cf-42b8-a5e0-ddfaaa5429d9 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:25.220963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:25.226715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6090019c-72cf-42b8-a5e0-ddfaaa5429d9 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:25.227189 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6090019c-72cf-42b8-a5e0-ddfaaa5429d9 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:25.228254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6090019c-72cf-42b8-a5e0-ddfaaa5429d9 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:25.228953 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6090019c-72cf-42b8-a5e0-ddfaaa5429d9 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:25.229396 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6090019c-72cf-42b8-a5e0-ddfaaa5429d9 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:25.229813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6090019c-72cf-42b8-a5e0-ddfaaa5429d9 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:25.368746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6090019c-72cf-42b8-a5e0-ddfaaa5429d9 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:25.378714 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6090019c-72cf-42b8-a5e0-ddfaaa5429d9 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.164009 Aug 30 14:45:25.379673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 210/409] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:25 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:25.548129 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-568f7588-c346-4ab0-9d61-f6a696483aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:25.549500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-568f7588-c346-4ab0-9d61-f6a696483aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:25.556964 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-568f7588-c346-4ab0-9d61-f6a696483aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:25.557753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-568f7588-c346-4ab0-9d61-f6a696483aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:25.558390 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-568f7588-c346-4ab0-9d61-f6a696483aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:25.559336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-568f7588-c346-4ab0-9d61-f6a696483aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:25.559998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-568f7588-c346-4ab0-9d61-f6a696483aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:25.560609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-568f7588-c346-4ab0-9d61-f6a696483aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:25.698523 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-568f7588-c346-4ab0-9d61-f6a696483aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:25.707054 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-568f7588-c346-4ab0-9d61-f6a696483aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:25.708496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-568f7588-c346-4ab0-9d61-f6a696483aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:25.709648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-568f7588-c346-4ab0-9d61-f6a696483aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.165457 Aug 30 14:45:25.710202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 200/410] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:25 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:25.787053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a88e3308-fc2a-42f5-be00-2b27ab7e5edb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:25.788279 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a88e3308-fc2a-42f5-be00-2b27ab7e5edb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:25.803102 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a88e3308-fc2a-42f5-be00-2b27ab7e5edb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:25.803716 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a88e3308-fc2a-42f5-be00-2b27ab7e5edb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:25.804304 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a88e3308-fc2a-42f5-be00-2b27ab7e5edb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:25.805348 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a88e3308-fc2a-42f5-be00-2b27ab7e5edb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:25.806480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a88e3308-fc2a-42f5-be00-2b27ab7e5edb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:25.806974 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a88e3308-fc2a-42f5-be00-2b27ab7e5edb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:25.946426 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a88e3308-fc2a-42f5-be00-2b27ab7e5edb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:25.968039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a88e3308-fc2a-42f5-be00-2b27ab7e5edb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.184712 Aug 30 14:45:25.969694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 211/411] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:25 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:26.061910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-aa16b3a6-a167-4a1c-b9ed-4d0368cb1329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:26.062521 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-aa16b3a6-a167-4a1c-b9ed-4d0368cb1329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:26.068698 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa16b3a6-a167-4a1c-b9ed-4d0368cb1329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:26.069181 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa16b3a6-a167-4a1c-b9ed-4d0368cb1329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:26.069620 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa16b3a6-a167-4a1c-b9ed-4d0368cb1329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:26.070302 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa16b3a6-a167-4a1c-b9ed-4d0368cb1329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:26.070817 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa16b3a6-a167-4a1c-b9ed-4d0368cb1329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:26.071349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa16b3a6-a167-4a1c-b9ed-4d0368cb1329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:26.133048 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-aa16b3a6-a167-4a1c-b9ed-4d0368cb1329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:26.141052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-aa16b3a6-a167-4a1c-b9ed-4d0368cb1329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1223 microversion: 2.1 time: 0.082956 Aug 30 14:45:26.141602 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 201/412] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:26 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:26.401517 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-dfe00a0b-9daf-457f-9ef9-1ae1623a1454 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:26.402778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-dfe00a0b-9daf-457f-9ef9-1ae1623a1454 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:26.416459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dfe00a0b-9daf-457f-9ef9-1ae1623a1454 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:26.416955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dfe00a0b-9daf-457f-9ef9-1ae1623a1454 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:26.417391 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dfe00a0b-9daf-457f-9ef9-1ae1623a1454 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:26.418130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dfe00a0b-9daf-457f-9ef9-1ae1623a1454 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:26.418579 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dfe00a0b-9daf-457f-9ef9-1ae1623a1454 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:26.419000 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dfe00a0b-9daf-457f-9ef9-1ae1623a1454 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:26.559428 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-dfe00a0b-9daf-457f-9ef9-1ae1623a1454 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:26.567169 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-dfe00a0b-9daf-457f-9ef9-1ae1623a1454 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.169582 Aug 30 14:45:26.567759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 212/413] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:26 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:26.734613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-479aaa31-6b9e-4665-bbb1-9a0ed7897f3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:26.735168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-479aaa31-6b9e-4665-bbb1-9a0ed7897f3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:26.741355 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479aaa31-6b9e-4665-bbb1-9a0ed7897f3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:26.741828 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479aaa31-6b9e-4665-bbb1-9a0ed7897f3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:26.742249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479aaa31-6b9e-4665-bbb1-9a0ed7897f3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:26.742918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479aaa31-6b9e-4665-bbb1-9a0ed7897f3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:26.743443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479aaa31-6b9e-4665-bbb1-9a0ed7897f3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:26.743944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479aaa31-6b9e-4665-bbb1-9a0ed7897f3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:26.887245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-479aaa31-6b9e-4665-bbb1-9a0ed7897f3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:26.895901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-479aaa31-6b9e-4665-bbb1-9a0ed7897f3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:26.897364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-479aaa31-6b9e-4665-bbb1-9a0ed7897f3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:26.898500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-479aaa31-6b9e-4665-bbb1-9a0ed7897f3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.167802 Aug 30 14:45:26.899053 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 202/414] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:26 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:26.989386 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d1b53e15-6afd-48d5-887a-d8b50ec8ca00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:26.989943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d1b53e15-6afd-48d5-887a-d8b50ec8ca00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:26.996576 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1b53e15-6afd-48d5-887a-d8b50ec8ca00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:26.997058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1b53e15-6afd-48d5-887a-d8b50ec8ca00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:26.997519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1b53e15-6afd-48d5-887a-d8b50ec8ca00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:26.998208 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1b53e15-6afd-48d5-887a-d8b50ec8ca00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:26.998657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1b53e15-6afd-48d5-887a-d8b50ec8ca00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:26.999113 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1b53e15-6afd-48d5-887a-d8b50ec8ca00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:27.123919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d1b53e15-6afd-48d5-887a-d8b50ec8ca00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:27.131431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d1b53e15-6afd-48d5-887a-d8b50ec8ca00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1370 microversion: 2.1 time: 0.145930 Aug 30 14:45:27.132019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 213/415] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:26 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:27.161756 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a2cb51a6-064b-4b09-b2ed-f97838acfbea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:27.166410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a2cb51a6-064b-4b09-b2ed-f97838acfbea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:27.168785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2cb51a6-064b-4b09-b2ed-f97838acfbea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:27.169269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2cb51a6-064b-4b09-b2ed-f97838acfbea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:27.169697 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2cb51a6-064b-4b09-b2ed-f97838acfbea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:27.170374 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2cb51a6-064b-4b09-b2ed-f97838acfbea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:27.170824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2cb51a6-064b-4b09-b2ed-f97838acfbea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:27.171266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2cb51a6-064b-4b09-b2ed-f97838acfbea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:27.237713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a2cb51a6-064b-4b09-b2ed-f97838acfbea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:27.246065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a2cb51a6-064b-4b09-b2ed-f97838acfbea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1223 microversion: 2.1 time: 0.088060 Aug 30 14:45:27.246568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 203/416] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:27 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:27.588016 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ad1f9c35-31b9-4600-97c5-e64082348269 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:27.588628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ad1f9c35-31b9-4600-97c5-e64082348269 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:27.594961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ad1f9c35-31b9-4600-97c5-e64082348269 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:27.595471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ad1f9c35-31b9-4600-97c5-e64082348269 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:27.595899 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ad1f9c35-31b9-4600-97c5-e64082348269 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:27.596580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ad1f9c35-31b9-4600-97c5-e64082348269 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:27.597022 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ad1f9c35-31b9-4600-97c5-e64082348269 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:27.597433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ad1f9c35-31b9-4600-97c5-e64082348269 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:27.724213 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ad1f9c35-31b9-4600-97c5-e64082348269 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:27.732333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ad1f9c35-31b9-4600-97c5-e64082348269 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.148548 Aug 30 14:45:27.732893 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 214/417] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:27 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:27.922415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b212cc60-4310-42bf-83c4-19aab5227a17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:27.922968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b212cc60-4310-42bf-83c4-19aab5227a17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:27.929297 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b212cc60-4310-42bf-83c4-19aab5227a17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:27.929898 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b212cc60-4310-42bf-83c4-19aab5227a17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:27.930330 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b212cc60-4310-42bf-83c4-19aab5227a17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:27.931631 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b212cc60-4310-42bf-83c4-19aab5227a17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:27.932077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b212cc60-4310-42bf-83c4-19aab5227a17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:27.932492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b212cc60-4310-42bf-83c4-19aab5227a17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:28.057790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b212cc60-4310-42bf-83c4-19aab5227a17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:28.066568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b212cc60-4310-42bf-83c4-19aab5227a17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:28.068037 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b212cc60-4310-42bf-83c4-19aab5227a17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:28.069186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b212cc60-4310-42bf-83c4-19aab5227a17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.150724 Aug 30 14:45:28.069738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 204/418] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:27 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:28.153438 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-95205db9-9596-4090-860e-3b9206d99be2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:28.154053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-95205db9-9596-4090-860e-3b9206d99be2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:28.159928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95205db9-9596-4090-860e-3b9206d99be2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:28.160413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95205db9-9596-4090-860e-3b9206d99be2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:28.160842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95205db9-9596-4090-860e-3b9206d99be2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:28.161526 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95205db9-9596-4090-860e-3b9206d99be2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:28.161975 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95205db9-9596-4090-860e-3b9206d99be2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:28.162396 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95205db9-9596-4090-860e-3b9206d99be2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:28.267192 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7dd8250c-af5c-4d60-9155-41ef43988e4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:28.267846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7dd8250c-af5c-4d60-9155-41ef43988e4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:28.275804 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dd8250c-af5c-4d60-9155-41ef43988e4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:28.276301 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dd8250c-af5c-4d60-9155-41ef43988e4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:28.276729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dd8250c-af5c-4d60-9155-41ef43988e4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:28.277424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dd8250c-af5c-4d60-9155-41ef43988e4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:28.277866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dd8250c-af5c-4d60-9155-41ef43988e4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:28.278282 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dd8250c-af5c-4d60-9155-41ef43988e4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:28.320624 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-95205db9-9596-4090-860e-3b9206d99be2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:28.329748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-95205db9-9596-4090-860e-3b9206d99be2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1565 microversion: 2.1 time: 0.181617 Aug 30 14:45:28.330522 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 215/419] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:28 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1565 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:28.350417 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-398ba0e4-7ce8-41f7-8299-4d445a0d94b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:28.350905 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-398ba0e4-7ce8-41f7-8299-4d445a0d94b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:28.357383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7dd8250c-af5c-4d60-9155-41ef43988e4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:28.357561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-398ba0e4-7ce8-41f7-8299-4d445a0d94b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:28.358147 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-398ba0e4-7ce8-41f7-8299-4d445a0d94b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:28.358638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-398ba0e4-7ce8-41f7-8299-4d445a0d94b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:28.359424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-398ba0e4-7ce8-41f7-8299-4d445a0d94b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:28.359940 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-398ba0e4-7ce8-41f7-8299-4d445a0d94b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:28.360428 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-398ba0e4-7ce8-41f7-8299-4d445a0d94b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:28.364937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7dd8250c-af5c-4d60-9155-41ef43988e4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1223 microversion: 2.1 time: 0.102728 Aug 30 14:45:28.365601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 205/420] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:28 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:28.436312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-398ba0e4-7ce8-41f7-8299-4d445a0d94b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089694 Aug 30 14:45:28.436935 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 216/421] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 14:45:28 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:45:28.753949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f296fa7a-3fa5-4c73-bedd-4b33910e7c9a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:28.754571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f296fa7a-3fa5-4c73-bedd-4b33910e7c9a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:28.761348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f296fa7a-3fa5-4c73-bedd-4b33910e7c9a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:28.761829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f296fa7a-3fa5-4c73-bedd-4b33910e7c9a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:28.762259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f296fa7a-3fa5-4c73-bedd-4b33910e7c9a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:28.763189 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f296fa7a-3fa5-4c73-bedd-4b33910e7c9a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:28.763420 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f296fa7a-3fa5-4c73-bedd-4b33910e7c9a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:28.763841 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f296fa7a-3fa5-4c73-bedd-4b33910e7c9a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:29.092376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-472a580f-45df-4558-9337-afea34af5665 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:29.092981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-472a580f-45df-4558-9337-afea34af5665 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:29.098789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-472a580f-45df-4558-9337-afea34af5665 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:29.099296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-472a580f-45df-4558-9337-afea34af5665 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:29.099732 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-472a580f-45df-4558-9337-afea34af5665 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:29.100418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-472a580f-45df-4558-9337-afea34af5665 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:29.100859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-472a580f-45df-4558-9337-afea34af5665 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:29.101281 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-472a580f-45df-4558-9337-afea34af5665 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:29.225083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f296fa7a-3fa5-4c73-bedd-4b33910e7c9a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:29.235381 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f296fa7a-3fa5-4c73-bedd-4b33910e7c9a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.486036 Aug 30 14:45:29.238858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-472a580f-45df-4558-9337-afea34af5665 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:29.239186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 206/422] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:28 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:29.248949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-472a580f-45df-4558-9337-afea34af5665 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:29.250413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-472a580f-45df-4558-9337-afea34af5665 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:29.251736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-472a580f-45df-4558-9337-afea34af5665 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.163798 Aug 30 14:45:29.252277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 217/423] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:29 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:45:29.385485 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d0680e82-5d7b-48ce-818f-d20fe5d80aa3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:29.386184 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d0680e82-5d7b-48ce-818f-d20fe5d80aa3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:29.392106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0680e82-5d7b-48ce-818f-d20fe5d80aa3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:29.392657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0680e82-5d7b-48ce-818f-d20fe5d80aa3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:29.393084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0680e82-5d7b-48ce-818f-d20fe5d80aa3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:29.393769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0680e82-5d7b-48ce-818f-d20fe5d80aa3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:29.394213 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0680e82-5d7b-48ce-818f-d20fe5d80aa3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:29.394625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0680e82-5d7b-48ce-818f-d20fe5d80aa3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:29.467739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d0680e82-5d7b-48ce-818f-d20fe5d80aa3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:29.475239 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d0680e82-5d7b-48ce-818f-d20fe5d80aa3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1215 microversion: 2.1 time: 0.093647 Aug 30 14:45:29.475801 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 207/424] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:29 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:30.185110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-67bb87ba-796c-4fdd-b423-e3ea5d037479 req-8ce4a17f-6bf9-45ff-b94d-bc9511248947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42a99ef-987b-4b7f-a6ef-5458fccc5c52", "tag": "de9192f0-7fd0-49c1-8393-b52baf316782"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:30.195309 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-67bb87ba-796c-4fdd-b423-e3ea5d037479 req-8ce4a17f-6bf9-45ff-b94d-bc9511248947 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:30.195898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-67bb87ba-796c-4fdd-b423-e3ea5d037479 req-8ce4a17f-6bf9-45ff-b94d-bc9511248947 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:30.196883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-67bb87ba-796c-4fdd-b423-e3ea5d037479 req-8ce4a17f-6bf9-45ff-b94d-bc9511248947 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:30.207623 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-67bb87ba-796c-4fdd-b423-e3ea5d037479 req-8ce4a17f-6bf9-45ff-b94d-bc9511248947 service nova] Creating event network-changed:de9192f0-7fd0-49c1-8393-b52baf316782 for instance e42a99ef-987b-4b7f-a6ef-5458fccc5c52 on hv-cinder-82880 Aug 30 14:45:30.218324 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-67bb87ba-796c-4fdd-b423-e3ea5d037479 req-8ce4a17f-6bf9-45ff-b94d-bc9511248947 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036881 Aug 30 14:45:30.221756 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 218/425] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:45:30.260326 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e3034bdd-7ff3-4b2d-b66c-5f201584d337 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:30.261615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e3034bdd-7ff3-4b2d-b66c-5f201584d337 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:30.268068 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3034bdd-7ff3-4b2d-b66c-5f201584d337 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:30.268599 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3034bdd-7ff3-4b2d-b66c-5f201584d337 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:30.268980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3034bdd-7ff3-4b2d-b66c-5f201584d337 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:30.269678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3034bdd-7ff3-4b2d-b66c-5f201584d337 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:30.270125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3034bdd-7ff3-4b2d-b66c-5f201584d337 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:30.270543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3034bdd-7ff3-4b2d-b66c-5f201584d337 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:30.274761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7cd4a987-e04d-4175-83bb-27e34e504e34 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:30.275502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7cd4a987-e04d-4175-83bb-27e34e504e34 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:30.282217 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cd4a987-e04d-4175-83bb-27e34e504e34 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:30.282703 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cd4a987-e04d-4175-83bb-27e34e504e34 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:30.283135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cd4a987-e04d-4175-83bb-27e34e504e34 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:30.283866 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cd4a987-e04d-4175-83bb-27e34e504e34 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:30.284613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cd4a987-e04d-4175-83bb-27e34e504e34 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:30.285038 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cd4a987-e04d-4175-83bb-27e34e504e34 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:30.405233 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e3034bdd-7ff3-4b2d-b66c-5f201584d337 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:30.413581 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e3034bdd-7ff3-4b2d-b66c-5f201584d337 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.157579 Aug 30 14:45:30.421484 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7cd4a987-e04d-4175-83bb-27e34e504e34 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:30.425461 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 208/426] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:30 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:30.430292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7cd4a987-e04d-4175-83bb-27e34e504e34 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:30.432341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7cd4a987-e04d-4175-83bb-27e34e504e34 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:30.433485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7cd4a987-e04d-4175-83bb-27e34e504e34 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.163156 Aug 30 14:45:30.434028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 219/427] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:30 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:45:30.497788 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2e199683-8fcf-4949-a871-eaf2ba84046e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:30.498329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2e199683-8fcf-4949-a871-eaf2ba84046e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:30.504192 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e199683-8fcf-4949-a871-eaf2ba84046e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:30.504678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e199683-8fcf-4949-a871-eaf2ba84046e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:30.505106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e199683-8fcf-4949-a871-eaf2ba84046e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:30.505846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e199683-8fcf-4949-a871-eaf2ba84046e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:30.506298 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e199683-8fcf-4949-a871-eaf2ba84046e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:30.506718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e199683-8fcf-4949-a871-eaf2ba84046e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:30.573569 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2e199683-8fcf-4949-a871-eaf2ba84046e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:30.581474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2e199683-8fcf-4949-a871-eaf2ba84046e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1271 microversion: 2.1 time: 0.088239 Aug 30 14:45:30.582054 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 209/428] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:30 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:31.434247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fc0b95b4-02c4-4a41-8816-85221c8fcff5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:31.434869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fc0b95b4-02c4-4a41-8816-85221c8fcff5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:31.441838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc0b95b4-02c4-4a41-8816-85221c8fcff5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:31.442325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc0b95b4-02c4-4a41-8816-85221c8fcff5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:31.442751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc0b95b4-02c4-4a41-8816-85221c8fcff5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:31.443487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc0b95b4-02c4-4a41-8816-85221c8fcff5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:31.443937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc0b95b4-02c4-4a41-8816-85221c8fcff5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:31.444357 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc0b95b4-02c4-4a41-8816-85221c8fcff5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:31.456157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f77f0e5c-5401-4cce-a5b1-beb34dd9af20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:31.456888 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f77f0e5c-5401-4cce-a5b1-beb34dd9af20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:31.463930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f77f0e5c-5401-4cce-a5b1-beb34dd9af20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:31.464534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f77f0e5c-5401-4cce-a5b1-beb34dd9af20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:31.465587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f77f0e5c-5401-4cce-a5b1-beb34dd9af20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:31.465785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f77f0e5c-5401-4cce-a5b1-beb34dd9af20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:31.466308 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f77f0e5c-5401-4cce-a5b1-beb34dd9af20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:31.466791 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f77f0e5c-5401-4cce-a5b1-beb34dd9af20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:31.613860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f77f0e5c-5401-4cce-a5b1-beb34dd9af20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:31.623540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f77f0e5c-5401-4cce-a5b1-beb34dd9af20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:31.625084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f77f0e5c-5401-4cce-a5b1-beb34dd9af20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:31.626327 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f77f0e5c-5401-4cce-a5b1-beb34dd9af20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.174051 Aug 30 14:45:31.626965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 210/429] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:31 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:45:31.646994 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-04c68b8e-2c3d-447a-9d7b-90c83480e660 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:31.647741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-04c68b8e-2c3d-447a-9d7b-90c83480e660 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:31.653978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fc0b95b4-02c4-4a41-8816-85221c8fcff5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:31.664519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fc0b95b4-02c4-4a41-8816-85221c8fcff5 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1314 microversion: 2.1 time: 0.234381 Aug 30 14:45:31.665128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 220/430] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:31 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:31.665806 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04c68b8e-2c3d-447a-9d7b-90c83480e660 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:31.666479 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04c68b8e-2c3d-447a-9d7b-90c83480e660 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:31.667077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04c68b8e-2c3d-447a-9d7b-90c83480e660 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:31.667957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04c68b8e-2c3d-447a-9d7b-90c83480e660 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:31.668583 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04c68b8e-2c3d-447a-9d7b-90c83480e660 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:31.669163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04c68b8e-2c3d-447a-9d7b-90c83480e660 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:31.736361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-04c68b8e-2c3d-447a-9d7b-90c83480e660 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:31.744713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-04c68b8e-2c3d-447a-9d7b-90c83480e660 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1277 microversion: 2.1 time: 0.116506 Aug 30 14:45:31.745276 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 211/431] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:31 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:32.650925 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-43f20462-ab4e-4704-a464-eeb4ca6eb455 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:32.651566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-43f20462-ab4e-4704-a464-eeb4ca6eb455 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:32.658409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-43f20462-ab4e-4704-a464-eeb4ca6eb455 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:32.658885 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-43f20462-ab4e-4704-a464-eeb4ca6eb455 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:32.659358 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-43f20462-ab4e-4704-a464-eeb4ca6eb455 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:32.660261 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-43f20462-ab4e-4704-a464-eeb4ca6eb455 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:32.660714 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-43f20462-ab4e-4704-a464-eeb4ca6eb455 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:32.661135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-43f20462-ab4e-4704-a464-eeb4ca6eb455 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:32.685606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7e379fe4-eb14-4c5d-bf2e-cd71810a7b3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:32.686192 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7e379fe4-eb14-4c5d-bf2e-cd71810a7b3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:32.700907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e379fe4-eb14-4c5d-bf2e-cd71810a7b3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:32.701391 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e379fe4-eb14-4c5d-bf2e-cd71810a7b3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:32.701829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e379fe4-eb14-4c5d-bf2e-cd71810a7b3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:32.702878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e379fe4-eb14-4c5d-bf2e-cd71810a7b3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:32.703373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e379fe4-eb14-4c5d-bf2e-cd71810a7b3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:32.703795 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e379fe4-eb14-4c5d-bf2e-cd71810a7b3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:32.922804 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7e379fe4-eb14-4c5d-bf2e-cd71810a7b3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:32.932890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7e379fe4-eb14-4c5d-bf2e-cd71810a7b3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1498 microversion: 2.1 time: 0.251479 Aug 30 14:45:32.933861 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 212/432] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:32 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1498 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:32.938937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b0840027-a8aa-48b2-bad0-10302e4b508d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:32.939824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b0840027-a8aa-48b2-bad0-10302e4b508d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:32.949706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0840027-a8aa-48b2-bad0-10302e4b508d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:32.950283 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0840027-a8aa-48b2-bad0-10302e4b508d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:32.950819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0840027-a8aa-48b2-bad0-10302e4b508d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:32.951763 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0840027-a8aa-48b2-bad0-10302e4b508d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:32.952280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0840027-a8aa-48b2-bad0-10302e4b508d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:32.952752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0840027-a8aa-48b2-bad0-10302e4b508d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:33.099495 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b0840027-a8aa-48b2-bad0-10302e4b508d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:33.108021 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b0840027-a8aa-48b2-bad0-10302e4b508d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1319 microversion: 2.1 time: 0.172779 Aug 30 14:45:33.108614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 213/433] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:32 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:33.153202 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-43f20462-ab4e-4704-a464-eeb4ca6eb455 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:33.161714 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-43f20462-ab4e-4704-a464-eeb4ca6eb455 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:33.163167 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-43f20462-ab4e-4704-a464-eeb4ca6eb455 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:33.164396 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-43f20462-ab4e-4704-a464-eeb4ca6eb455 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.518288 Aug 30 14:45:33.164981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 221/434] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:32 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:33.284131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-00bf713a-4304-4b37-bbd6-cda2ea9cc128 req-ef3e25f5-5ab1-4212-bdee-8ebb388b127c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38cae1b8-5973-4846-b2f4-79ed7e98be62", "tag": "43ef8efc-c930-4960-9ef2-48d6d5f548da"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:33.300073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-00bf713a-4304-4b37-bbd6-cda2ea9cc128 req-ef3e25f5-5ab1-4212-bdee-8ebb388b127c service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:33.300073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-00bf713a-4304-4b37-bbd6-cda2ea9cc128 req-ef3e25f5-5ab1-4212-bdee-8ebb388b127c service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:33.300073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-00bf713a-4304-4b37-bbd6-cda2ea9cc128 req-ef3e25f5-5ab1-4212-bdee-8ebb388b127c service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:33.308651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-00bf713a-4304-4b37-bbd6-cda2ea9cc128 req-ef3e25f5-5ab1-4212-bdee-8ebb388b127c service nova] Creating event network-changed:43ef8efc-c930-4960-9ef2-48d6d5f548da for instance 38cae1b8-5973-4846-b2f4-79ed7e98be62 on hv-cinder-82880 Aug 30 14:45:33.314171 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-00bf713a-4304-4b37-bbd6-cda2ea9cc128 req-ef3e25f5-5ab1-4212-bdee-8ebb388b127c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033157 Aug 30 14:45:33.315027 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 214/435] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:45:33.605596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0240f87d-eb15-4b5d-8bec-3ec9bbc203aa tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:33.606093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0240f87d-eb15-4b5d-8bec-3ec9bbc203aa tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:33.612065 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0240f87d-eb15-4b5d-8bec-3ec9bbc203aa tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:33.612548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0240f87d-eb15-4b5d-8bec-3ec9bbc203aa tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:33.612985 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0240f87d-eb15-4b5d-8bec-3ec9bbc203aa tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:33.613674 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0240f87d-eb15-4b5d-8bec-3ec9bbc203aa tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:33.614128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0240f87d-eb15-4b5d-8bec-3ec9bbc203aa tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:33.614553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0240f87d-eb15-4b5d-8bec-3ec9bbc203aa tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:33.639433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0240f87d-eb15-4b5d-8bec-3ec9bbc203aa tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Going to try to terminate instance {{(pid=127089) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:45:33.724865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0240f87d-eb15-4b5d-8bec-3ec9bbc203aa tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "DELETE /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 204 len: 0 microversion: 2.1 time: 0.123313 Aug 30 14:45:33.725543 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 222/436] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 14:45:33 2022] DELETE /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:45:33.734704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b33941a4-74b9-46ab-acd8-feedcb67caa3 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:33.735433 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b33941a4-74b9-46ab-acd8-feedcb67caa3 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:33.741879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b33941a4-74b9-46ab-acd8-feedcb67caa3 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:33.742362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b33941a4-74b9-46ab-acd8-feedcb67caa3 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:33.742793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b33941a4-74b9-46ab-acd8-feedcb67caa3 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:33.743512 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b33941a4-74b9-46ab-acd8-feedcb67caa3 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:33.743959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b33941a4-74b9-46ab-acd8-feedcb67caa3 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:33.744376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b33941a4-74b9-46ab-acd8-feedcb67caa3 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:33.875511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b33941a4-74b9-46ab-acd8-feedcb67caa3 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:33.883056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b33941a4-74b9-46ab-acd8-feedcb67caa3 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1504 microversion: 2.1 time: 0.153158 Aug 30 14:45:33.884432 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 215/437] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:33 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:34.130225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a2fed2ee-b1f4-43a2-a202-007eb8cc017e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:34.130843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a2fed2ee-b1f4-43a2-a202-007eb8cc017e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:34.137285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2fed2ee-b1f4-43a2-a202-007eb8cc017e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:34.137758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2fed2ee-b1f4-43a2-a202-007eb8cc017e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:34.138186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2fed2ee-b1f4-43a2-a202-007eb8cc017e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:34.138881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2fed2ee-b1f4-43a2-a202-007eb8cc017e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:34.139384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2fed2ee-b1f4-43a2-a202-007eb8cc017e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:34.139802 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2fed2ee-b1f4-43a2-a202-007eb8cc017e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:34.187436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2d323a5b-fe9a-4d4e-8ae2-d013d66a4223 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:34.188138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2d323a5b-fe9a-4d4e-8ae2-d013d66a4223 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:34.194376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d323a5b-fe9a-4d4e-8ae2-d013d66a4223 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:34.194860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d323a5b-fe9a-4d4e-8ae2-d013d66a4223 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:34.195321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d323a5b-fe9a-4d4e-8ae2-d013d66a4223 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:34.196058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d323a5b-fe9a-4d4e-8ae2-d013d66a4223 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:34.197047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d323a5b-fe9a-4d4e-8ae2-d013d66a4223 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:34.197481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d323a5b-fe9a-4d4e-8ae2-d013d66a4223 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:34.215745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:34.275281 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a2fed2ee-b1f4-43a2-a202-007eb8cc017e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:34.282885 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a2fed2ee-b1f4-43a2-a202-007eb8cc017e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1319 microversion: 2.1 time: 0.156965 Aug 30 14:45:34.283476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 223/438] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:34 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:34.326068 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2d323a5b-fe9a-4d4e-8ae2-d013d66a4223 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:34.334504 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2d323a5b-fe9a-4d4e-8ae2-d013d66a4223 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:34.335987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2d323a5b-fe9a-4d4e-8ae2-d013d66a4223 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:34.337516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2d323a5b-fe9a-4d4e-8ae2-d013d66a4223 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.153963 Aug 30 14:45:34.338072 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 216/439] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:34 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:45:34.905054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ccf46bcb-3c77-487c-b2fe-73c371fa90c2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:34.905664 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ccf46bcb-3c77-487c-b2fe-73c371fa90c2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:34.912103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ccf46bcb-3c77-487c-b2fe-73c371fa90c2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:34.912579 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ccf46bcb-3c77-487c-b2fe-73c371fa90c2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:34.913017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ccf46bcb-3c77-487c-b2fe-73c371fa90c2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:34.913726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ccf46bcb-3c77-487c-b2fe-73c371fa90c2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:34.914173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ccf46bcb-3c77-487c-b2fe-73c371fa90c2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:34.914591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ccf46bcb-3c77-487c-b2fe-73c371fa90c2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:34.930355 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:35.044923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ccf46bcb-3c77-487c-b2fe-73c371fa90c2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:35.052605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ccf46bcb-3c77-487c-b2fe-73c371fa90c2 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1504 microversion: 2.1 time: 0.151455 Aug 30 14:45:35.053170 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 224/440] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:34 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:35.303589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1ff15b03-d175-415a-ac33-fc8868a450c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:35.304130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1ff15b03-d175-415a-ac33-fc8868a450c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:35.310779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ff15b03-d175-415a-ac33-fc8868a450c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:35.311287 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ff15b03-d175-415a-ac33-fc8868a450c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:35.311729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ff15b03-d175-415a-ac33-fc8868a450c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:35.312411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ff15b03-d175-415a-ac33-fc8868a450c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:35.312861 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ff15b03-d175-415a-ac33-fc8868a450c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:35.313291 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ff15b03-d175-415a-ac33-fc8868a450c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:35.360442 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1fc6b03d-a682-40aa-9fbc-624b7c3bed9f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:35.361056 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1fc6b03d-a682-40aa-9fbc-624b7c3bed9f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:35.366959 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1fc6b03d-a682-40aa-9fbc-624b7c3bed9f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:35.367478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1fc6b03d-a682-40aa-9fbc-624b7c3bed9f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:35.367926 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1fc6b03d-a682-40aa-9fbc-624b7c3bed9f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:35.368616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1fc6b03d-a682-40aa-9fbc-624b7c3bed9f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:35.369070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1fc6b03d-a682-40aa-9fbc-624b7c3bed9f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:35.369498 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1fc6b03d-a682-40aa-9fbc-624b7c3bed9f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:35.454332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1ff15b03-d175-415a-ac33-fc8868a450c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:35.462804 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1ff15b03-d175-415a-ac33-fc8868a450c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1319 microversion: 2.1 time: 0.163124 Aug 30 14:45:35.463507 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 217/441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:35 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:35.504118 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1fc6b03d-a682-40aa-9fbc-624b7c3bed9f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:35.513600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1fc6b03d-a682-40aa-9fbc-624b7c3bed9f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:35.515034 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1fc6b03d-a682-40aa-9fbc-624b7c3bed9f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:35.516206 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1fc6b03d-a682-40aa-9fbc-624b7c3bed9f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.159637 Aug 30 14:45:35.516777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 225/442] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:35 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:45:36.074062 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0dfc1a99-1b14-47eb-87dd-8e3bf4045626 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:36.074672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0dfc1a99-1b14-47eb-87dd-8e3bf4045626 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:36.080605 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dfc1a99-1b14-47eb-87dd-8e3bf4045626 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:36.081085 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dfc1a99-1b14-47eb-87dd-8e3bf4045626 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:36.081518 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dfc1a99-1b14-47eb-87dd-8e3bf4045626 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:36.082202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dfc1a99-1b14-47eb-87dd-8e3bf4045626 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:36.082657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dfc1a99-1b14-47eb-87dd-8e3bf4045626 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:36.083082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dfc1a99-1b14-47eb-87dd-8e3bf4045626 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:36.208437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0dfc1a99-1b14-47eb-87dd-8e3bf4045626 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:36.216274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0dfc1a99-1b14-47eb-87dd-8e3bf4045626 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1504 microversion: 2.1 time: 0.146360 Aug 30 14:45:36.216839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 218/443] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:36 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1504 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:36.482584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1b7fefad-b04d-4ccb-9efb-e8fd0e821e73 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:36.483111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1b7fefad-b04d-4ccb-9efb-e8fd0e821e73 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:36.489513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b7fefad-b04d-4ccb-9efb-e8fd0e821e73 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:36.489988 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b7fefad-b04d-4ccb-9efb-e8fd0e821e73 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:36.490415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b7fefad-b04d-4ccb-9efb-e8fd0e821e73 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:36.491101 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b7fefad-b04d-4ccb-9efb-e8fd0e821e73 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:36.491569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b7fefad-b04d-4ccb-9efb-e8fd0e821e73 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:36.491982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b7fefad-b04d-4ccb-9efb-e8fd0e821e73 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:36.539798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c65027ba-2cf5-4a67-9f12-1c8bab2782fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:36.540743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c65027ba-2cf5-4a67-9f12-1c8bab2782fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:36.547066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c65027ba-2cf5-4a67-9f12-1c8bab2782fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:36.547573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c65027ba-2cf5-4a67-9f12-1c8bab2782fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:36.548000 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c65027ba-2cf5-4a67-9f12-1c8bab2782fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:36.548677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c65027ba-2cf5-4a67-9f12-1c8bab2782fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:36.549118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c65027ba-2cf5-4a67-9f12-1c8bab2782fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:36.549533 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c65027ba-2cf5-4a67-9f12-1c8bab2782fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:36.623636 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1b7fefad-b04d-4ccb-9efb-e8fd0e821e73 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:36.631771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1b7fefad-b04d-4ccb-9efb-e8fd0e821e73 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1319 microversion: 2.1 time: 0.153164 Aug 30 14:45:36.632350 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 226/444] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:36 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:36.677962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c65027ba-2cf5-4a67-9f12-1c8bab2782fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:36.687015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c65027ba-2cf5-4a67-9f12-1c8bab2782fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:36.688492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c65027ba-2cf5-4a67-9f12-1c8bab2782fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:36.689656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c65027ba-2cf5-4a67-9f12-1c8bab2782fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.153780 Aug 30 14:45:36.690212 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 219/445] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:36 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:45:37.238138 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4991ca81-2e96-4e6d-abd1-b888939018ba tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:37.238835 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4991ca81-2e96-4e6d-abd1-b888939018ba tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:37.245746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4991ca81-2e96-4e6d-abd1-b888939018ba tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:37.246328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4991ca81-2e96-4e6d-abd1-b888939018ba tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:37.246925 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4991ca81-2e96-4e6d-abd1-b888939018ba tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:37.247662 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4991ca81-2e96-4e6d-abd1-b888939018ba tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:37.248818 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4991ca81-2e96-4e6d-abd1-b888939018ba tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:37.249258 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4991ca81-2e96-4e6d-abd1-b888939018ba tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:37.444772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4991ca81-2e96-4e6d-abd1-b888939018ba tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:37.453067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4991ca81-2e96-4e6d-abd1-b888939018ba tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1504 microversion: 2.1 time: 0.219168 Aug 30 14:45:37.453657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 227/446] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:37 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:37.630740 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-36562bd8-3c30-4001-9271-b88a1491cc14 req-35c80315-1351-49b7-ac91-d2aee4fbfc0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42bd75a4-4d0a-4ff5-92e6-0b6c222a3744", "name": "network-vif-deleted", "tag": "4bb27bf9-4d67-42eb-ae1a-3b416edc85fb"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:37.641083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-36562bd8-3c30-4001-9271-b88a1491cc14 req-35c80315-1351-49b7-ac91-d2aee4fbfc0d service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:37.641564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-36562bd8-3c30-4001-9271-b88a1491cc14 req-35c80315-1351-49b7-ac91-d2aee4fbfc0d service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:37.641989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-36562bd8-3c30-4001-9271-b88a1491cc14 req-35c80315-1351-49b7-ac91-d2aee4fbfc0d service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:37.652876 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-36562bd8-3c30-4001-9271-b88a1491cc14 req-35c80315-1351-49b7-ac91-d2aee4fbfc0d service nova] Creating event network-vif-deleted:4bb27bf9-4d67-42eb-ae1a-3b416edc85fb for instance 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 on hv-cinder-82880 Aug 30 14:45:37.653507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4682e695-008e-470e-8db8-04ef4067852d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:37.654727 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4682e695-008e-470e-8db8-04ef4067852d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:37.657837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-36562bd8-3c30-4001-9271-b88a1491cc14 req-35c80315-1351-49b7-ac91-d2aee4fbfc0d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030804 Aug 30 14:45:37.658829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 220/447] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:45:37.667132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4682e695-008e-470e-8db8-04ef4067852d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:37.668218 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4682e695-008e-470e-8db8-04ef4067852d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:37.668686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4682e695-008e-470e-8db8-04ef4067852d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:37.669371 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4682e695-008e-470e-8db8-04ef4067852d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:37.669817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4682e695-008e-470e-8db8-04ef4067852d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:37.670241 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4682e695-008e-470e-8db8-04ef4067852d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:37.717900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-24804e59-3c4a-465f-803d-63096feff909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:37.719128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-24804e59-3c4a-465f-803d-63096feff909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:37.731953 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24804e59-3c4a-465f-803d-63096feff909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:37.733136 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24804e59-3c4a-465f-803d-63096feff909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:37.733847 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24804e59-3c4a-465f-803d-63096feff909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:37.734635 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24804e59-3c4a-465f-803d-63096feff909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:37.737799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24804e59-3c4a-465f-803d-63096feff909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:37.738505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24804e59-3c4a-465f-803d-63096feff909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:37.805778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4682e695-008e-470e-8db8-04ef4067852d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:37.813349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4682e695-008e-470e-8db8-04ef4067852d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1319 microversion: 2.1 time: 0.165115 Aug 30 14:45:37.813922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 228/448] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:37 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:37.877139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-24804e59-3c4a-465f-803d-63096feff909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:37.885609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-24804e59-3c4a-465f-803d-63096feff909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:37.887056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-24804e59-3c4a-465f-803d-63096feff909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:37.888243 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-24804e59-3c4a-465f-803d-63096feff909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.178655 Aug 30 14:45:37.888836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 221/449] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:37 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:38.474060 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b15993b5-0b98-4e7c-9d8d-6b57d3e89355 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:38.474598 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b15993b5-0b98-4e7c-9d8d-6b57d3e89355 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:38.481284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b15993b5-0b98-4e7c-9d8d-6b57d3e89355 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:38.481772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b15993b5-0b98-4e7c-9d8d-6b57d3e89355 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:38.482205 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b15993b5-0b98-4e7c-9d8d-6b57d3e89355 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:38.482903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b15993b5-0b98-4e7c-9d8d-6b57d3e89355 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:38.483393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b15993b5-0b98-4e7c-9d8d-6b57d3e89355 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:38.483825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b15993b5-0b98-4e7c-9d8d-6b57d3e89355 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:38.547036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b15993b5-0b98-4e7c-9d8d-6b57d3e89355 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:38.554661 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b15993b5-0b98-4e7c-9d8d-6b57d3e89355 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1299 microversion: 2.1 time: 0.084624 Aug 30 14:45:38.555753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 229/450] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:38 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:38.833968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c3381503-0510-4e00-81ef-afbf950d5291 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:38.834681 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c3381503-0510-4e00-81ef-afbf950d5291 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:38.841460 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3381503-0510-4e00-81ef-afbf950d5291 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:38.841935 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3381503-0510-4e00-81ef-afbf950d5291 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:38.842363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3381503-0510-4e00-81ef-afbf950d5291 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:38.843042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3381503-0510-4e00-81ef-afbf950d5291 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:38.843542 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3381503-0510-4e00-81ef-afbf950d5291 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:38.843955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3381503-0510-4e00-81ef-afbf950d5291 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:38.912997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-81d8c580-0c95-4c55-8a90-d27f525d7f96 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:38.914419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-81d8c580-0c95-4c55-8a90-d27f525d7f96 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:38.925108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81d8c580-0c95-4c55-8a90-d27f525d7f96 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:38.927143 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81d8c580-0c95-4c55-8a90-d27f525d7f96 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:38.928109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81d8c580-0c95-4c55-8a90-d27f525d7f96 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:38.929933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81d8c580-0c95-4c55-8a90-d27f525d7f96 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:38.931657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81d8c580-0c95-4c55-8a90-d27f525d7f96 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:38.933825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81d8c580-0c95-4c55-8a90-d27f525d7f96 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:38.989743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c3381503-0510-4e00-81ef-afbf950d5291 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:39.015365 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c3381503-0510-4e00-81ef-afbf950d5291 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1319 microversion: 2.1 time: 0.169152 Aug 30 14:45:39.016056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 222/451] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:38 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:39.094039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-81d8c580-0c95-4c55-8a90-d27f525d7f96 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:39.103840 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-81d8c580-0c95-4c55-8a90-d27f525d7f96 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:39.105390 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-81d8c580-0c95-4c55-8a90-d27f525d7f96 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:39.106552 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-81d8c580-0c95-4c55-8a90-d27f525d7f96 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.198741 Aug 30 14:45:39.107094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 230/452] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:38 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:45:39.576795 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9c6bcffe-5d0e-4185-9724-3829f5825dbf tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:39.577425 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9c6bcffe-5d0e-4185-9724-3829f5825dbf tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:39.584396 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c6bcffe-5d0e-4185-9724-3829f5825dbf tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:39.584879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c6bcffe-5d0e-4185-9724-3829f5825dbf tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:39.585306 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c6bcffe-5d0e-4185-9724-3829f5825dbf tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:39.585985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c6bcffe-5d0e-4185-9724-3829f5825dbf tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:39.586979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c6bcffe-5d0e-4185-9724-3829f5825dbf tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:39.587589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c6bcffe-5d0e-4185-9724-3829f5825dbf tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:39.619617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c6bcffe-5d0e-4185-9724-3829f5825dbf tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:39.620011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c6bcffe-5d0e-4185-9724-3829f5825dbf tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:39.620453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c6bcffe-5d0e-4185-9724-3829f5825dbf tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:39.620874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-9c6bcffe-5d0e-4185-9724-3829f5825dbf tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lazy-loading 'fault' on Instance uuid 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:45:39.664536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9c6bcffe-5d0e-4185-9724-3829f5825dbf tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:39.672517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9c6bcffe-5d0e-4185-9724-3829f5825dbf tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 200 len: 1304 microversion: 2.1 time: 0.100285 Aug 30 14:45:39.673082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 223/453] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:39 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:40.035659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e909ec78-d765-44dc-80b1-7b63adcee8f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:40.036203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e909ec78-d765-44dc-80b1-7b63adcee8f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:40.042583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e909ec78-d765-44dc-80b1-7b63adcee8f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:40.043058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e909ec78-d765-44dc-80b1-7b63adcee8f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:40.043516 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e909ec78-d765-44dc-80b1-7b63adcee8f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:40.044195 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e909ec78-d765-44dc-80b1-7b63adcee8f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:40.044639 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e909ec78-d765-44dc-80b1-7b63adcee8f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:40.045057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e909ec78-d765-44dc-80b1-7b63adcee8f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:40.129471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-47fcbc89-d88e-4f85-8d9b-0f441d5f07ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:40.130077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-47fcbc89-d88e-4f85-8d9b-0f441d5f07ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:40.137067 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47fcbc89-d88e-4f85-8d9b-0f441d5f07ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:40.137548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47fcbc89-d88e-4f85-8d9b-0f441d5f07ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:40.137978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47fcbc89-d88e-4f85-8d9b-0f441d5f07ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:40.138665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47fcbc89-d88e-4f85-8d9b-0f441d5f07ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:40.139110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47fcbc89-d88e-4f85-8d9b-0f441d5f07ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:40.139561 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47fcbc89-d88e-4f85-8d9b-0f441d5f07ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:40.170893 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e909ec78-d765-44dc-80b1-7b63adcee8f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:40.178545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e909ec78-d765-44dc-80b1-7b63adcee8f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1319 microversion: 2.1 time: 0.146823 Aug 30 14:45:40.179115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 231/454] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:40 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:40.267170 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-47fcbc89-d88e-4f85-8d9b-0f441d5f07ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:40.277197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-47fcbc89-d88e-4f85-8d9b-0f441d5f07ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:40.278635 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-47fcbc89-d88e-4f85-8d9b-0f441d5f07ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:40.279966 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-47fcbc89-d88e-4f85-8d9b-0f441d5f07ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.154343 Aug 30 14:45:40.280622 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 224/455] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:40 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:45:40.562646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-b932f52b-196b-4942-8c06-5ecbfc4c5e4c req-57f2fa8e-5bdc-44d9-aaa3-7ad16ee2e660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df823286-f7fd-4dbf-acb5-7cd297f48da0", "name": "network-vif-plugged", "status": "completed", "tag": "356c248c-dbd2-4ea8-93cc-dd834560932d"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:40.572788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-b932f52b-196b-4942-8c06-5ecbfc4c5e4c req-57f2fa8e-5bdc-44d9-aaa3-7ad16ee2e660 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:40.573259 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-b932f52b-196b-4942-8c06-5ecbfc4c5e4c req-57f2fa8e-5bdc-44d9-aaa3-7ad16ee2e660 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:40.573685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-b932f52b-196b-4942-8c06-5ecbfc4c5e4c req-57f2fa8e-5bdc-44d9-aaa3-7ad16ee2e660 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:40.586504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-b932f52b-196b-4942-8c06-5ecbfc4c5e4c req-57f2fa8e-5bdc-44d9-aaa3-7ad16ee2e660 service nova] Creating event network-vif-plugged:356c248c-dbd2-4ea8-93cc-dd834560932d for instance df823286-f7fd-4dbf-acb5-7cd297f48da0 on hv-cinder-82880 Aug 30 14:45:40.591891 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-b932f52b-196b-4942-8c06-5ecbfc4c5e4c req-57f2fa8e-5bdc-44d9-aaa3-7ad16ee2e660 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032809 Aug 30 14:45:40.592503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 232/456] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:45:40.693875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2849b810-41ba-4b07-bc2c-f889e97a30bd tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:40.694484 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2849b810-41ba-4b07-bc2c-f889e97a30bd tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:40.698284 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:40.702271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2849b810-41ba-4b07-bc2c-f889e97a30bd tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:40.702751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2849b810-41ba-4b07-bc2c-f889e97a30bd tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:40.703177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2849b810-41ba-4b07-bc2c-f889e97a30bd tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:40.703893 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2849b810-41ba-4b07-bc2c-f889e97a30bd tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:40.704338 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2849b810-41ba-4b07-bc2c-f889e97a30bd tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:40.704764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2849b810-41ba-4b07-bc2c-f889e97a30bd tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:40.721009 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-2849b810-41ba-4b07-bc2c-f889e97a30bd tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] HTTP exception thrown: Instance 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 could not be found. Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2849b810-41ba-4b07-bc2c-f889e97a30bd tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Request method failure captured: Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 HTTP/1.1 Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDiJuN_cqh63WXEPx5CKVR6P0DrgPx5mnWW-FdgVU1No3zn9sLDi0KOSvy1zEHJlY130PfRsAyKOIi5o6g9EfwqI4_gR2EPw9ZKtjGCXVWll-1gB5thEw8vkA8Skn4uK-wie3tXeJWiEMUTG2brZ181mB1febI0uuzT8eAmUFl0qz9QU Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: e67c28ec4d3949dc9d00e70f61b5657f Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesActionsTest-1318175984 Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 14:45:40.722615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 14:45:40.724130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e67c28ec4d3949dc9d00e70f61b5657f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e67c28ec4d3949dc9d00e70f61b5657f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e67c28ec4d3949dc9d00e70f61b5657f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e67c28ec4d3949dc9d00e70f61b5657f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:45:40.724130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesActionsTest-1318175984 Aug 30 14:45:40.724130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: e67c28ec4d3949dc9d00e70f61b5657f Aug 30 14:45:40.724130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesActionsTest-1318175984 Aug 30 14:45:40.724130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesActionsTest-1318175984-project Aug 30 14:45:40.724130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 14:45:40.724130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 14:45:40.724130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: a5dd8cf0a16345c5b2973552f0881893 Aug 30 14:45:40.724130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesActionsTest-1318175984-project Aug 30 14:45:40.724130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 14:45:40.724130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 could not be found. Aug 30 14:45:40.724130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': '42bd75a4-4d0a-4ff5-92e6-0b6c222a3744'} Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 could not be found. Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:45:40.724909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 could not be found. Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 could not be found. Aug 30 14:45:40.726152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:45:40.727350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2849b810-41ba-4b07-bc2c-f889e97a30bd tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Returning 404 to user: Instance 42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:45:40.727350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2849b810-41ba-4b07-bc2c-f889e97a30bd tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744" status: 404 len: 111 microversion: 2.1 time: 0.034252 Aug 30 14:45:40.727350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 225/457] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:40 2022] GET /compute/v2.1/servers/42bd75a4-4d0a-4ff5-92e6-0b6c222a3744 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:45:40.827225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1323285511", "imageRef": "fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b", "flavorRef": "452", "networks": [{"uuid": "582043b5-356e-4f2d-aa71-583f5445bff6"}]}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:40.879446 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.network.neutron [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] validate_networks() for [('582043b5-356e-4f2d-aa71-583f5445bff6', None, None, None, None, None)] {{(pid=127089) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:45:41.200422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-455bfa9f-0b7d-4794-9ae8-a0d6a2ef8424 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:41.201031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-455bfa9f-0b7d-4794-9ae8-a0d6a2ef8424 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:41.208012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-455bfa9f-0b7d-4794-9ae8-a0d6a2ef8424 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:41.209424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-455bfa9f-0b7d-4794-9ae8-a0d6a2ef8424 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:41.210085 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-455bfa9f-0b7d-4794-9ae8-a0d6a2ef8424 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:41.213086 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-455bfa9f-0b7d-4794-9ae8-a0d6a2ef8424 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:41.213772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-455bfa9f-0b7d-4794-9ae8-a0d6a2ef8424 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:41.214402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-455bfa9f-0b7d-4794-9ae8-a0d6a2ef8424 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:41.255701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Flavor limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:45:41.256231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Image limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:45:41.256584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Flavor pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:45:41.257048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Image pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:45:41.257462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:45:41.266569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:41.267048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:41.267512 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:41.268236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:41.268685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:41.269102 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:41.286702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Getting quotas for project e67c28ec4d3949dc9d00e70f61b5657f. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:45:41.291802 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Getting quotas for user a5dd8cf0a16345c5b2973552f0881893 and project e67c28ec4d3949dc9d00e70f61b5657f. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:45:41.303854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Going to run 1 instances... {{(pid=127089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:45:41.306883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:45:41.351733 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-455bfa9f-0b7d-4794-9ae8-a0d6a2ef8424 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:41.352503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2eb647d0-f0e5-4fb3-bb82-86f0cfd3228b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528986 Aug 30 14:45:41.359238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 233/458] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 14:45:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:45:41.359415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5b8fefb6-daee-4376-a556-ab862a1db227 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:41.360044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5b8fefb6-daee-4376-a556-ab862a1db227 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:41.361103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-455bfa9f-0b7d-4794-9ae8-a0d6a2ef8424 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1319 microversion: 2.1 time: 0.164630 Aug 30 14:45:41.362077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 226/459] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:41 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:41.367058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-97aad1a9-5370-421e-bc4a-895a39d7f0f1 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:41.368284 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-97aad1a9-5370-421e-bc4a-895a39d7f0f1 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:41.378619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b8fefb6-daee-4376-a556-ab862a1db227 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:41.379109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b8fefb6-daee-4376-a556-ab862a1db227 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:41.379570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b8fefb6-daee-4376-a556-ab862a1db227 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:41.380306 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b8fefb6-daee-4376-a556-ab862a1db227 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:41.380759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b8fefb6-daee-4376-a556-ab862a1db227 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:41.381180 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b8fefb6-daee-4376-a556-ab862a1db227 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:41.427038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-97aad1a9-5370-421e-bc4a-895a39d7f0f1 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:41.434997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-97aad1a9-5370-421e-bc4a-895a39d7f0f1 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1214 microversion: 2.1 time: 0.071648 Aug 30 14:45:41.439242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 227/460] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:41 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:41.516686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5b8fefb6-daee-4376-a556-ab862a1db227 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:41.527242 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5b8fefb6-daee-4376-a556-ab862a1db227 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:41.528747 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5b8fefb6-daee-4376-a556-ab862a1db227 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:41.529961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5b8fefb6-daee-4376-a556-ab862a1db227 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.175432 Aug 30 14:45:41.530513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 234/461] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:41 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:42.386643 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f04c4b38-d352-44c1-af1a-0a614829d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:42.387332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f04c4b38-d352-44c1-af1a-0a614829d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:42.393633 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f04c4b38-d352-44c1-af1a-0a614829d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:42.394101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f04c4b38-d352-44c1-af1a-0a614829d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:42.395328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f04c4b38-d352-44c1-af1a-0a614829d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:42.396039 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f04c4b38-d352-44c1-af1a-0a614829d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:42.396506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f04c4b38-d352-44c1-af1a-0a614829d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:42.396909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f04c4b38-d352-44c1-af1a-0a614829d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:42.457525 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-82e36af2-cc56-4102-a201-9493de8d5d4a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:42.458150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-82e36af2-cc56-4102-a201-9493de8d5d4a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:42.469847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82e36af2-cc56-4102-a201-9493de8d5d4a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:42.470456 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82e36af2-cc56-4102-a201-9493de8d5d4a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:42.470973 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82e36af2-cc56-4102-a201-9493de8d5d4a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:42.471915 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82e36af2-cc56-4102-a201-9493de8d5d4a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:42.472542 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82e36af2-cc56-4102-a201-9493de8d5d4a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:42.472972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82e36af2-cc56-4102-a201-9493de8d5d4a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:42.546573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f04c4b38-d352-44c1-af1a-0a614829d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:42.556354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f04c4b38-d352-44c1-af1a-0a614829d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1319 microversion: 2.1 time: 0.174272 Aug 30 14:45:42.557365 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 228/462] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:42 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:42.561839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-381373dc-e7e4-4e43-9f71-c349170fdc39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:42.562714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-381373dc-e7e4-4e43-9f71-c349170fdc39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:42.565746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-82e36af2-cc56-4102-a201-9493de8d5d4a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:42.569928 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-381373dc-e7e4-4e43-9f71-c349170fdc39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:42.570610 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-381373dc-e7e4-4e43-9f71-c349170fdc39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:42.571631 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-381373dc-e7e4-4e43-9f71-c349170fdc39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:42.572328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-381373dc-e7e4-4e43-9f71-c349170fdc39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:42.572772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-381373dc-e7e4-4e43-9f71-c349170fdc39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:42.573361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-381373dc-e7e4-4e43-9f71-c349170fdc39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:42.575564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-82e36af2-cc56-4102-a201-9493de8d5d4a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1266 microversion: 2.1 time: 0.123323 Aug 30 14:45:42.576131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 235/463] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:42 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:42.620085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-c67b811d-fe35-449f-bd17-189a5837da8f req-2c8efa43-043f-49a6-826d-0acc2789a44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cae1b8-5973-4846-b2f4-79ed7e98be62", "name": "network-vif-plugged", "status": "completed", "tag": "43ef8efc-c930-4960-9ef2-48d6d5f548da"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:42.629462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-c67b811d-fe35-449f-bd17-189a5837da8f req-2c8efa43-043f-49a6-826d-0acc2789a44a service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:42.629926 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-c67b811d-fe35-449f-bd17-189a5837da8f req-2c8efa43-043f-49a6-826d-0acc2789a44a service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:42.630346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-c67b811d-fe35-449f-bd17-189a5837da8f req-2c8efa43-043f-49a6-826d-0acc2789a44a service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:42.641105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-c67b811d-fe35-449f-bd17-189a5837da8f req-2c8efa43-043f-49a6-826d-0acc2789a44a service nova] Creating event network-vif-plugged:43ef8efc-c930-4960-9ef2-48d6d5f548da for instance 38cae1b8-5973-4846-b2f4-79ed7e98be62 on hv-cinder-82880 Aug 30 14:45:42.645861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-c67b811d-fe35-449f-bd17-189a5837da8f req-2c8efa43-043f-49a6-826d-0acc2789a44a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030062 Aug 30 14:45:42.646442 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 236/464] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:45:42.708019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-381373dc-e7e4-4e43-9f71-c349170fdc39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:42.716616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-381373dc-e7e4-4e43-9f71-c349170fdc39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:42.718058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-381373dc-e7e4-4e43-9f71-c349170fdc39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:42.719232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-381373dc-e7e4-4e43-9f71-c349170fdc39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.160933 Aug 30 14:45:42.719801 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 229/465] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:42 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:43.578693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b966e4d8-34f9-4c6e-907b-bc040fcc6e3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:43.579427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b966e4d8-34f9-4c6e-907b-bc040fcc6e3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:43.585882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b966e4d8-34f9-4c6e-907b-bc040fcc6e3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:43.586326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b966e4d8-34f9-4c6e-907b-bc040fcc6e3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:43.587325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b966e4d8-34f9-4c6e-907b-bc040fcc6e3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:43.588027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b966e4d8-34f9-4c6e-907b-bc040fcc6e3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:43.588477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b966e4d8-34f9-4c6e-907b-bc040fcc6e3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:43.588896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b966e4d8-34f9-4c6e-907b-bc040fcc6e3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:43.596443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6e757439-9d27-4ac3-a237-ca4180e21353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:43.597062 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6e757439-9d27-4ac3-a237-ca4180e21353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:43.603611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e757439-9d27-4ac3-a237-ca4180e21353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:43.604097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e757439-9d27-4ac3-a237-ca4180e21353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:43.604528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e757439-9d27-4ac3-a237-ca4180e21353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:43.605220 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e757439-9d27-4ac3-a237-ca4180e21353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:43.605672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e757439-9d27-4ac3-a237-ca4180e21353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:43.606093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6e757439-9d27-4ac3-a237-ca4180e21353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:43.693966 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6e757439-9d27-4ac3-a237-ca4180e21353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:43.713771 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6e757439-9d27-4ac3-a237-ca4180e21353 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1266 microversion: 2.1 time: 0.120935 Aug 30 14:45:43.731372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 230/466] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:43 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:43.741204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b966e4d8-34f9-4c6e-907b-bc040fcc6e3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:43.745179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cd867c5b-f9c3-4385-bdf4-ce3a9c5dbc3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:43.746464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cd867c5b-f9c3-4385-bdf4-ce3a9c5dbc3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:43.751312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b966e4d8-34f9-4c6e-907b-bc040fcc6e3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1319 microversion: 2.1 time: 0.177188 Aug 30 14:45:43.752217 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 237/467] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:43 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:43.753027 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd867c5b-f9c3-4385-bdf4-ce3a9c5dbc3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:43.753614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd867c5b-f9c3-4385-bdf4-ce3a9c5dbc3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:43.754130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd867c5b-f9c3-4385-bdf4-ce3a9c5dbc3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:43.755119 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd867c5b-f9c3-4385-bdf4-ce3a9c5dbc3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:43.755682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd867c5b-f9c3-4385-bdf4-ce3a9c5dbc3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:43.756180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd867c5b-f9c3-4385-bdf4-ce3a9c5dbc3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:43.905808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cd867c5b-f9c3-4385-bdf4-ce3a9c5dbc3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:43.914404 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cd867c5b-f9c3-4385-bdf4-ce3a9c5dbc3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:43.915851 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cd867c5b-f9c3-4385-bdf4-ce3a9c5dbc3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:43.917013 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cd867c5b-f9c3-4385-bdf4-ce3a9c5dbc3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1806 microversion: 2.20 time: 0.177968 Aug 30 14:45:43.917571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 231/468] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:43 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:45:44.686341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7ee46003-ec5d-410d-ab5f-d4ee75305795 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:44.687031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7ee46003-ec5d-410d-ab5f-d4ee75305795 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:44.694987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ee46003-ec5d-410d-ab5f-d4ee75305795 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:44.695508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ee46003-ec5d-410d-ab5f-d4ee75305795 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:44.695950 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ee46003-ec5d-410d-ab5f-d4ee75305795 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:44.696826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ee46003-ec5d-410d-ab5f-d4ee75305795 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:44.697418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ee46003-ec5d-410d-ab5f-d4ee75305795 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:44.698051 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ee46003-ec5d-410d-ab5f-d4ee75305795 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:44.734501 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-36a8e005-56f3-47d6-b3bf-1dd05ef39445 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:44.735782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-36a8e005-56f3-47d6-b3bf-1dd05ef39445 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:44.742166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36a8e005-56f3-47d6-b3bf-1dd05ef39445 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:44.742697 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36a8e005-56f3-47d6-b3bf-1dd05ef39445 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:44.743131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36a8e005-56f3-47d6-b3bf-1dd05ef39445 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:44.744023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36a8e005-56f3-47d6-b3bf-1dd05ef39445 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:44.744485 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36a8e005-56f3-47d6-b3bf-1dd05ef39445 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:44.744899 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36a8e005-56f3-47d6-b3bf-1dd05ef39445 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:44.828484 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-36a8e005-56f3-47d6-b3bf-1dd05ef39445 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:44.837862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-36a8e005-56f3-47d6-b3bf-1dd05ef39445 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1272 microversion: 2.1 time: 0.107062 Aug 30 14:45:44.838484 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 232/469] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:44 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:44.851369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.objects.instance [None req-7ee46003-ec5d-410d-ab5f-d4ee75305795 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lazy-loading 'services' on Instance uuid c9dfd407-56eb-4670-8ee7-5e0cabe294e3 {{(pid=127089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:45:44.857461 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8b5be677-63b6-4ce4-9a1c-0ae8a6508014 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:44.858073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8b5be677-63b6-4ce4-9a1c-0ae8a6508014 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:44.864334 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b5be677-63b6-4ce4-9a1c-0ae8a6508014 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:44.864812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b5be677-63b6-4ce4-9a1c-0ae8a6508014 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:44.865421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b5be677-63b6-4ce4-9a1c-0ae8a6508014 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:44.866118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b5be677-63b6-4ce4-9a1c-0ae8a6508014 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:44.866569 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b5be677-63b6-4ce4-9a1c-0ae8a6508014 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:44.866987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b5be677-63b6-4ce4-9a1c-0ae8a6508014 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:44.970394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7ee46003-ec5d-410d-ab5f-d4ee75305795 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/os-volume_attachments/fd340d06-1624-49eb-82ab-202c7aa240d5" status: 202 len: 0 microversion: 2.1 time: 0.287624 Aug 30 14:45:44.970862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 238/470] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 14:45:44 2022] DELETE /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/os-volume_attachments/fd340d06-1624-49eb-82ab-202c7aa240d5 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:45:44.982032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1f2ff271-8571-4dfb-9945-1a9be03aff9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:44.982747 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1f2ff271-8571-4dfb-9945-1a9be03aff9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:44.990863 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f2ff271-8571-4dfb-9945-1a9be03aff9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:44.991415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f2ff271-8571-4dfb-9945-1a9be03aff9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:44.991852 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f2ff271-8571-4dfb-9945-1a9be03aff9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:44.993101 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f2ff271-8571-4dfb-9945-1a9be03aff9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:44.994033 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f2ff271-8571-4dfb-9945-1a9be03aff9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:44.994461 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f2ff271-8571-4dfb-9945-1a9be03aff9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:45.138700 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1f2ff271-8571-4dfb-9945-1a9be03aff9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:45.148477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1f2ff271-8571-4dfb-9945-1a9be03aff9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:45.149982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1f2ff271-8571-4dfb-9945-1a9be03aff9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:45.151173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1f2ff271-8571-4dfb-9945-1a9be03aff9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1793 microversion: 2.20 time: 0.179011 Aug 30 14:45:45.152042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 239/471] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:45:44 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1793 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:45:45.319341 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8b5be677-63b6-4ce4-9a1c-0ae8a6508014 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:45.327852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8b5be677-63b6-4ce4-9a1c-0ae8a6508014 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1319 microversion: 2.1 time: 0.474209 Aug 30 14:45:45.328463 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 233/472] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:44 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:45.863235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-72dc721f-50a2-4cdd-a578-adcedd4464f0 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:45.865034 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-72dc721f-50a2-4cdd-a578-adcedd4464f0 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:45.869813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:45.876335 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-72dc721f-50a2-4cdd-a578-adcedd4464f0 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:45.876820 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-72dc721f-50a2-4cdd-a578-adcedd4464f0 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:45.877248 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-72dc721f-50a2-4cdd-a578-adcedd4464f0 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:45.877938 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-72dc721f-50a2-4cdd-a578-adcedd4464f0 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:45.878382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-72dc721f-50a2-4cdd-a578-adcedd4464f0 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:45.878797 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-72dc721f-50a2-4cdd-a578-adcedd4464f0 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:46.008407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-72dc721f-50a2-4cdd-a578-adcedd4464f0 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:46.016045 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-72dc721f-50a2-4cdd-a578-adcedd4464f0 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1314 microversion: 2.1 time: 0.157119 Aug 30 14:45:46.016620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 240/473] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:45 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:46.350195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d9ed7f0f-d359-4142-8d68-fd147247c6f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:46.350906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d9ed7f0f-d359-4142-8d68-fd147247c6f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:46.358256 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9ed7f0f-d359-4142-8d68-fd147247c6f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:46.358760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9ed7f0f-d359-4142-8d68-fd147247c6f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:46.359173 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9ed7f0f-d359-4142-8d68-fd147247c6f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:46.359907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9ed7f0f-d359-4142-8d68-fd147247c6f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:46.360336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9ed7f0f-d359-4142-8d68-fd147247c6f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:46.360748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9ed7f0f-d359-4142-8d68-fd147247c6f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:46.389382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-214452bf-a49f-493c-9fc9-bef5756ee32c req-989504d5-ed04-4710-b2ef-25f262d7f673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c1ab0c-6f53-4ea8-ac39-673deabd6975", "tag": "35ced3b0-5211-4ad9-b1ad-847e474e8328"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:46.401046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-214452bf-a49f-493c-9fc9-bef5756ee32c req-989504d5-ed04-4710-b2ef-25f262d7f673 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:46.401547 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-214452bf-a49f-493c-9fc9-bef5756ee32c req-989504d5-ed04-4710-b2ef-25f262d7f673 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:46.402171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-214452bf-a49f-493c-9fc9-bef5756ee32c req-989504d5-ed04-4710-b2ef-25f262d7f673 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:46.418801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-214452bf-a49f-493c-9fc9-bef5756ee32c req-989504d5-ed04-4710-b2ef-25f262d7f673 service nova] Creating event network-changed:35ced3b0-5211-4ad9-b1ad-847e474e8328 for instance 56c1ab0c-6f53-4ea8-ac39-673deabd6975 on hv-cinder-82880 Aug 30 14:45:46.423493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-214452bf-a49f-493c-9fc9-bef5756ee32c req-989504d5-ed04-4710-b2ef-25f262d7f673 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037840 Aug 30 14:45:46.424093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 241/474] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:45:46.549262 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d9ed7f0f-d359-4142-8d68-fd147247c6f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:46.556970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d9ed7f0f-d359-4142-8d68-fd147247c6f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1508 microversion: 2.1 time: 0.211064 Aug 30 14:45:46.557532 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 234/475] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:46 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1508 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:47.038528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c771d365-a1ae-4a60-a071-137fae0472ce tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:47.039261 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c771d365-a1ae-4a60-a071-137fae0472ce tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:47.046384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c771d365-a1ae-4a60-a071-137fae0472ce tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:47.046904 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c771d365-a1ae-4a60-a071-137fae0472ce tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:47.047347 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c771d365-a1ae-4a60-a071-137fae0472ce tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:47.048238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c771d365-a1ae-4a60-a071-137fae0472ce tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:47.048822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c771d365-a1ae-4a60-a071-137fae0472ce tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:47.049096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c771d365-a1ae-4a60-a071-137fae0472ce tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:47.160399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-977cee9b-d22e-431f-8b6b-66b47ec4d350 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:47.167315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-977cee9b-d22e-431f-8b6b-66b47ec4d350 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:47.167805 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-977cee9b-d22e-431f-8b6b-66b47ec4d350 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:47.168235 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-977cee9b-d22e-431f-8b6b-66b47ec4d350 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:47.171818 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:47.191465 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c771d365-a1ae-4a60-a071-137fae0472ce tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:47.192058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-977cee9b-d22e-431f-8b6b-66b47ec4d350 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Going to try to stop instance {{(pid=127088) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 14:45:47.205903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c771d365-a1ae-4a60-a071-137fae0472ce tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1314 microversion: 2.1 time: 0.172395 Aug 30 14:45:47.207349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 242/476] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:47 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:47.250096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-977cee9b-d22e-431f-8b6b-66b47ec4d350 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "POST /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/action" status: 202 len: 0 microversion: 2.1 time: 0.093518 Aug 30 14:45:47.250719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 235/477] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 14:45:47 2022] POST /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 14:45:47.259564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1a8f8da2-546f-4a8d-9a2f-c0315195e9d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:47.260489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1a8f8da2-546f-4a8d-9a2f-c0315195e9d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:47.266657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1a8f8da2-546f-4a8d-9a2f-c0315195e9d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:47.267149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1a8f8da2-546f-4a8d-9a2f-c0315195e9d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:47.267939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1a8f8da2-546f-4a8d-9a2f-c0315195e9d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:47.268740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1a8f8da2-546f-4a8d-9a2f-c0315195e9d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:47.269369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1a8f8da2-546f-4a8d-9a2f-c0315195e9d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:47.269793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1a8f8da2-546f-4a8d-9a2f-c0315195e9d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:47.274992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:47.402967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1a8f8da2-546f-4a8d-9a2f-c0315195e9d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:47.411503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1a8f8da2-546f-4a8d-9a2f-c0315195e9d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1676 microversion: 2.1 time: 0.156427 Aug 30 14:45:47.412084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 243/478] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:47 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:48.235257 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0310252d-89cc-4e34-8643-93102212f40d tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:48.235955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0310252d-89cc-4e34-8643-93102212f40d tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:48.242127 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0310252d-89cc-4e34-8643-93102212f40d tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:48.243279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0310252d-89cc-4e34-8643-93102212f40d tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:48.243718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0310252d-89cc-4e34-8643-93102212f40d tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:48.244401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0310252d-89cc-4e34-8643-93102212f40d tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:48.244847 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0310252d-89cc-4e34-8643-93102212f40d tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:48.245333 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0310252d-89cc-4e34-8643-93102212f40d tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:48.379425 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0310252d-89cc-4e34-8643-93102212f40d tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:48.387014 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0310252d-89cc-4e34-8643-93102212f40d tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1314 microversion: 2.1 time: 0.156663 Aug 30 14:45:48.387608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 236/479] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:48 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:48.434242 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cb4769ff-0a10-4616-826d-8c96c1e29a26 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:48.434853 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cb4769ff-0a10-4616-826d-8c96c1e29a26 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:48.441680 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb4769ff-0a10-4616-826d-8c96c1e29a26 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:48.442157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb4769ff-0a10-4616-826d-8c96c1e29a26 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:48.442589 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb4769ff-0a10-4616-826d-8c96c1e29a26 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:48.443307 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb4769ff-0a10-4616-826d-8c96c1e29a26 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:48.443759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb4769ff-0a10-4616-826d-8c96c1e29a26 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:48.444185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb4769ff-0a10-4616-826d-8c96c1e29a26 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:48.578356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cb4769ff-0a10-4616-826d-8c96c1e29a26 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:48.586791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cb4769ff-0a10-4616-826d-8c96c1e29a26 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1676 microversion: 2.1 time: 0.155856 Aug 30 14:45:48.587521 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 244/480] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:48 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:49.407852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1a719a93-88d6-47bb-8380-c296af5e8f1f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:49.408383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1a719a93-88d6-47bb-8380-c296af5e8f1f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:49.416368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a719a93-88d6-47bb-8380-c296af5e8f1f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:49.417042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a719a93-88d6-47bb-8380-c296af5e8f1f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:49.417571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a719a93-88d6-47bb-8380-c296af5e8f1f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:49.418446 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a719a93-88d6-47bb-8380-c296af5e8f1f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:49.418998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a719a93-88d6-47bb-8380-c296af5e8f1f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:49.419469 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a719a93-88d6-47bb-8380-c296af5e8f1f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:49.552146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1a719a93-88d6-47bb-8380-c296af5e8f1f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:49.561312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1a719a93-88d6-47bb-8380-c296af5e8f1f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1314 microversion: 2.1 time: 0.156749 Aug 30 14:45:49.561965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 237/481] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:49 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:49.607117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-020bdb31-1a50-4316-8bb0-8a4c384cc58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:49.607758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-020bdb31-1a50-4316-8bb0-8a4c384cc58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:49.614098 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-020bdb31-1a50-4316-8bb0-8a4c384cc58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:49.614575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-020bdb31-1a50-4316-8bb0-8a4c384cc58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:49.615005 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-020bdb31-1a50-4316-8bb0-8a4c384cc58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:49.615724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-020bdb31-1a50-4316-8bb0-8a4c384cc58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:49.616184 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-020bdb31-1a50-4316-8bb0-8a4c384cc58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:49.616596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-020bdb31-1a50-4316-8bb0-8a4c384cc58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:49.752740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-020bdb31-1a50-4316-8bb0-8a4c384cc58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:49.762383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-020bdb31-1a50-4316-8bb0-8a4c384cc58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1676 microversion: 2.1 time: 0.159107 Aug 30 14:45:49.763181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 245/482] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:49 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:50.583101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-46d32935-99cb-4129-80c1-db723cdb776f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:50.584320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-46d32935-99cb-4129-80c1-db723cdb776f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:50.590898 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46d32935-99cb-4129-80c1-db723cdb776f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:50.591421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46d32935-99cb-4129-80c1-db723cdb776f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:50.592759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46d32935-99cb-4129-80c1-db723cdb776f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:50.593810 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46d32935-99cb-4129-80c1-db723cdb776f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:50.594264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46d32935-99cb-4129-80c1-db723cdb776f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:50.594685 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46d32935-99cb-4129-80c1-db723cdb776f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:50.734943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-46d32935-99cb-4129-80c1-db723cdb776f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:50.742896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-46d32935-99cb-4129-80c1-db723cdb776f tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1314 microversion: 2.1 time: 0.163677 Aug 30 14:45:50.743505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 238/483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:50 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:50.786196 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0835adee-b5db-4b4d-8c44-615041288241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:50.786688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0835adee-b5db-4b4d-8c44-615041288241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:50.793837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0835adee-b5db-4b4d-8c44-615041288241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:50.794319 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0835adee-b5db-4b4d-8c44-615041288241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:50.794753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0835adee-b5db-4b4d-8c44-615041288241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:50.795473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0835adee-b5db-4b4d-8c44-615041288241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:50.795924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0835adee-b5db-4b4d-8c44-615041288241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:50.796342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0835adee-b5db-4b4d-8c44-615041288241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:50.930500 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0835adee-b5db-4b4d-8c44-615041288241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:50.938126 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0835adee-b5db-4b4d-8c44-615041288241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1676 microversion: 2.1 time: 0.157327 Aug 30 14:45:50.938686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 246/484] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:50 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:51.764464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f41a4fcb-87cb-415d-a91d-cb09231403ae tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:51.765191 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f41a4fcb-87cb-415d-a91d-cb09231403ae tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:51.767581 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:51.773483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f41a4fcb-87cb-415d-a91d-cb09231403ae tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:51.774511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f41a4fcb-87cb-415d-a91d-cb09231403ae tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:51.774933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f41a4fcb-87cb-415d-a91d-cb09231403ae tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:51.775648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f41a4fcb-87cb-415d-a91d-cb09231403ae tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:51.776089 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f41a4fcb-87cb-415d-a91d-cb09231403ae tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:51.776787 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f41a4fcb-87cb-415d-a91d-cb09231403ae tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:51.909986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f41a4fcb-87cb-415d-a91d-cb09231403ae tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:51.917593 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f41a4fcb-87cb-415d-a91d-cb09231403ae tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1314 microversion: 2.1 time: 0.157135 Aug 30 14:45:51.918161 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 239/485] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:51 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:51.959037 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3467e517-b909-43b2-adbb-184741982914 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:51.959676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3467e517-b909-43b2-adbb-184741982914 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:51.962215 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:51.962941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=6 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:45:51.969007 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3467e517-b909-43b2-adbb-184741982914 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:51.969490 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3467e517-b909-43b2-adbb-184741982914 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:51.969923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3467e517-b909-43b2-adbb-184741982914 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:51.970628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3467e517-b909-43b2-adbb-184741982914 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:51.971085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3467e517-b909-43b2-adbb-184741982914 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:51.971553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3467e517-b909-43b2-adbb-184741982914 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:52.109291 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3467e517-b909-43b2-adbb-184741982914 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:52.116805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3467e517-b909-43b2-adbb-184741982914 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1676 microversion: 2.1 time: 0.161711 Aug 30 14:45:52.117479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 247/486] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:51 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:52.522968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-5d4e30bc-a937-49ff-bb7a-a4b335e2e3a6 req-a95918aa-3778-4f44-b1d2-6fb55b646fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c1ab0c-6f53-4ea8-ac39-673deabd6975", "name": "network-vif-plugged", "status": "completed", "tag": "35ced3b0-5211-4ad9-b1ad-847e474e8328"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:52.533618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-5d4e30bc-a937-49ff-bb7a-a4b335e2e3a6 req-a95918aa-3778-4f44-b1d2-6fb55b646fa8 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:52.534202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-5d4e30bc-a937-49ff-bb7a-a4b335e2e3a6 req-a95918aa-3778-4f44-b1d2-6fb55b646fa8 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:52.534668 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-5d4e30bc-a937-49ff-bb7a-a4b335e2e3a6 req-a95918aa-3778-4f44-b1d2-6fb55b646fa8 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:52.548139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-5d4e30bc-a937-49ff-bb7a-a4b335e2e3a6 req-a95918aa-3778-4f44-b1d2-6fb55b646fa8 service nova] Creating event network-vif-plugged:35ced3b0-5211-4ad9-b1ad-847e474e8328 for instance 56c1ab0c-6f53-4ea8-ac39-673deabd6975 on hv-cinder-82880 Aug 30 14:45:52.552843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-5d4e30bc-a937-49ff-bb7a-a4b335e2e3a6 req-a95918aa-3778-4f44-b1d2-6fb55b646fa8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033540 Aug 30 14:45:52.553443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 240/487] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:45:52.937984 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2c4a9955-cbbf-443d-a1a3-b2fa1e075ac8 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:52.938509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2c4a9955-cbbf-443d-a1a3-b2fa1e075ac8 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:52.944857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c4a9955-cbbf-443d-a1a3-b2fa1e075ac8 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:52.945390 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c4a9955-cbbf-443d-a1a3-b2fa1e075ac8 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:52.946345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c4a9955-cbbf-443d-a1a3-b2fa1e075ac8 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:52.947055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c4a9955-cbbf-443d-a1a3-b2fa1e075ac8 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:52.947541 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c4a9955-cbbf-443d-a1a3-b2fa1e075ac8 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:52.947962 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c4a9955-cbbf-443d-a1a3-b2fa1e075ac8 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:53.074628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2c4a9955-cbbf-443d-a1a3-b2fa1e075ac8 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:53.083171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2c4a9955-cbbf-443d-a1a3-b2fa1e075ac8 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1314 microversion: 2.1 time: 0.148601 Aug 30 14:45:53.083779 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 248/488] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:52 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:53.138394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-91bfbf61-7624-4124-88da-5d28809ae9dd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:53.139178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-91bfbf61-7624-4124-88da-5d28809ae9dd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:53.145779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91bfbf61-7624-4124-88da-5d28809ae9dd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:53.146255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91bfbf61-7624-4124-88da-5d28809ae9dd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:53.146686 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91bfbf61-7624-4124-88da-5d28809ae9dd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:53.147424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91bfbf61-7624-4124-88da-5d28809ae9dd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:53.147874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91bfbf61-7624-4124-88da-5d28809ae9dd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:53.148292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91bfbf61-7624-4124-88da-5d28809ae9dd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:53.281774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-91bfbf61-7624-4124-88da-5d28809ae9dd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:53.290686 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-91bfbf61-7624-4124-88da-5d28809ae9dd tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1676 microversion: 2.1 time: 0.156244 Aug 30 14:45:53.291422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 241/489] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:53 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:45:54.103856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0c8ac7d9-d7c9-4edd-a969-ae96024b016c tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:54.104466 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0c8ac7d9-d7c9-4edd-a969-ae96024b016c tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:54.110844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c8ac7d9-d7c9-4edd-a969-ae96024b016c tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:54.111352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c8ac7d9-d7c9-4edd-a969-ae96024b016c tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:54.111784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c8ac7d9-d7c9-4edd-a969-ae96024b016c tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:54.112466 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c8ac7d9-d7c9-4edd-a969-ae96024b016c tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:54.112914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c8ac7d9-d7c9-4edd-a969-ae96024b016c tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:54.113332 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c8ac7d9-d7c9-4edd-a969-ae96024b016c tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:54.247053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0c8ac7d9-d7c9-4edd-a969-ae96024b016c tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:54.254856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0c8ac7d9-d7c9-4edd-a969-ae96024b016c tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1314 microversion: 2.1 time: 0.154943 Aug 30 14:45:54.255471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 249/490] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:54 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:54.311793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-27a676e7-fb41-4887-8cab-b006e3c0c00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:54.312394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-27a676e7-fb41-4887-8cab-b006e3c0c00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:54.318959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27a676e7-fb41-4887-8cab-b006e3c0c00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:54.319474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27a676e7-fb41-4887-8cab-b006e3c0c00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:54.319894 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27a676e7-fb41-4887-8cab-b006e3c0c00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:54.321234 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27a676e7-fb41-4887-8cab-b006e3c0c00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:54.321728 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27a676e7-fb41-4887-8cab-b006e3c0c00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:54.322143 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27a676e7-fb41-4887-8cab-b006e3c0c00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:54.469361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-27a676e7-fb41-4887-8cab-b006e3c0c00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:54.477656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-27a676e7-fb41-4887-8cab-b006e3c0c00a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1676 microversion: 2.1 time: 0.169091 Aug 30 14:45:54.478232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 242/491] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:54 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:55.275732 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b31be37a-58e0-40da-98e2-38bbac369b00 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:55.276377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b31be37a-58e0-40da-98e2-38bbac369b00 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:55.282836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b31be37a-58e0-40da-98e2-38bbac369b00 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:55.283361 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b31be37a-58e0-40da-98e2-38bbac369b00 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:55.283781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b31be37a-58e0-40da-98e2-38bbac369b00 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:55.284474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b31be37a-58e0-40da-98e2-38bbac369b00 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:55.284923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b31be37a-58e0-40da-98e2-38bbac369b00 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:55.285346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b31be37a-58e0-40da-98e2-38bbac369b00 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:55.421698 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b31be37a-58e0-40da-98e2-38bbac369b00 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:55.429234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b31be37a-58e0-40da-98e2-38bbac369b00 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1498 microversion: 2.1 time: 0.157926 Aug 30 14:45:55.430351 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 250/492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:55 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:55.498717 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-da91d38c-f3c0-4cb2-8363-906fbcc58de5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:55.499476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-da91d38c-f3c0-4cb2-8363-906fbcc58de5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:55.505932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da91d38c-f3c0-4cb2-8363-906fbcc58de5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:55.506410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da91d38c-f3c0-4cb2-8363-906fbcc58de5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:55.506842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da91d38c-f3c0-4cb2-8363-906fbcc58de5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:55.507566 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da91d38c-f3c0-4cb2-8363-906fbcc58de5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:55.508088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da91d38c-f3c0-4cb2-8363-906fbcc58de5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:55.508512 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da91d38c-f3c0-4cb2-8363-906fbcc58de5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:55.644194 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-da91d38c-f3c0-4cb2-8363-906fbcc58de5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:55.652176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-da91d38c-f3c0-4cb2-8363-906fbcc58de5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1676 microversion: 2.1 time: 0.157661 Aug 30 14:45:55.652735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 243/493] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:55 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:56.053713 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ee71ae57-1518-4ff3-a411-fd85061abb3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:56.054260 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ee71ae57-1518-4ff3-a411-fd85061abb3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:56.060664 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee71ae57-1518-4ff3-a411-fd85061abb3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:56.061142 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee71ae57-1518-4ff3-a411-fd85061abb3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:56.061571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee71ae57-1518-4ff3-a411-fd85061abb3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:56.062253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee71ae57-1518-4ff3-a411-fd85061abb3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:56.062694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee71ae57-1518-4ff3-a411-fd85061abb3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:56.063104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee71ae57-1518-4ff3-a411-fd85061abb3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:56.088253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ee71ae57-1518-4ff3-a411-fd85061abb3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Going to try to terminate instance {{(pid=127089) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:45:56.163637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ee71ae57-1518-4ff3-a411-fd85061abb3e tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "DELETE /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 204 len: 0 microversion: 2.1 time: 0.113671 Aug 30 14:45:56.164274 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 251/494] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 14:45:56 2022] DELETE /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:45:56.174296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-85870dc7-53df-4f99-b8fa-7fb02c3ef16b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:56.174907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-85870dc7-53df-4f99-b8fa-7fb02c3ef16b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:56.181456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85870dc7-53df-4f99-b8fa-7fb02c3ef16b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:56.181936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85870dc7-53df-4f99-b8fa-7fb02c3ef16b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:56.182580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85870dc7-53df-4f99-b8fa-7fb02c3ef16b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:56.183382 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85870dc7-53df-4f99-b8fa-7fb02c3ef16b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:56.183997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85870dc7-53df-4f99-b8fa-7fb02c3ef16b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:56.184417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85870dc7-53df-4f99-b8fa-7fb02c3ef16b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:56.315422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-85870dc7-53df-4f99-b8fa-7fb02c3ef16b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:56.323839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-85870dc7-53df-4f99-b8fa-7fb02c3ef16b tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1504 microversion: 2.1 time: 0.153395 Aug 30 14:45:56.324412 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 244/495] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:56 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:56.674490 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-242ba0f8-3284-45b4-babb-5b5ebb1cebed tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:56.675294 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-242ba0f8-3284-45b4-babb-5b5ebb1cebed tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:56.682173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-242ba0f8-3284-45b4-babb-5b5ebb1cebed tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:56.682651 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-242ba0f8-3284-45b4-babb-5b5ebb1cebed tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:56.683081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-242ba0f8-3284-45b4-babb-5b5ebb1cebed tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:56.683802 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-242ba0f8-3284-45b4-babb-5b5ebb1cebed tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:56.684251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-242ba0f8-3284-45b4-babb-5b5ebb1cebed tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:56.684666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-242ba0f8-3284-45b4-babb-5b5ebb1cebed tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:56.821502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-242ba0f8-3284-45b4-babb-5b5ebb1cebed tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:56.829086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-242ba0f8-3284-45b4-babb-5b5ebb1cebed tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1676 microversion: 2.1 time: 0.158870 Aug 30 14:45:56.829649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 252/496] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:56 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:57.346304 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a179e427-eac2-4948-bacb-794c37e4a3d1 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:57.346912 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a179e427-eac2-4948-bacb-794c37e4a3d1 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:57.353689 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a179e427-eac2-4948-bacb-794c37e4a3d1 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:57.354166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a179e427-eac2-4948-bacb-794c37e4a3d1 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:57.354601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a179e427-eac2-4948-bacb-794c37e4a3d1 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:57.355315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a179e427-eac2-4948-bacb-794c37e4a3d1 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:57.355768 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a179e427-eac2-4948-bacb-794c37e4a3d1 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:57.356190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a179e427-eac2-4948-bacb-794c37e4a3d1 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:57.491779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a179e427-eac2-4948-bacb-794c37e4a3d1 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:57.499937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a179e427-eac2-4948-bacb-794c37e4a3d1 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1504 microversion: 2.1 time: 0.157537 Aug 30 14:45:57.500505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 245/497] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:57 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:57.850452 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2de820df-6314-4b14-814f-1532fd63f9e4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:57.851200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2de820df-6314-4b14-814f-1532fd63f9e4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:57.858121 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2de820df-6314-4b14-814f-1532fd63f9e4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:57.858602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2de820df-6314-4b14-814f-1532fd63f9e4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:57.859033 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2de820df-6314-4b14-814f-1532fd63f9e4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:57.859751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2de820df-6314-4b14-814f-1532fd63f9e4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:57.860202 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2de820df-6314-4b14-814f-1532fd63f9e4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:57.860624 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2de820df-6314-4b14-814f-1532fd63f9e4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:57.990024 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2de820df-6314-4b14-814f-1532fd63f9e4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:57.999549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2de820df-6314-4b14-814f-1532fd63f9e4 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1676 microversion: 2.1 time: 0.152983 Aug 30 14:45:58.000122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 253/498] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:57 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:58.520574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f917419c-cf15-48b7-a4a4-063cd1ac502a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:58.521807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f917419c-cf15-48b7-a4a4-063cd1ac502a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:58.528749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f917419c-cf15-48b7-a4a4-063cd1ac502a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:58.529222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f917419c-cf15-48b7-a4a4-063cd1ac502a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:58.529652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f917419c-cf15-48b7-a4a4-063cd1ac502a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:58.530336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f917419c-cf15-48b7-a4a4-063cd1ac502a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:58.530786 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f917419c-cf15-48b7-a4a4-063cd1ac502a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:58.531200 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f917419c-cf15-48b7-a4a4-063cd1ac502a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:58.722497 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f917419c-cf15-48b7-a4a4-063cd1ac502a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:58.731253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f917419c-cf15-48b7-a4a4-063cd1ac502a tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1504 microversion: 2.1 time: 0.214497 Aug 30 14:45:58.731845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 246/499] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:58 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:58.810375 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-37ae6ed8-316b-48f1-9ff9-e35ec751940b req-0e9e9b24-7217-414e-a042-a8d7eae2b619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c1ab0c-6f53-4ea8-ac39-673deabd6975", "name": "network-vif-deleted", "tag": "35ced3b0-5211-4ad9-b1ad-847e474e8328"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:45:58.820031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-37ae6ed8-316b-48f1-9ff9-e35ec751940b req-0e9e9b24-7217-414e-a042-a8d7eae2b619 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:58.821081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-37ae6ed8-316b-48f1-9ff9-e35ec751940b req-0e9e9b24-7217-414e-a042-a8d7eae2b619 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:58.821511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-37ae6ed8-316b-48f1-9ff9-e35ec751940b req-0e9e9b24-7217-414e-a042-a8d7eae2b619 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:58.833974 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-37ae6ed8-316b-48f1-9ff9-e35ec751940b req-0e9e9b24-7217-414e-a042-a8d7eae2b619 service nova] Creating event network-vif-deleted:35ced3b0-5211-4ad9-b1ad-847e474e8328 for instance 56c1ab0c-6f53-4ea8-ac39-673deabd6975 on hv-cinder-82880 Aug 30 14:45:58.838733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-37ae6ed8-316b-48f1-9ff9-e35ec751940b req-0e9e9b24-7217-414e-a042-a8d7eae2b619 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032032 Aug 30 14:45:58.839327 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 254/500] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:45:59.021446 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d539de3b-4107-4d5a-b00e-e0194d12548b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:59.022125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d539de3b-4107-4d5a-b00e-e0194d12548b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:59.028572 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d539de3b-4107-4d5a-b00e-e0194d12548b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:59.029051 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d539de3b-4107-4d5a-b00e-e0194d12548b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:59.029484 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d539de3b-4107-4d5a-b00e-e0194d12548b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:59.030169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d539de3b-4107-4d5a-b00e-e0194d12548b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:59.030812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d539de3b-4107-4d5a-b00e-e0194d12548b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:59.031250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d539de3b-4107-4d5a-b00e-e0194d12548b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:59.166907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d539de3b-4107-4d5a-b00e-e0194d12548b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:59.174833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d539de3b-4107-4d5a-b00e-e0194d12548b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1676 microversion: 2.1 time: 0.157970 Aug 30 14:45:59.175503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 247/501] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:59 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:45:59.754747 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3529b01a-00c5-4169-b81d-72b0769d4041 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:45:59.756236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3529b01a-00c5-4169-b81d-72b0769d4041 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:45:59.763537 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3529b01a-00c5-4169-b81d-72b0769d4041 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:59.764196 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3529b01a-00c5-4169-b81d-72b0769d4041 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:59.764785 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3529b01a-00c5-4169-b81d-72b0769d4041 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:59.765637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3529b01a-00c5-4169-b81d-72b0769d4041 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:59.766328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3529b01a-00c5-4169-b81d-72b0769d4041 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:59.767108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3529b01a-00c5-4169-b81d-72b0769d4041 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:59.800753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3529b01a-00c5-4169-b81d-72b0769d4041 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:45:59.801470 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3529b01a-00c5-4169-b81d-72b0769d4041 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:45:59.802043 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3529b01a-00c5-4169-b81d-72b0769d4041 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:45:59.802638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.objects.instance [None req-3529b01a-00c5-4169-b81d-72b0769d4041 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lazy-loading 'fault' on Instance uuid 56c1ab0c-6f53-4ea8-ac39-673deabd6975 {{(pid=127089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:45:59.843592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3529b01a-00c5-4169-b81d-72b0769d4041 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5dd8cf0a16345c5b2973552f0881893', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e67c28ec4d3949dc9d00e70f61b5657f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:45:59.851164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3529b01a-00c5-4169-b81d-72b0769d4041 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 200 len: 1304 microversion: 2.1 time: 0.101834 Aug 30 14:45:59.852789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 255/502] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:45:59 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:00.197290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d36afef0-d1f6-4319-9e8b-0efe81840a0d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:00.197831 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d36afef0-d1f6-4319-9e8b-0efe81840a0d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:00.204208 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d36afef0-d1f6-4319-9e8b-0efe81840a0d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:00.204717 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d36afef0-d1f6-4319-9e8b-0efe81840a0d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:00.205152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d36afef0-d1f6-4319-9e8b-0efe81840a0d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:00.205838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d36afef0-d1f6-4319-9e8b-0efe81840a0d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:00.206291 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d36afef0-d1f6-4319-9e8b-0efe81840a0d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:00.206714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d36afef0-d1f6-4319-9e8b-0efe81840a0d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:00.336663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d36afef0-d1f6-4319-9e8b-0efe81840a0d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:00.344533 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d36afef0-d1f6-4319-9e8b-0efe81840a0d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1653 microversion: 2.1 time: 0.151654 Aug 30 14:46:00.345105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 248/503] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:00 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1653 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:00.364665 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1069908a-c9d5-44b4-ae5f-fe0cfe4084aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:46:00.371255 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1069908a-c9d5-44b4-ae5f-fe0cfe4084aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:00.371736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1069908a-c9d5-44b4-ae5f-fe0cfe4084aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:00.372165 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1069908a-c9d5-44b4-ae5f-fe0cfe4084aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:00.393995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1069908a-c9d5-44b4-ae5f-fe0cfe4084aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Going to try to start instance {{(pid=127089) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 14:46:00.436066 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1069908a-c9d5-44b4-ae5f-fe0cfe4084aa tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "POST /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/action" status: 202 len: 0 microversion: 2.1 time: 0.074953 Aug 30 14:46:00.436695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 256/504] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 14:46:00 2022] POST /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:46:00.445742 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-71d5316e-c947-4b45-81a0-fff8f7bc7800 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:00.446640 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-71d5316e-c947-4b45-81a0-fff8f7bc7800 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:00.453678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71d5316e-c947-4b45-81a0-fff8f7bc7800 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:00.454134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71d5316e-c947-4b45-81a0-fff8f7bc7800 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:00.454567 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71d5316e-c947-4b45-81a0-fff8f7bc7800 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:00.455482 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71d5316e-c947-4b45-81a0-fff8f7bc7800 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:00.455939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71d5316e-c947-4b45-81a0-fff8f7bc7800 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:00.456433 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71d5316e-c947-4b45-81a0-fff8f7bc7800 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:00.593515 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-71d5316e-c947-4b45-81a0-fff8f7bc7800 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:00.601787 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-71d5316e-c947-4b45-81a0-fff8f7bc7800 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1662 microversion: 2.1 time: 0.160204 Aug 30 14:46:00.602371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 249/505] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:00 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1662 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:00.874652 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1169aa20-fd24-4c4e-8286-e16472441620 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:00.875393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1169aa20-fd24-4c4e-8286-e16472441620 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] [instance: 56c1ab0c-6f53-4ea8-ac39-673deabd6975] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:00.881481 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1169aa20-fd24-4c4e-8286-e16472441620 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:00.881961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1169aa20-fd24-4c4e-8286-e16472441620 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:00.882392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1169aa20-fd24-4c4e-8286-e16472441620 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:00.883176 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1169aa20-fd24-4c4e-8286-e16472441620 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:00.883649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1169aa20-fd24-4c4e-8286-e16472441620 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:00.884069 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1169aa20-fd24-4c4e-8286-e16472441620 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:00.897572 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-1169aa20-fd24-4c4e-8286-e16472441620 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] HTTP exception thrown: Instance 56c1ab0c-6f53-4ea8-ac39-673deabd6975 could not be found. Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1169aa20-fd24-4c4e-8286-e16472441620 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Request method failure captured: Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 HTTP/1.1 Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiJuN_cqh63WXEPx5CKVR6P0DrgPx5mnWW-FdgVU1No3zn9sLDi0KOSvy1zEHJlY130PfRsAyKOIi5o6g9EfwqI4_gR2EPw9ZKtjGCXVWll-1gB5thEw8vkA8Skn4uK-wie3tXeJWiEMUTG2brZ181mB1febI0uuzT8eAmUFl0qz9QU Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: e67c28ec4d3949dc9d00e70f61b5657f Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-VolumesActionsTest-1318175984 Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 14:46:00.899252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 14:46:00.901081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e67c28ec4d3949dc9d00e70f61b5657f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_e67c28ec4d3949dc9d00e70f61b5657f", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/e67c28ec4d3949dc9d00e70f61b5657f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/e67c28ec4d3949dc9d00e70f61b5657f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:46:00.901081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-VolumesActionsTest-1318175984 Aug 30 14:46:00.901081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: e67c28ec4d3949dc9d00e70f61b5657f Aug 30 14:46:00.901081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-VolumesActionsTest-1318175984 Aug 30 14:46:00.901081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-VolumesActionsTest-1318175984-project Aug 30 14:46:00.901081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 14:46:00.901081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 14:46:00.901081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: a5dd8cf0a16345c5b2973552f0881893 Aug 30 14:46:00.901081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-VolumesActionsTest-1318175984-project Aug 30 14:46:00.901081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 14:46:00.901081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance 56c1ab0c-6f53-4ea8-ac39-673deabd6975 could not be found. Aug 30 14:46:00.901081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': '56c1ab0c-6f53-4ea8-ac39-673deabd6975'} Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c1ab0c-6f53-4ea8-ac39-673deabd6975 could not be found. Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:46:00.902047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c1ab0c-6f53-4ea8-ac39-673deabd6975 could not be found. Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c1ab0c-6f53-4ea8-ac39-673deabd6975 could not be found. Aug 30 14:46:00.903505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:46:00.904789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1169aa20-fd24-4c4e-8286-e16472441620 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] Returning 404 to user: Instance 56c1ab0c-6f53-4ea8-ac39-673deabd6975 could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:46:00.904789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1169aa20-fd24-4c4e-8286-e16472441620 tempest-VolumesActionsTest-1318175984 tempest-VolumesActionsTest-1318175984-project] 10.222.0.30 "GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975" status: 404 len: 111 microversion: 2.1 time: 0.030838 Aug 30 14:46:00.904789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 257/506] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:00 2022] GET /compute/v2.1/servers/56c1ab0c-6f53-4ea8-ac39-673deabd6975 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:46:01.626869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-35f7ffd5-556a-4c49-b06a-fe2e22f13681 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:01.627509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-35f7ffd5-556a-4c49-b06a-fe2e22f13681 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:01.633476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35f7ffd5-556a-4c49-b06a-fe2e22f13681 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:01.633980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35f7ffd5-556a-4c49-b06a-fe2e22f13681 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:01.634412 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35f7ffd5-556a-4c49-b06a-fe2e22f13681 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:01.635101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35f7ffd5-556a-4c49-b06a-fe2e22f13681 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:01.635587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35f7ffd5-556a-4c49-b06a-fe2e22f13681 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:01.636013 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35f7ffd5-556a-4c49-b06a-fe2e22f13681 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:01.767010 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-35f7ffd5-556a-4c49-b06a-fe2e22f13681 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:01.775509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-35f7ffd5-556a-4c49-b06a-fe2e22f13681 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1662 microversion: 2.1 time: 0.155464 Aug 30 14:46:01.776068 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 250/507] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:01 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:02.796124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-db13cbbd-98db-4344-9d66-8984a4a05540 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:02.796736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-db13cbbd-98db-4344-9d66-8984a4a05540 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:02.803263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db13cbbd-98db-4344-9d66-8984a4a05540 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:02.803748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db13cbbd-98db-4344-9d66-8984a4a05540 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:02.804184 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db13cbbd-98db-4344-9d66-8984a4a05540 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:02.805372 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db13cbbd-98db-4344-9d66-8984a4a05540 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:02.805829 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db13cbbd-98db-4344-9d66-8984a4a05540 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:02.806246 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db13cbbd-98db-4344-9d66-8984a4a05540 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:02.822719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:02.942021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-db13cbbd-98db-4344-9d66-8984a4a05540 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:02.949792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-db13cbbd-98db-4344-9d66-8984a4a05540 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1662 microversion: 2.1 time: 0.157507 Aug 30 14:46:02.950360 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 258/508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:02 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:03.970529 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7fbe4594-6051-400b-9e37-94c67c4b1640 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:03.971093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7fbe4594-6051-400b-9e37-94c67c4b1640 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:03.977470 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fbe4594-6051-400b-9e37-94c67c4b1640 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:03.978007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fbe4594-6051-400b-9e37-94c67c4b1640 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:03.978435 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fbe4594-6051-400b-9e37-94c67c4b1640 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:03.979109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fbe4594-6051-400b-9e37-94c67c4b1640 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:03.979574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fbe4594-6051-400b-9e37-94c67c4b1640 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:03.979988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fbe4594-6051-400b-9e37-94c67c4b1640 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:03.998052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:04.112854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7fbe4594-6051-400b-9e37-94c67c4b1640 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:04.121005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7fbe4594-6051-400b-9e37-94c67c4b1640 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1662 microversion: 2.1 time: 0.154311 Aug 30 14:46:04.121568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 251/509] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:03 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:05.142780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5dd0fb19-c61d-4574-ba7c-16a0deb72bc9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:05.143425 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5dd0fb19-c61d-4574-ba7c-16a0deb72bc9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:05.150517 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5dd0fb19-c61d-4574-ba7c-16a0deb72bc9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:05.150997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5dd0fb19-c61d-4574-ba7c-16a0deb72bc9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:05.151457 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5dd0fb19-c61d-4574-ba7c-16a0deb72bc9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:05.152151 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5dd0fb19-c61d-4574-ba7c-16a0deb72bc9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:05.152601 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5dd0fb19-c61d-4574-ba7c-16a0deb72bc9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:05.153021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5dd0fb19-c61d-4574-ba7c-16a0deb72bc9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:05.280439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5dd0fb19-c61d-4574-ba7c-16a0deb72bc9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:05.288028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5dd0fb19-c61d-4574-ba7c-16a0deb72bc9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1662 microversion: 2.1 time: 0.149090 Aug 30 14:46:05.288587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 259/510] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:05 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1662 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:06.308516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-92e5f1f6-1987-4ca0-b5fa-acd526b14145 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:06.309155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-92e5f1f6-1987-4ca0-b5fa-acd526b14145 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:06.316136 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92e5f1f6-1987-4ca0-b5fa-acd526b14145 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:06.316624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92e5f1f6-1987-4ca0-b5fa-acd526b14145 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:06.317059 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92e5f1f6-1987-4ca0-b5fa-acd526b14145 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:06.317752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92e5f1f6-1987-4ca0-b5fa-acd526b14145 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:06.318207 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92e5f1f6-1987-4ca0-b5fa-acd526b14145 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:06.318629 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92e5f1f6-1987-4ca0-b5fa-acd526b14145 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:06.446488 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-92e5f1f6-1987-4ca0-b5fa-acd526b14145 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:06.454083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-92e5f1f6-1987-4ca0-b5fa-acd526b14145 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1666 microversion: 2.1 time: 0.149535 Aug 30 14:46:06.454647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 252/511] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:06 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:08.115515 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cbb2f33c-5945-4807-bbba-b8add68aee8b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb4947a0-1df0-41da-8b36-045778982ab8", "device": "/dev/sdb"}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:46:08.119647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cbb2f33c-5945-4807-bbba-b8add68aee8b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:08.128223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb2f33c-5945-4807-bbba-b8add68aee8b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:08.129121 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb2f33c-5945-4807-bbba-b8add68aee8b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:08.129658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb2f33c-5945-4807-bbba-b8add68aee8b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:08.130761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb2f33c-5945-4807-bbba-b8add68aee8b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:08.131432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb2f33c-5945-4807-bbba-b8add68aee8b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:08.131887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb2f33c-5945-4807-bbba-b8add68aee8b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:08.474053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cbb2f33c-5945-4807-bbba-b8add68aee8b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "POST /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362627 Aug 30 14:46:08.475507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 260/512] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 14:46:08 2022] POST /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:46:11.542376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4238b789-de3c-4f11-8014-ade0572e1e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a4622f6-6d77-44f7-9672-b00addcd4459"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:46:11.544908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4238b789-de3c-4f11-8014-ade0572e1e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:11.551066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=57 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:11.552937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4238b789-de3c-4f11-8014-ade0572e1e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:11.553699 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4238b789-de3c-4f11-8014-ade0572e1e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:11.554892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4238b789-de3c-4f11-8014-ade0572e1e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:11.555846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4238b789-de3c-4f11-8014-ade0572e1e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:11.556504 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4238b789-de3c-4f11-8014-ade0572e1e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:11.557175 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4238b789-de3c-4f11-8014-ade0572e1e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:11.922520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4238b789-de3c-4f11-8014-ade0572e1e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "POST /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383274 Aug 30 14:46:11.923358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 253/513] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 14:46:11 2022] POST /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:46:29.909886 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:29.910671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:29.915646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-dd26f4ca-cd2d-4e58-971c-6478799ab35d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:29.916234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-dd26f4ca-cd2d-4e58-971c-6478799ab35d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:29.923941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dd26f4ca-cd2d-4e58-971c-6478799ab35d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:29.924421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dd26f4ca-cd2d-4e58-971c-6478799ab35d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:29.924858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dd26f4ca-cd2d-4e58-971c-6478799ab35d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:29.925544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dd26f4ca-cd2d-4e58-971c-6478799ab35d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:29.925995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dd26f4ca-cd2d-4e58-971c-6478799ab35d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:29.926416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dd26f4ca-cd2d-4e58-971c-6478799ab35d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:29.959003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-dd26f4ca-cd2d-4e58-971c-6478799ab35d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments/72ce0953-f5c8-4724-a213-770f060618b4" status: 200 len: 194 microversion: 2.20 time: 0.050876 Aug 30 14:46:29.959617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 261/514] 10.222.0.30 () {60 vars in 1454 bytes} [Tue Aug 30 14:46:29 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments/72ce0953-f5c8-4724-a213-770f060618b4 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:30.024156 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:30.025017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:30.029234 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-578dac34-7193-4ff9-b278-84509ee173e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:30.029816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-578dac34-7193-4ff9-b278-84509ee173e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:30.037501 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-578dac34-7193-4ff9-b278-84509ee173e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:30.037981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-578dac34-7193-4ff9-b278-84509ee173e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:30.038418 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-578dac34-7193-4ff9-b278-84509ee173e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:30.039681 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-578dac34-7193-4ff9-b278-84509ee173e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:30.040135 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-578dac34-7193-4ff9-b278-84509ee173e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:30.040643 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-578dac34-7193-4ff9-b278-84509ee173e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:30.167672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-578dac34-7193-4ff9-b278-84509ee173e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lazy-loading 'services' on Instance uuid df823286-f7fd-4dbf-acb5-7cd297f48da0 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:46:30.280409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-578dac34-7193-4ff9-b278-84509ee173e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "DELETE /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments/72ce0953-f5c8-4724-a213-770f060618b4" status: 202 len: 0 microversion: 2.20 time: 0.257719 Aug 30 14:46:30.281022 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 254/515] 10.222.0.30 () {60 vars in 1457 bytes} [Tue Aug 30 14:46:30 2022] DELETE /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments/72ce0953-f5c8-4724-a213-770f060618b4 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:46:30.290056 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-940cccf6-84c3-40fc-acea-8ce8b68af083 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:30.292334 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-940cccf6-84c3-40fc-acea-8ce8b68af083 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:30.298585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-940cccf6-84c3-40fc-acea-8ce8b68af083 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:30.299062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-940cccf6-84c3-40fc-acea-8ce8b68af083 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:30.299554 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-940cccf6-84c3-40fc-acea-8ce8b68af083 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:30.300243 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-940cccf6-84c3-40fc-acea-8ce8b68af083 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:30.300690 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-940cccf6-84c3-40fc-acea-8ce8b68af083 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:30.301109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-940cccf6-84c3-40fc-acea-8ce8b68af083 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:30.329933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-940cccf6-84c3-40fc-acea-8ce8b68af083 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044390 Aug 30 14:46:30.330473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 262/516] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:30 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:31.343474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-257be7ed-f012-4641-89ab-15a9bb5de5d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:31.345750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-257be7ed-f012-4641-89ab-15a9bb5de5d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:31.352350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-257be7ed-f012-4641-89ab-15a9bb5de5d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:31.352762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-257be7ed-f012-4641-89ab-15a9bb5de5d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:31.353190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-257be7ed-f012-4641-89ab-15a9bb5de5d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:31.353869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-257be7ed-f012-4641-89ab-15a9bb5de5d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:31.354316 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-257be7ed-f012-4641-89ab-15a9bb5de5d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:31.354732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-257be7ed-f012-4641-89ab-15a9bb5de5d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:31.383998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-257be7ed-f012-4641-89ab-15a9bb5de5d5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045402 Aug 30 14:46:31.384553 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 255/517] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:31 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:32.396413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-775ed441-8d72-4ddb-99c7-e4cc93683413 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:32.398726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-775ed441-8d72-4ddb-99c7-e4cc93683413 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:32.405164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-775ed441-8d72-4ddb-99c7-e4cc93683413 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:32.405693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-775ed441-8d72-4ddb-99c7-e4cc93683413 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:32.406076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-775ed441-8d72-4ddb-99c7-e4cc93683413 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:32.406761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-775ed441-8d72-4ddb-99c7-e4cc93683413 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:32.407240 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-775ed441-8d72-4ddb-99c7-e4cc93683413 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:32.407654 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-775ed441-8d72-4ddb-99c7-e4cc93683413 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:32.437577 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-775ed441-8d72-4ddb-99c7-e4cc93683413 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045186 Aug 30 14:46:32.438127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 263/518] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:32 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:33.450887 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-716fb6df-cd6a-4c34-bbf2-d5b50aed89f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:33.452963 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-716fb6df-cd6a-4c34-bbf2-d5b50aed89f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:33.459231 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-716fb6df-cd6a-4c34-bbf2-d5b50aed89f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:33.459721 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-716fb6df-cd6a-4c34-bbf2-d5b50aed89f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:33.460151 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-716fb6df-cd6a-4c34-bbf2-d5b50aed89f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:33.460851 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-716fb6df-cd6a-4c34-bbf2-d5b50aed89f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:33.461292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-716fb6df-cd6a-4c34-bbf2-d5b50aed89f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:33.461706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-716fb6df-cd6a-4c34-bbf2-d5b50aed89f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:33.489762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-716fb6df-cd6a-4c34-bbf2-d5b50aed89f8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042918 Aug 30 14:46:33.490319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 256/519] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:33 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:46:34.502591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-be83560e-1ed6-4782-9c0c-2f8ea1db62a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:34.504651 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-be83560e-1ed6-4782-9c0c-2f8ea1db62a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:34.512087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be83560e-1ed6-4782-9c0c-2f8ea1db62a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:34.512571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be83560e-1ed6-4782-9c0c-2f8ea1db62a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:34.513004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be83560e-1ed6-4782-9c0c-2f8ea1db62a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:34.513697 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be83560e-1ed6-4782-9c0c-2f8ea1db62a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:34.514148 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be83560e-1ed6-4782-9c0c-2f8ea1db62a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:34.514568 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be83560e-1ed6-4782-9c0c-2f8ea1db62a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:34.543678 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-be83560e-1ed6-4782-9c0c-2f8ea1db62a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045083 Aug 30 14:46:34.544228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 264/520] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:34 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:35.555979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cfd8cc13-0aa3-4c4f-8cbd-94cabd7e326d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:35.558063 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cfd8cc13-0aa3-4c4f-8cbd-94cabd7e326d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:35.564286 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cfd8cc13-0aa3-4c4f-8cbd-94cabd7e326d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:35.564754 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cfd8cc13-0aa3-4c4f-8cbd-94cabd7e326d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:35.565175 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cfd8cc13-0aa3-4c4f-8cbd-94cabd7e326d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:35.565843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cfd8cc13-0aa3-4c4f-8cbd-94cabd7e326d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:35.566533 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cfd8cc13-0aa3-4c4f-8cbd-94cabd7e326d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:35.566945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cfd8cc13-0aa3-4c4f-8cbd-94cabd7e326d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:35.598721 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cfd8cc13-0aa3-4c4f-8cbd-94cabd7e326d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046721 Aug 30 14:46:35.599288 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 257/521] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:35 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:36.611745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ba77f088-6889-4e1b-b30f-daf40bec2e43 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:36.613882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ba77f088-6889-4e1b-b30f-daf40bec2e43 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:36.621028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba77f088-6889-4e1b-b30f-daf40bec2e43 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:36.621511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba77f088-6889-4e1b-b30f-daf40bec2e43 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:36.621949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba77f088-6889-4e1b-b30f-daf40bec2e43 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:36.622649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba77f088-6889-4e1b-b30f-daf40bec2e43 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:36.623099 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba77f088-6889-4e1b-b30f-daf40bec2e43 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:36.623549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba77f088-6889-4e1b-b30f-daf40bec2e43 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:36.652314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ba77f088-6889-4e1b-b30f-daf40bec2e43 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044708 Aug 30 14:46:36.652867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 265/522] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:36 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:37.664648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3748bd83-3ea9-4017-a788-2bc0cd783622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:37.666764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3748bd83-3ea9-4017-a788-2bc0cd783622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:37.673057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3748bd83-3ea9-4017-a788-2bc0cd783622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:37.673529 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3748bd83-3ea9-4017-a788-2bc0cd783622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:37.673954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3748bd83-3ea9-4017-a788-2bc0cd783622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:37.674631 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3748bd83-3ea9-4017-a788-2bc0cd783622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:37.675076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3748bd83-3ea9-4017-a788-2bc0cd783622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:37.675531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3748bd83-3ea9-4017-a788-2bc0cd783622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:37.704864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3748bd83-3ea9-4017-a788-2bc0cd783622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044153 Aug 30 14:46:37.705419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 258/523] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:37 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:38.717550 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-30229941-850e-4022-8841-82ad1c5f246e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:38.719726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-30229941-850e-4022-8841-82ad1c5f246e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:38.726729 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-30229941-850e-4022-8841-82ad1c5f246e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:38.727231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-30229941-850e-4022-8841-82ad1c5f246e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:38.727668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-30229941-850e-4022-8841-82ad1c5f246e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:38.728355 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-30229941-850e-4022-8841-82ad1c5f246e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:38.728805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-30229941-850e-4022-8841-82ad1c5f246e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:38.729224 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-30229941-850e-4022-8841-82ad1c5f246e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:38.757992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-30229941-850e-4022-8841-82ad1c5f246e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044541 Aug 30 14:46:38.758470 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 266/524] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:38 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:39.770092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f38b2acc-c092-455d-a85c-2a291a7343ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:39.772234 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f38b2acc-c092-455d-a85c-2a291a7343ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:39.778626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f38b2acc-c092-455d-a85c-2a291a7343ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:39.779103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f38b2acc-c092-455d-a85c-2a291a7343ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:39.779562 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f38b2acc-c092-455d-a85c-2a291a7343ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:39.780241 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f38b2acc-c092-455d-a85c-2a291a7343ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:39.780687 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f38b2acc-c092-455d-a85c-2a291a7343ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:39.781106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f38b2acc-c092-455d-a85c-2a291a7343ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:39.810784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f38b2acc-c092-455d-a85c-2a291a7343ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044637 Aug 30 14:46:39.811374 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 259/525] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:39 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:40.823964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-94f7ab93-fd87-4d59-a133-326960cd3a05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:40.826115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-94f7ab93-fd87-4d59-a133-326960cd3a05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:40.832547 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-94f7ab93-fd87-4d59-a133-326960cd3a05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:40.833025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-94f7ab93-fd87-4d59-a133-326960cd3a05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:40.833459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-94f7ab93-fd87-4d59-a133-326960cd3a05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:40.834140 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-94f7ab93-fd87-4d59-a133-326960cd3a05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:40.834583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-94f7ab93-fd87-4d59-a133-326960cd3a05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:40.835041 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-94f7ab93-fd87-4d59-a133-326960cd3a05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:40.862899 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-94f7ab93-fd87-4d59-a133-326960cd3a05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043649 Aug 30 14:46:40.863403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 267/526] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:40 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:41.875692 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6297698e-ace2-48bc-809f-3aa5daf4262c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:41.877808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6297698e-ace2-48bc-809f-3aa5daf4262c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:41.885323 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6297698e-ace2-48bc-809f-3aa5daf4262c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:41.885796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6297698e-ace2-48bc-809f-3aa5daf4262c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:41.886227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6297698e-ace2-48bc-809f-3aa5daf4262c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:41.886903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6297698e-ace2-48bc-809f-3aa5daf4262c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:41.887377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6297698e-ace2-48bc-809f-3aa5daf4262c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:41.887796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6297698e-ace2-48bc-809f-3aa5daf4262c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:41.918008 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6297698e-ace2-48bc-809f-3aa5daf4262c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046226 Aug 30 14:46:41.918481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 260/527] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:41 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:42.930999 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8b2eae71-6fe4-43e5-aac7-625d0c28eb4b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:42.933130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8b2eae71-6fe4-43e5-aac7-625d0c28eb4b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:42.939505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b2eae71-6fe4-43e5-aac7-625d0c28eb4b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:42.939985 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b2eae71-6fe4-43e5-aac7-625d0c28eb4b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:42.940417 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b2eae71-6fe4-43e5-aac7-625d0c28eb4b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:42.941360 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b2eae71-6fe4-43e5-aac7-625d0c28eb4b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:42.941808 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b2eae71-6fe4-43e5-aac7-625d0c28eb4b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:42.942227 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b2eae71-6fe4-43e5-aac7-625d0c28eb4b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:42.971448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8b2eae71-6fe4-43e5-aac7-625d0c28eb4b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045198 Aug 30 14:46:42.971921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 268/528] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:42 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:43.983618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5172d057-f36c-4535-86da-b96688127ccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:43.985768 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5172d057-f36c-4535-86da-b96688127ccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:43.992020 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5172d057-f36c-4535-86da-b96688127ccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:43.992524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5172d057-f36c-4535-86da-b96688127ccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:43.992955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5172d057-f36c-4535-86da-b96688127ccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:43.993630 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5172d057-f36c-4535-86da-b96688127ccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:43.994075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5172d057-f36c-4535-86da-b96688127ccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:43.994496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5172d057-f36c-4535-86da-b96688127ccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:44.023969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5172d057-f36c-4535-86da-b96688127ccc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043621 Aug 30 14:46:44.024464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 261/529] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:43 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:45.036354 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-db9f7c45-10f7-468b-bbe9-6b39c9a337e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:45.038503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-db9f7c45-10f7-468b-bbe9-6b39c9a337e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:45.045277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db9f7c45-10f7-468b-bbe9-6b39c9a337e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:45.045763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db9f7c45-10f7-468b-bbe9-6b39c9a337e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:45.046202 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db9f7c45-10f7-468b-bbe9-6b39c9a337e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:45.046898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db9f7c45-10f7-468b-bbe9-6b39c9a337e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:45.047395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db9f7c45-10f7-468b-bbe9-6b39c9a337e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:45.047826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db9f7c45-10f7-468b-bbe9-6b39c9a337e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:45.076539 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-db9f7c45-10f7-468b-bbe9-6b39c9a337e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044261 Aug 30 14:46:45.077084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 269/530] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:45 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:45.958562 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-59850bf4-ae33-4eba-9a74-76dbaaaf31bf tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:45.960727 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-59850bf4-ae33-4eba-9a74-76dbaaaf31bf tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:45.967679 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59850bf4-ae33-4eba-9a74-76dbaaaf31bf tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:45.968149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59850bf4-ae33-4eba-9a74-76dbaaaf31bf tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:45.968572 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59850bf4-ae33-4eba-9a74-76dbaaaf31bf tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:45.969246 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59850bf4-ae33-4eba-9a74-76dbaaaf31bf tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:45.969687 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59850bf4-ae33-4eba-9a74-76dbaaaf31bf tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:45.970103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59850bf4-ae33-4eba-9a74-76dbaaaf31bf tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:45.997538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-59850bf4-ae33-4eba-9a74-76dbaaaf31bf tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042900 Aug 30 14:46:45.998088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 262/531] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:46:45 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 14:46:46.058615 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-503f16ac-b70d-4ac8-a7dc-6c611a7ff0d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:46.059093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-503f16ac-b70d-4ac8-a7dc-6c611a7ff0d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:46.065335 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-503f16ac-b70d-4ac8-a7dc-6c611a7ff0d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:46.065816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-503f16ac-b70d-4ac8-a7dc-6c611a7ff0d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:46.066507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-503f16ac-b70d-4ac8-a7dc-6c611a7ff0d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:46.067193 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-503f16ac-b70d-4ac8-a7dc-6c611a7ff0d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:46.067664 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-503f16ac-b70d-4ac8-a7dc-6c611a7ff0d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:46.068090 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-503f16ac-b70d-4ac8-a7dc-6c611a7ff0d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:46.089457 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a0722e88-9c54-4e09-8d92-693854600af7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:46.091563 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a0722e88-9c54-4e09-8d92-693854600af7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:46.094110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-503f16ac-b70d-4ac8-a7dc-6c611a7ff0d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Going to try to terminate instance {{(pid=127089) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:46:46.097319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0722e88-9c54-4e09-8d92-693854600af7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:46.098153 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0722e88-9c54-4e09-8d92-693854600af7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:46.098582 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0722e88-9c54-4e09-8d92-693854600af7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:46.099315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0722e88-9c54-4e09-8d92-693854600af7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:46.099781 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0722e88-9c54-4e09-8d92-693854600af7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:46.100197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0722e88-9c54-4e09-8d92-693854600af7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:46.130582 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a0722e88-9c54-4e09-8d92-693854600af7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045857 Aug 30 14:46:46.132044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 263/532] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:46 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:46:46.170883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-503f16ac-b70d-4ac8-a7dc-6c611a7ff0d3 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 204 len: 0 microversion: 2.1 time: 0.115840 Aug 30 14:46:46.171490 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 270/533] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 14:46:46 2022] DELETE /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:46:46.179389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-093754b3-bbfa-46eb-8527-4e64d2e42ee0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:46.179988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-093754b3-bbfa-46eb-8527-4e64d2e42ee0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:46.186320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-093754b3-bbfa-46eb-8527-4e64d2e42ee0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:46.186793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-093754b3-bbfa-46eb-8527-4e64d2e42ee0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:46.187251 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-093754b3-bbfa-46eb-8527-4e64d2e42ee0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:46.187922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-093754b3-bbfa-46eb-8527-4e64d2e42ee0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:46.188364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-093754b3-bbfa-46eb-8527-4e64d2e42ee0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:46.188775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-093754b3-bbfa-46eb-8527-4e64d2e42ee0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:46.323537 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-093754b3-bbfa-46eb-8527-4e64d2e42ee0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:46.331268 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-093754b3-bbfa-46eb-8527-4e64d2e42ee0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.155659 Aug 30 14:46:46.331853 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 264/534] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:46 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:47.145064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3570b52c-b731-4c0d-a2f3-d10c64e634ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:47.147255 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3570b52c-b731-4c0d-a2f3-d10c64e634ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:47.154097 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3570b52c-b731-4c0d-a2f3-d10c64e634ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:47.154574 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3570b52c-b731-4c0d-a2f3-d10c64e634ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:47.155004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3570b52c-b731-4c0d-a2f3-d10c64e634ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:47.155710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3570b52c-b731-4c0d-a2f3-d10c64e634ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:47.156159 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3570b52c-b731-4c0d-a2f3-d10c64e634ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:47.156579 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3570b52c-b731-4c0d-a2f3-d10c64e634ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:47.188336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3570b52c-b731-4c0d-a2f3-d10c64e634ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047596 Aug 30 14:46:47.188886 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 271/535] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:47 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:47.353478 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d61ddf69-ed10-4965-a8cb-b64f0f8d2bf9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:47.354093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d61ddf69-ed10-4965-a8cb-b64f0f8d2bf9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:47.360936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d61ddf69-ed10-4965-a8cb-b64f0f8d2bf9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:47.361419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d61ddf69-ed10-4965-a8cb-b64f0f8d2bf9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:47.361860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d61ddf69-ed10-4965-a8cb-b64f0f8d2bf9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:47.362552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d61ddf69-ed10-4965-a8cb-b64f0f8d2bf9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:47.363002 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d61ddf69-ed10-4965-a8cb-b64f0f8d2bf9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:47.363452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d61ddf69-ed10-4965-a8cb-b64f0f8d2bf9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:47.488890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d61ddf69-ed10-4965-a8cb-b64f0f8d2bf9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:47.496469 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d61ddf69-ed10-4965-a8cb-b64f0f8d2bf9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.147518 Aug 30 14:46:47.497037 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 265/536] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:47 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:48.201588 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6443d9a8-48ab-4df3-a9f4-ce8eb14e5def tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:48.203776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6443d9a8-48ab-4df3-a9f4-ce8eb14e5def tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:48.210051 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6443d9a8-48ab-4df3-a9f4-ce8eb14e5def tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:48.210540 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6443d9a8-48ab-4df3-a9f4-ce8eb14e5def tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:48.210976 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6443d9a8-48ab-4df3-a9f4-ce8eb14e5def tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:48.211783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6443d9a8-48ab-4df3-a9f4-ce8eb14e5def tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:48.212424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6443d9a8-48ab-4df3-a9f4-ce8eb14e5def tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:48.212757 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6443d9a8-48ab-4df3-a9f4-ce8eb14e5def tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:48.243719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6443d9a8-48ab-4df3-a9f4-ce8eb14e5def tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045351 Aug 30 14:46:48.244175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 272/537] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:48 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:46:48.517869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a5c209d0-75c1-4643-89c0-c06ce8078652 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:48.518430 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a5c209d0-75c1-4643-89c0-c06ce8078652 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:48.524809 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5c209d0-75c1-4643-89c0-c06ce8078652 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:48.525280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5c209d0-75c1-4643-89c0-c06ce8078652 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:48.525704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5c209d0-75c1-4643-89c0-c06ce8078652 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:48.526396 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5c209d0-75c1-4643-89c0-c06ce8078652 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:48.526825 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5c209d0-75c1-4643-89c0-c06ce8078652 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:48.527261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5c209d0-75c1-4643-89c0-c06ce8078652 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:48.655720 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a5c209d0-75c1-4643-89c0-c06ce8078652 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:48.663356 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a5c209d0-75c1-4643-89c0-c06ce8078652 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.149321 Aug 30 14:46:48.663910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 266/538] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:48 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:49.255899 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e5841879-5f39-469f-9ce4-3e3bf67f7aaf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:49.258006 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e5841879-5f39-469f-9ce4-3e3bf67f7aaf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:49.264956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e5841879-5f39-469f-9ce4-3e3bf67f7aaf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:49.265436 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e5841879-5f39-469f-9ce4-3e3bf67f7aaf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:49.265867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e5841879-5f39-469f-9ce4-3e3bf67f7aaf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:49.266549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e5841879-5f39-469f-9ce4-3e3bf67f7aaf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:49.266999 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e5841879-5f39-469f-9ce4-3e3bf67f7aaf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:49.267457 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e5841879-5f39-469f-9ce4-3e3bf67f7aaf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:49.296403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e5841879-5f39-469f-9ce4-3e3bf67f7aaf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044487 Aug 30 14:46:49.296950 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 273/539] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:49 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:49.685310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0ef31942-180a-4813-9e6b-8e2d36f14e0f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:49.685909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0ef31942-180a-4813-9e6b-8e2d36f14e0f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:49.692678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ef31942-180a-4813-9e6b-8e2d36f14e0f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:49.693180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ef31942-180a-4813-9e6b-8e2d36f14e0f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:49.693625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ef31942-180a-4813-9e6b-8e2d36f14e0f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:49.694366 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ef31942-180a-4813-9e6b-8e2d36f14e0f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:49.694818 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ef31942-180a-4813-9e6b-8e2d36f14e0f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:49.695271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ef31942-180a-4813-9e6b-8e2d36f14e0f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:49.824939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0ef31942-180a-4813-9e6b-8e2d36f14e0f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:49.832521 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0ef31942-180a-4813-9e6b-8e2d36f14e0f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.151059 Aug 30 14:46:49.833082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 267/540] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:49 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:50.308440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8418cb9c-7e3a-45cc-94e1-031c8f687490 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:50.310591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8418cb9c-7e3a-45cc-94e1-031c8f687490 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:50.317213 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8418cb9c-7e3a-45cc-94e1-031c8f687490 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:50.317695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8418cb9c-7e3a-45cc-94e1-031c8f687490 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:50.318132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8418cb9c-7e3a-45cc-94e1-031c8f687490 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:50.318837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8418cb9c-7e3a-45cc-94e1-031c8f687490 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:50.319313 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8418cb9c-7e3a-45cc-94e1-031c8f687490 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:50.319739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8418cb9c-7e3a-45cc-94e1-031c8f687490 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:50.349418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8418cb9c-7e3a-45cc-94e1-031c8f687490 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045048 Aug 30 14:46:50.349907 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 274/541] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:50 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:50.853801 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e3d3b227-32c6-4f0a-b453-1ea63ec49727 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:50.854397 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e3d3b227-32c6-4f0a-b453-1ea63ec49727 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:50.860379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d3b227-32c6-4f0a-b453-1ea63ec49727 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:50.860861 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d3b227-32c6-4f0a-b453-1ea63ec49727 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:50.861295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d3b227-32c6-4f0a-b453-1ea63ec49727 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:50.861979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d3b227-32c6-4f0a-b453-1ea63ec49727 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:50.862427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d3b227-32c6-4f0a-b453-1ea63ec49727 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:50.862846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d3b227-32c6-4f0a-b453-1ea63ec49727 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:50.988377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e3d3b227-32c6-4f0a-b453-1ea63ec49727 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:50.996490 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e3d3b227-32c6-4f0a-b453-1ea63ec49727 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.146803 Aug 30 14:46:50.997057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 268/542] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:50 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:51.362327 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6add3e3d-e735-4743-8237-91b3eb00d443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:51.364578 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6add3e3d-e735-4743-8237-91b3eb00d443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:51.371525 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6add3e3d-e735-4743-8237-91b3eb00d443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:51.372008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6add3e3d-e735-4743-8237-91b3eb00d443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:51.372441 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6add3e3d-e735-4743-8237-91b3eb00d443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:51.373129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6add3e3d-e735-4743-8237-91b3eb00d443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:51.373586 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6add3e3d-e735-4743-8237-91b3eb00d443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:51.374005 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6add3e3d-e735-4743-8237-91b3eb00d443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:51.398095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:51.403348 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6add3e3d-e735-4743-8237-91b3eb00d443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045271 Aug 30 14:46:51.403820 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 275/543] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:51 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:52.017895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-770c575b-8a2f-41cb-a1a5-6308faeff64a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:52.018499 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-770c575b-8a2f-41cb-a1a5-6308faeff64a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:52.025664 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-770c575b-8a2f-41cb-a1a5-6308faeff64a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:52.026137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-770c575b-8a2f-41cb-a1a5-6308faeff64a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:52.026566 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-770c575b-8a2f-41cb-a1a5-6308faeff64a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:52.027335 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-770c575b-8a2f-41cb-a1a5-6308faeff64a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:52.027798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-770c575b-8a2f-41cb-a1a5-6308faeff64a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:52.028218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-770c575b-8a2f-41cb-a1a5-6308faeff64a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:52.158713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-770c575b-8a2f-41cb-a1a5-6308faeff64a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:52.162189 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:46:52.167474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-770c575b-8a2f-41cb-a1a5-6308faeff64a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.153431 Aug 30 14:46:52.168049 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 269/544] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:52 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:52.416212 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-26ae4a9f-4415-44d5-85bf-05968541f45a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:52.418402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-26ae4a9f-4415-44d5-85bf-05968541f45a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:52.425394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-26ae4a9f-4415-44d5-85bf-05968541f45a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:52.425872 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-26ae4a9f-4415-44d5-85bf-05968541f45a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:52.426303 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-26ae4a9f-4415-44d5-85bf-05968541f45a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:52.426991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-26ae4a9f-4415-44d5-85bf-05968541f45a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:52.427465 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-26ae4a9f-4415-44d5-85bf-05968541f45a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:52.427885 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-26ae4a9f-4415-44d5-85bf-05968541f45a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:52.457807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-26ae4a9f-4415-44d5-85bf-05968541f45a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046207 Aug 30 14:46:52.458352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 276/545] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:52 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:53.189175 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e4b36535-5a80-4d8e-b964-b7dbe8141482 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:53.189774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e4b36535-5a80-4d8e-b964-b7dbe8141482 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:53.197129 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4b36535-5a80-4d8e-b964-b7dbe8141482 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:53.197607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4b36535-5a80-4d8e-b964-b7dbe8141482 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:53.198036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4b36535-5a80-4d8e-b964-b7dbe8141482 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:53.198710 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4b36535-5a80-4d8e-b964-b7dbe8141482 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:53.199157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4b36535-5a80-4d8e-b964-b7dbe8141482 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:53.199598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4b36535-5a80-4d8e-b964-b7dbe8141482 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:53.337691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e4b36535-5a80-4d8e-b964-b7dbe8141482 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:53.345198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e4b36535-5a80-4d8e-b964-b7dbe8141482 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.160906 Aug 30 14:46:53.345774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 270/546] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:53 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:53.471426 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-592ca28f-44cd-4ea7-a91e-4f32c24fbb81 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:53.473480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-592ca28f-44cd-4ea7-a91e-4f32c24fbb81 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:53.479881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-592ca28f-44cd-4ea7-a91e-4f32c24fbb81 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:53.480358 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-592ca28f-44cd-4ea7-a91e-4f32c24fbb81 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:53.480788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-592ca28f-44cd-4ea7-a91e-4f32c24fbb81 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:53.481471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-592ca28f-44cd-4ea7-a91e-4f32c24fbb81 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:53.481917 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-592ca28f-44cd-4ea7-a91e-4f32c24fbb81 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:53.482337 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-592ca28f-44cd-4ea7-a91e-4f32c24fbb81 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:53.511321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-592ca28f-44cd-4ea7-a91e-4f32c24fbb81 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044037 Aug 30 14:46:53.511869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 277/547] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:53 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:54.370247 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3cea78c8-f3c3-43f8-b108-94e9dc79b400 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:54.370247 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3cea78c8-f3c3-43f8-b108-94e9dc79b400 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:54.376311 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cea78c8-f3c3-43f8-b108-94e9dc79b400 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:54.376894 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cea78c8-f3c3-43f8-b108-94e9dc79b400 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:54.377401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cea78c8-f3c3-43f8-b108-94e9dc79b400 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:54.378166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cea78c8-f3c3-43f8-b108-94e9dc79b400 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:54.378695 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cea78c8-f3c3-43f8-b108-94e9dc79b400 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:54.379190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cea78c8-f3c3-43f8-b108-94e9dc79b400 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:54.509775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3cea78c8-f3c3-43f8-b108-94e9dc79b400 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:54.517394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3cea78c8-f3c3-43f8-b108-94e9dc79b400 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.153106 Aug 30 14:46:54.517969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 271/548] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:54 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:54.523580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-39eaf1b4-96fd-4c7f-9672-6f887ca87b37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:54.525800 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-39eaf1b4-96fd-4c7f-9672-6f887ca87b37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:54.532290 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39eaf1b4-96fd-4c7f-9672-6f887ca87b37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:54.532772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39eaf1b4-96fd-4c7f-9672-6f887ca87b37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:54.533204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39eaf1b4-96fd-4c7f-9672-6f887ca87b37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:54.533895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39eaf1b4-96fd-4c7f-9672-6f887ca87b37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:54.534349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39eaf1b4-96fd-4c7f-9672-6f887ca87b37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:54.534771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39eaf1b4-96fd-4c7f-9672-6f887ca87b37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:54.564671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-39eaf1b4-96fd-4c7f-9672-6f887ca87b37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045067 Aug 30 14:46:54.565219 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 278/549] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:54 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:55.539223 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3f16017f-9e0d-4868-949c-bb401e78693e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:55.540003 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3f16017f-9e0d-4868-949c-bb401e78693e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:55.546438 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f16017f-9e0d-4868-949c-bb401e78693e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:55.546923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f16017f-9e0d-4868-949c-bb401e78693e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:55.547395 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f16017f-9e0d-4868-949c-bb401e78693e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:55.548084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f16017f-9e0d-4868-949c-bb401e78693e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:55.548536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f16017f-9e0d-4868-949c-bb401e78693e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:55.548959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f16017f-9e0d-4868-949c-bb401e78693e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:55.577597 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-55784fae-af8e-4a21-b16e-1c65314e4f11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:55.579768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-55784fae-af8e-4a21-b16e-1c65314e4f11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:55.586132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55784fae-af8e-4a21-b16e-1c65314e4f11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:55.586782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55784fae-af8e-4a21-b16e-1c65314e4f11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:55.587231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55784fae-af8e-4a21-b16e-1c65314e4f11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:55.587926 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55784fae-af8e-4a21-b16e-1c65314e4f11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:55.588378 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55784fae-af8e-4a21-b16e-1c65314e4f11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:55.588795 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55784fae-af8e-4a21-b16e-1c65314e4f11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:55.618919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-55784fae-af8e-4a21-b16e-1c65314e4f11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045112 Aug 30 14:46:55.619524 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 279/550] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:55 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:46:55.675624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3f16017f-9e0d-4868-949c-bb401e78693e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:55.683925 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3f16017f-9e0d-4868-949c-bb401e78693e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.148654 Aug 30 14:46:55.684499 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 272/551] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:55 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:46:56.630979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a73e9b64-a326-4dd7-9bb0-ff51d8689006 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:56.633673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a73e9b64-a326-4dd7-9bb0-ff51d8689006 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:56.640027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a73e9b64-a326-4dd7-9bb0-ff51d8689006 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:56.640504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a73e9b64-a326-4dd7-9bb0-ff51d8689006 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:56.640932 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a73e9b64-a326-4dd7-9bb0-ff51d8689006 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:56.641611 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a73e9b64-a326-4dd7-9bb0-ff51d8689006 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:56.642062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a73e9b64-a326-4dd7-9bb0-ff51d8689006 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:56.642478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a73e9b64-a326-4dd7-9bb0-ff51d8689006 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:56.672047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a73e9b64-a326-4dd7-9bb0-ff51d8689006 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045010 Aug 30 14:46:56.672597 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 280/552] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:56 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:56.705776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ffb9f118-858c-4d83-9088-cae87813fa38 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:56.706377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ffb9f118-858c-4d83-9088-cae87813fa38 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:56.713359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffb9f118-858c-4d83-9088-cae87813fa38 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:56.713883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffb9f118-858c-4d83-9088-cae87813fa38 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:56.714268 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffb9f118-858c-4d83-9088-cae87813fa38 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:56.714948 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffb9f118-858c-4d83-9088-cae87813fa38 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:56.715426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffb9f118-858c-4d83-9088-cae87813fa38 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:56.715843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffb9f118-858c-4d83-9088-cae87813fa38 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:56.845143 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ffb9f118-858c-4d83-9088-cae87813fa38 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:56.852756 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ffb9f118-858c-4d83-9088-cae87813fa38 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.150789 Aug 30 14:46:56.853321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 273/553] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:56 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:57.684715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3a403c11-d0fc-4bb7-9c5b-61aecde67078 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:57.686821 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3a403c11-d0fc-4bb7-9c5b-61aecde67078 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:57.693438 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a403c11-d0fc-4bb7-9c5b-61aecde67078 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:57.693914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a403c11-d0fc-4bb7-9c5b-61aecde67078 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:57.694343 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a403c11-d0fc-4bb7-9c5b-61aecde67078 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:57.695018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a403c11-d0fc-4bb7-9c5b-61aecde67078 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:57.695499 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a403c11-d0fc-4bb7-9c5b-61aecde67078 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:57.696145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a403c11-d0fc-4bb7-9c5b-61aecde67078 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:57.725314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3a403c11-d0fc-4bb7-9c5b-61aecde67078 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044868 Aug 30 14:46:57.725812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 281/554] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:57 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:57.878753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-47119837-11a9-4d5e-b5aa-5389c0af569b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:57.879401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-47119837-11a9-4d5e-b5aa-5389c0af569b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:57.885904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47119837-11a9-4d5e-b5aa-5389c0af569b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:57.886393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47119837-11a9-4d5e-b5aa-5389c0af569b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:57.886837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47119837-11a9-4d5e-b5aa-5389c0af569b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:57.887570 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47119837-11a9-4d5e-b5aa-5389c0af569b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:57.888026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47119837-11a9-4d5e-b5aa-5389c0af569b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:57.888446 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47119837-11a9-4d5e-b5aa-5389c0af569b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:58.016979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-47119837-11a9-4d5e-b5aa-5389c0af569b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:58.025417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-47119837-11a9-4d5e-b5aa-5389c0af569b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.150478 Aug 30 14:46:58.026007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 274/555] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:57 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:58.738239 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-35e30a64-8d3e-4f0b-bea0-959a06c018a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:58.740315 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-35e30a64-8d3e-4f0b-bea0-959a06c018a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:58.747593 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35e30a64-8d3e-4f0b-bea0-959a06c018a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:58.748070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35e30a64-8d3e-4f0b-bea0-959a06c018a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:58.748495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35e30a64-8d3e-4f0b-bea0-959a06c018a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:58.749172 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35e30a64-8d3e-4f0b-bea0-959a06c018a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:58.749618 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35e30a64-8d3e-4f0b-bea0-959a06c018a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:58.750031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35e30a64-8d3e-4f0b-bea0-959a06c018a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:58.779888 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-35e30a64-8d3e-4f0b-bea0-959a06c018a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045721 Aug 30 14:46:58.780429 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 282/556] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:58 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:46:59.046499 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d3249bbf-90d6-400c-a0ff-35446284e844 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:59.047032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d3249bbf-90d6-400c-a0ff-35446284e844 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:59.053355 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3249bbf-90d6-400c-a0ff-35446284e844 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:59.053838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3249bbf-90d6-400c-a0ff-35446284e844 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:59.054268 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3249bbf-90d6-400c-a0ff-35446284e844 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:59.055650 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3249bbf-90d6-400c-a0ff-35446284e844 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:59.056199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3249bbf-90d6-400c-a0ff-35446284e844 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:59.056637 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3249bbf-90d6-400c-a0ff-35446284e844 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:59.185699 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d3249bbf-90d6-400c-a0ff-35446284e844 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:46:59.193508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d3249bbf-90d6-400c-a0ff-35446284e844 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.150921 Aug 30 14:46:59.194079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 275/557] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:46:59 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:46:59.792469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8bf87e61-e2bf-4389-b09e-8d1cb5aed2ab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:46:59.794469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8bf87e61-e2bf-4389-b09e-8d1cb5aed2ab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:46:59.801033 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bf87e61-e2bf-4389-b09e-8d1cb5aed2ab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:59.801518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bf87e61-e2bf-4389-b09e-8d1cb5aed2ab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:59.801953 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bf87e61-e2bf-4389-b09e-8d1cb5aed2ab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:59.802646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bf87e61-e2bf-4389-b09e-8d1cb5aed2ab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:46:59.803097 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bf87e61-e2bf-4389-b09e-8d1cb5aed2ab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:46:59.803556 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bf87e61-e2bf-4389-b09e-8d1cb5aed2ab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:46:59.833843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8bf87e61-e2bf-4389-b09e-8d1cb5aed2ab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045586 Aug 30 14:46:59.834403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 283/558] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:46:59 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:47:00.217137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e0c8bd15-ee58-43c5-8185-0831938c47dc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:00.217747 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e0c8bd15-ee58-43c5-8185-0831938c47dc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:00.220082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=45 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:00.225168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e0c8bd15-ee58-43c5-8185-0831938c47dc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:00.225647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e0c8bd15-ee58-43c5-8185-0831938c47dc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:00.226082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e0c8bd15-ee58-43c5-8185-0831938c47dc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:00.227348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e0c8bd15-ee58-43c5-8185-0831938c47dc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:00.227799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e0c8bd15-ee58-43c5-8185-0831938c47dc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:00.228217 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e0c8bd15-ee58-43c5-8185-0831938c47dc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:00.358970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e0c8bd15-ee58-43c5-8185-0831938c47dc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:00.366565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e0c8bd15-ee58-43c5-8185-0831938c47dc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.153307 Aug 30 14:47:00.367131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 276/559] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:00 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:00.846108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d5da1f8a-762f-46ac-abcd-5a30e738c5fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:00.848288 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d5da1f8a-762f-46ac-abcd-5a30e738c5fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:00.850584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:00.856449 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5da1f8a-762f-46ac-abcd-5a30e738c5fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:00.856934 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5da1f8a-762f-46ac-abcd-5a30e738c5fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:00.857369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5da1f8a-762f-46ac-abcd-5a30e738c5fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:00.858057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5da1f8a-762f-46ac-abcd-5a30e738c5fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:00.858505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5da1f8a-762f-46ac-abcd-5a30e738c5fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:00.858928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5da1f8a-762f-46ac-abcd-5a30e738c5fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:00.888089 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d5da1f8a-762f-46ac-abcd-5a30e738c5fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046116 Aug 30 14:47:00.888633 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 284/560] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:00 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:01.388683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dd799fb2-3545-44ee-9097-06384cd358c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:01.389206 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dd799fb2-3545-44ee-9097-06384cd358c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:01.395637 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd799fb2-3545-44ee-9097-06384cd358c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:01.396119 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd799fb2-3545-44ee-9097-06384cd358c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:01.396555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd799fb2-3545-44ee-9097-06384cd358c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:01.397241 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd799fb2-3545-44ee-9097-06384cd358c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:01.397692 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd799fb2-3545-44ee-9097-06384cd358c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:01.398111 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd799fb2-3545-44ee-9097-06384cd358c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:01.524090 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-dd799fb2-3545-44ee-9097-06384cd358c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:01.531501 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dd799fb2-3545-44ee-9097-06384cd358c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.146754 Aug 30 14:47:01.532066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 277/561] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:01 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:01.900302 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-814448eb-2f89-4f88-bd14-bee48d127b9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:01.902410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-814448eb-2f89-4f88-bd14-bee48d127b9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:01.908792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-814448eb-2f89-4f88-bd14-bee48d127b9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:01.909270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-814448eb-2f89-4f88-bd14-bee48d127b9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:01.909695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-814448eb-2f89-4f88-bd14-bee48d127b9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:01.910369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-814448eb-2f89-4f88-bd14-bee48d127b9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:01.910812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-814448eb-2f89-4f88-bd14-bee48d127b9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:01.911244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-814448eb-2f89-4f88-bd14-bee48d127b9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:01.940644 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-814448eb-2f89-4f88-bd14-bee48d127b9e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044312 Aug 30 14:47:01.941506 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 285/562] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:01 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:02.552575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4a03dbbf-9364-4088-976f-76490d87923e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:02.553096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4a03dbbf-9364-4088-976f-76490d87923e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:02.559601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a03dbbf-9364-4088-976f-76490d87923e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:02.560081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a03dbbf-9364-4088-976f-76490d87923e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:02.560508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a03dbbf-9364-4088-976f-76490d87923e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:02.561186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a03dbbf-9364-4088-976f-76490d87923e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:02.561632 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a03dbbf-9364-4088-976f-76490d87923e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:02.562055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a03dbbf-9364-4088-976f-76490d87923e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:02.690435 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4a03dbbf-9364-4088-976f-76490d87923e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:02.699056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4a03dbbf-9364-4088-976f-76490d87923e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.150453 Aug 30 14:47:02.699646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 278/563] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:02 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:02.953354 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-00d8fa0c-c8af-424e-a4ff-87f599e3124f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:02.955502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-00d8fa0c-c8af-424e-a4ff-87f599e3124f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:02.962239 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00d8fa0c-c8af-424e-a4ff-87f599e3124f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:02.962717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00d8fa0c-c8af-424e-a4ff-87f599e3124f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:02.963145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00d8fa0c-c8af-424e-a4ff-87f599e3124f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:02.963846 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00d8fa0c-c8af-424e-a4ff-87f599e3124f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:02.964289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00d8fa0c-c8af-424e-a4ff-87f599e3124f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:02.964703 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00d8fa0c-c8af-424e-a4ff-87f599e3124f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:02.993829 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-00d8fa0c-c8af-424e-a4ff-87f599e3124f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044550 Aug 30 14:47:02.994369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 286/564] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:02 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:03.720642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a92c7071-67c9-4b0c-b23c-28438ca874c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:03.721277 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a92c7071-67c9-4b0c-b23c-28438ca874c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:03.728236 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a92c7071-67c9-4b0c-b23c-28438ca874c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:03.728714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a92c7071-67c9-4b0c-b23c-28438ca874c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:03.729142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a92c7071-67c9-4b0c-b23c-28438ca874c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:03.729823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a92c7071-67c9-4b0c-b23c-28438ca874c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:03.730270 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a92c7071-67c9-4b0c-b23c-28438ca874c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:03.730692 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a92c7071-67c9-4b0c-b23c-28438ca874c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:03.859463 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a92c7071-67c9-4b0c-b23c-28438ca874c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:03.866960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a92c7071-67c9-4b0c-b23c-28438ca874c9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.150155 Aug 30 14:47:03.867574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 279/565] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:03 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:04.006032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f39e999a-47b6-41a5-8bf1-251da697518e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:04.008197 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f39e999a-47b6-41a5-8bf1-251da697518e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:04.014951 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f39e999a-47b6-41a5-8bf1-251da697518e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:04.015461 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f39e999a-47b6-41a5-8bf1-251da697518e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:04.015890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f39e999a-47b6-41a5-8bf1-251da697518e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:04.016570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f39e999a-47b6-41a5-8bf1-251da697518e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:04.017016 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f39e999a-47b6-41a5-8bf1-251da697518e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:04.017433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f39e999a-47b6-41a5-8bf1-251da697518e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:04.046308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f39e999a-47b6-41a5-8bf1-251da697518e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044276 Aug 30 14:47:04.046847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 287/566] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:04 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:04.887999 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5e924308-f9d0-4c3a-9305-00ccaa6fb9b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:04.888603 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5e924308-f9d0-4c3a-9305-00ccaa6fb9b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:04.894864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e924308-f9d0-4c3a-9305-00ccaa6fb9b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:04.895308 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e924308-f9d0-4c3a-9305-00ccaa6fb9b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:04.895738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e924308-f9d0-4c3a-9305-00ccaa6fb9b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:04.896419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e924308-f9d0-4c3a-9305-00ccaa6fb9b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:04.896865 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e924308-f9d0-4c3a-9305-00ccaa6fb9b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:04.897279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e924308-f9d0-4c3a-9305-00ccaa6fb9b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:05.025376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5e924308-f9d0-4c3a-9305-00ccaa6fb9b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:05.033764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5e924308-f9d0-4c3a-9305-00ccaa6fb9b5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.149549 Aug 30 14:47:05.034334 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 280/567] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:04 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:05.058267 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c2a44411-1fa8-4415-aa6b-6aae8f49d4db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:05.060433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c2a44411-1fa8-4415-aa6b-6aae8f49d4db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:05.066937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c2a44411-1fa8-4415-aa6b-6aae8f49d4db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:05.067455 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c2a44411-1fa8-4415-aa6b-6aae8f49d4db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:05.067883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c2a44411-1fa8-4415-aa6b-6aae8f49d4db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:05.068562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c2a44411-1fa8-4415-aa6b-6aae8f49d4db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:05.069007 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c2a44411-1fa8-4415-aa6b-6aae8f49d4db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:05.069421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c2a44411-1fa8-4415-aa6b-6aae8f49d4db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:05.098524 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c2a44411-1fa8-4415-aa6b-6aae8f49d4db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044321 Aug 30 14:47:05.099061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 288/568] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:05 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:06.055343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-abefbb7a-aeba-42ab-ae30-6f189aca8878 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:06.055952 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-abefbb7a-aeba-42ab-ae30-6f189aca8878 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:06.062839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abefbb7a-aeba-42ab-ae30-6f189aca8878 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:06.063347 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abefbb7a-aeba-42ab-ae30-6f189aca8878 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:06.063780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abefbb7a-aeba-42ab-ae30-6f189aca8878 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:06.064462 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abefbb7a-aeba-42ab-ae30-6f189aca8878 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:06.064908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abefbb7a-aeba-42ab-ae30-6f189aca8878 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:06.065326 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-abefbb7a-aeba-42ab-ae30-6f189aca8878 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:06.110335 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a0593ad5-6d1e-4333-9739-d36f56efd394 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:06.112600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a0593ad5-6d1e-4333-9739-d36f56efd394 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:06.118945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0593ad5-6d1e-4333-9739-d36f56efd394 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:06.119455 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0593ad5-6d1e-4333-9739-d36f56efd394 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:06.120617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0593ad5-6d1e-4333-9739-d36f56efd394 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:06.121508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0593ad5-6d1e-4333-9739-d36f56efd394 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:06.121958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0593ad5-6d1e-4333-9739-d36f56efd394 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:06.122375 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0593ad5-6d1e-4333-9739-d36f56efd394 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:06.153188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a0593ad5-6d1e-4333-9739-d36f56efd394 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046860 Aug 30 14:47:06.153946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 289/569] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:06 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:47:06.197979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-abefbb7a-aeba-42ab-ae30-6f189aca8878 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:06.205566 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-abefbb7a-aeba-42ab-ae30-6f189aca8878 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.154068 Aug 30 14:47:06.206132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 281/570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:06 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:07.165223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8bce0eda-dc5d-4a26-a2ff-3b8e562e1772 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:07.167404 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8bce0eda-dc5d-4a26-a2ff-3b8e562e1772 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:07.173566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bce0eda-dc5d-4a26-a2ff-3b8e562e1772 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:07.174042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bce0eda-dc5d-4a26-a2ff-3b8e562e1772 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:07.174491 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bce0eda-dc5d-4a26-a2ff-3b8e562e1772 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:07.175155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bce0eda-dc5d-4a26-a2ff-3b8e562e1772 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:07.175627 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bce0eda-dc5d-4a26-a2ff-3b8e562e1772 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:07.176042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bce0eda-dc5d-4a26-a2ff-3b8e562e1772 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:07.205512 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8bce0eda-dc5d-4a26-a2ff-3b8e562e1772 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044311 Aug 30 14:47:07.206061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 290/571] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:07 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:07.226115 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-11cebc75-ec67-4a8a-b28e-95c8c813397b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:07.226712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-11cebc75-ec67-4a8a-b28e-95c8c813397b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:07.233264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11cebc75-ec67-4a8a-b28e-95c8c813397b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:07.233737 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11cebc75-ec67-4a8a-b28e-95c8c813397b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:07.234163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11cebc75-ec67-4a8a-b28e-95c8c813397b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:07.234845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11cebc75-ec67-4a8a-b28e-95c8c813397b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:07.235315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11cebc75-ec67-4a8a-b28e-95c8c813397b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:07.235729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11cebc75-ec67-4a8a-b28e-95c8c813397b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:07.367792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-11cebc75-ec67-4a8a-b28e-95c8c813397b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:07.376020 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-11cebc75-ec67-4a8a-b28e-95c8c813397b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.153670 Aug 30 14:47:07.376588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 282/572] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:07 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:08.218155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-13fa7761-dc6e-4749-a036-682aba3f5a22 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:08.220435 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-13fa7761-dc6e-4749-a036-682aba3f5a22 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:08.227004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-13fa7761-dc6e-4749-a036-682aba3f5a22 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:08.227334 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-13fa7761-dc6e-4749-a036-682aba3f5a22 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:08.227776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-13fa7761-dc6e-4749-a036-682aba3f5a22 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:08.228473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-13fa7761-dc6e-4749-a036-682aba3f5a22 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:08.229704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-13fa7761-dc6e-4749-a036-682aba3f5a22 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:08.230141 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-13fa7761-dc6e-4749-a036-682aba3f5a22 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:08.259468 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-13fa7761-dc6e-4749-a036-682aba3f5a22 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045748 Aug 30 14:47:08.260027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 291/573] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:08 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:08.397541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d588105d-e842-45d8-b300-f00d23fa5075 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:08.398148 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d588105d-e842-45d8-b300-f00d23fa5075 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:08.405836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d588105d-e842-45d8-b300-f00d23fa5075 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:08.406338 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d588105d-e842-45d8-b300-f00d23fa5075 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:08.406779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d588105d-e842-45d8-b300-f00d23fa5075 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:08.407517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d588105d-e842-45d8-b300-f00d23fa5075 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:08.407968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d588105d-e842-45d8-b300-f00d23fa5075 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:08.408408 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d588105d-e842-45d8-b300-f00d23fa5075 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:08.537813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d588105d-e842-45d8-b300-f00d23fa5075 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:08.545488 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d588105d-e842-45d8-b300-f00d23fa5075 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.151767 Aug 30 14:47:08.546052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 283/574] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:08 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:09.271866 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1c105975-0faa-4116-a741-cf5a6b3deaea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:09.273987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1c105975-0faa-4116-a741-cf5a6b3deaea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:09.280484 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1c105975-0faa-4116-a741-cf5a6b3deaea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:09.280825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1c105975-0faa-4116-a741-cf5a6b3deaea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:09.281253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1c105975-0faa-4116-a741-cf5a6b3deaea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:09.281941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1c105975-0faa-4116-a741-cf5a6b3deaea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:09.282389 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1c105975-0faa-4116-a741-cf5a6b3deaea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:09.282809 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1c105975-0faa-4116-a741-cf5a6b3deaea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:09.299676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:09.314311 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1c105975-0faa-4116-a741-cf5a6b3deaea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046410 Aug 30 14:47:09.314867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 292/575] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:09 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:09.567028 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3ba71ea2-1666-49a8-969a-af801e731db7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:09.567663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3ba71ea2-1666-49a8-969a-af801e731db7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:09.574881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ba71ea2-1666-49a8-969a-af801e731db7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:09.575418 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ba71ea2-1666-49a8-969a-af801e731db7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:09.575854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ba71ea2-1666-49a8-969a-af801e731db7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:09.576558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ba71ea2-1666-49a8-969a-af801e731db7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:09.577015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ba71ea2-1666-49a8-969a-af801e731db7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:09.577435 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ba71ea2-1666-49a8-969a-af801e731db7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:09.710052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3ba71ea2-1666-49a8-969a-af801e731db7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:09.717557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3ba71ea2-1666-49a8-969a-af801e731db7 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.154744 Aug 30 14:47:09.718285 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 284/576] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:09 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:10.326348 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5a69829d-5ea5-43ad-acd3-5d08002500d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:10.328525 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5a69829d-5ea5-43ad-acd3-5d08002500d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:10.335636 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a69829d-5ea5-43ad-acd3-5d08002500d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:10.336277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a69829d-5ea5-43ad-acd3-5d08002500d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:10.336721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a69829d-5ea5-43ad-acd3-5d08002500d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:10.337444 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a69829d-5ea5-43ad-acd3-5d08002500d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:10.337902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a69829d-5ea5-43ad-acd3-5d08002500d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:10.338891 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a69829d-5ea5-43ad-acd3-5d08002500d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:10.372001 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5a69829d-5ea5-43ad-acd3-5d08002500d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049694 Aug 30 14:47:10.372601 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 293/577] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:10 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:10.739042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-14c59bdd-3fb7-4b87-bfae-e00a659fffe9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:10.739675 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-14c59bdd-3fb7-4b87-bfae-e00a659fffe9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:10.746188 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14c59bdd-3fb7-4b87-bfae-e00a659fffe9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:10.746662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14c59bdd-3fb7-4b87-bfae-e00a659fffe9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:10.747084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14c59bdd-3fb7-4b87-bfae-e00a659fffe9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:10.747786 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14c59bdd-3fb7-4b87-bfae-e00a659fffe9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:10.748254 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14c59bdd-3fb7-4b87-bfae-e00a659fffe9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:10.748666 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14c59bdd-3fb7-4b87-bfae-e00a659fffe9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:10.877138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-14c59bdd-3fb7-4b87-bfae-e00a659fffe9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:10.884692 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-14c59bdd-3fb7-4b87-bfae-e00a659fffe9 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.149433 Aug 30 14:47:10.885848 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 285/578] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:10 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:11.384346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-576cba3d-698e-4a9b-a2ab-e0196877838e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:11.387128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-576cba3d-698e-4a9b-a2ab-e0196877838e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:11.393321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-576cba3d-698e-4a9b-a2ab-e0196877838e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:11.393805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-576cba3d-698e-4a9b-a2ab-e0196877838e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:11.394232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-576cba3d-698e-4a9b-a2ab-e0196877838e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:11.394924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-576cba3d-698e-4a9b-a2ab-e0196877838e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:11.395405 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-576cba3d-698e-4a9b-a2ab-e0196877838e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:11.395823 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-576cba3d-698e-4a9b-a2ab-e0196877838e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:11.426504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-576cba3d-698e-4a9b-a2ab-e0196877838e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046157 Aug 30 14:47:11.427282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 294/579] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:11 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:11.906681 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-af32860f-f9ee-4e94-9e23-6ee8ea1dc46e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:11.907303 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-af32860f-f9ee-4e94-9e23-6ee8ea1dc46e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:11.913692 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af32860f-f9ee-4e94-9e23-6ee8ea1dc46e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:11.914163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af32860f-f9ee-4e94-9e23-6ee8ea1dc46e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:11.914586 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af32860f-f9ee-4e94-9e23-6ee8ea1dc46e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:11.915290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af32860f-f9ee-4e94-9e23-6ee8ea1dc46e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:11.915734 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af32860f-f9ee-4e94-9e23-6ee8ea1dc46e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:11.916292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af32860f-f9ee-4e94-9e23-6ee8ea1dc46e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:11.934205 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:12.050672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-af32860f-f9ee-4e94-9e23-6ee8ea1dc46e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:12.058358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-af32860f-f9ee-4e94-9e23-6ee8ea1dc46e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.155397 Aug 30 14:47:12.058918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 286/580] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:11 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:12.438534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9145686e-f836-4f97-b51b-558bccc6925c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:12.440927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9145686e-f836-4f97-b51b-558bccc6925c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:12.448156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9145686e-f836-4f97-b51b-558bccc6925c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:12.448649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9145686e-f836-4f97-b51b-558bccc6925c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:12.449084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9145686e-f836-4f97-b51b-558bccc6925c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:12.449776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9145686e-f836-4f97-b51b-558bccc6925c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:12.450224 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9145686e-f836-4f97-b51b-558bccc6925c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:12.450644 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9145686e-f836-4f97-b51b-558bccc6925c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:12.480638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9145686e-f836-4f97-b51b-558bccc6925c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046013 Aug 30 14:47:12.481200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 295/581] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:12 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:13.079471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b436d5b1-bd9a-4900-8257-c252887a8d97 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:13.080007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b436d5b1-bd9a-4900-8257-c252887a8d97 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:13.086386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b436d5b1-bd9a-4900-8257-c252887a8d97 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:13.086863 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b436d5b1-bd9a-4900-8257-c252887a8d97 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:13.087324 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b436d5b1-bd9a-4900-8257-c252887a8d97 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:13.088008 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b436d5b1-bd9a-4900-8257-c252887a8d97 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:13.088457 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b436d5b1-bd9a-4900-8257-c252887a8d97 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:13.088885 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b436d5b1-bd9a-4900-8257-c252887a8d97 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:13.368163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b436d5b1-bd9a-4900-8257-c252887a8d97 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:13.375949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b436d5b1-bd9a-4900-8257-c252887a8d97 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.300394 Aug 30 14:47:13.376510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 287/582] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:13 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:13.492109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bb50ec59-9da3-41b5-a207-5f52a29a8616 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:13.494268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bb50ec59-9da3-41b5-a207-5f52a29a8616 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:13.500654 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb50ec59-9da3-41b5-a207-5f52a29a8616 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:13.501144 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb50ec59-9da3-41b5-a207-5f52a29a8616 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:13.501580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb50ec59-9da3-41b5-a207-5f52a29a8616 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:13.502275 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb50ec59-9da3-41b5-a207-5f52a29a8616 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:13.502760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb50ec59-9da3-41b5-a207-5f52a29a8616 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:13.503186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb50ec59-9da3-41b5-a207-5f52a29a8616 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:13.533516 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bb50ec59-9da3-41b5-a207-5f52a29a8616 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045363 Aug 30 14:47:13.534106 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 296/583] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:13 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:14.397483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2165d63f-cdc0-4d81-946a-48d8ea583c63 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:14.398098 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2165d63f-cdc0-4d81-946a-48d8ea583c63 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:14.404596 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2165d63f-cdc0-4d81-946a-48d8ea583c63 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:14.405079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2165d63f-cdc0-4d81-946a-48d8ea583c63 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:14.405516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2165d63f-cdc0-4d81-946a-48d8ea583c63 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:14.406203 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2165d63f-cdc0-4d81-946a-48d8ea583c63 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:14.406654 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2165d63f-cdc0-4d81-946a-48d8ea583c63 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:14.407078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2165d63f-cdc0-4d81-946a-48d8ea583c63 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:14.537144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2165d63f-cdc0-4d81-946a-48d8ea583c63 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:14.545590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2165d63f-cdc0-4d81-946a-48d8ea583c63 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.151946 Aug 30 14:47:14.546169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 288/584] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:14 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:14.546592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8e0c53fe-af9d-4c6f-b113-caa826c843a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:14.548841 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8e0c53fe-af9d-4c6f-b113-caa826c843a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:14.555003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8e0c53fe-af9d-4c6f-b113-caa826c843a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:14.555804 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8e0c53fe-af9d-4c6f-b113-caa826c843a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:14.556279 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8e0c53fe-af9d-4c6f-b113-caa826c843a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:14.557597 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8e0c53fe-af9d-4c6f-b113-caa826c843a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:14.558235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8e0c53fe-af9d-4c6f-b113-caa826c843a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:14.558668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8e0c53fe-af9d-4c6f-b113-caa826c843a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:14.589890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8e0c53fe-af9d-4c6f-b113-caa826c843a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047591 Aug 30 14:47:14.590448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 297/585] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:14 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:47:15.567429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-02540579-ba1f-4ef3-82e3-9bf254436eb0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:15.568039 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-02540579-ba1f-4ef3-82e3-9bf254436eb0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:15.575302 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02540579-ba1f-4ef3-82e3-9bf254436eb0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:15.575787 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02540579-ba1f-4ef3-82e3-9bf254436eb0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:15.576220 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02540579-ba1f-4ef3-82e3-9bf254436eb0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:15.576916 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02540579-ba1f-4ef3-82e3-9bf254436eb0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:15.577384 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02540579-ba1f-4ef3-82e3-9bf254436eb0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:15.577805 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02540579-ba1f-4ef3-82e3-9bf254436eb0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:15.602110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8696841f-be90-4a9c-9f5d-2c0e7f37c72f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:15.604667 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8696841f-be90-4a9c-9f5d-2c0e7f37c72f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:15.612439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8696841f-be90-4a9c-9f5d-2c0e7f37c72f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:15.614671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8696841f-be90-4a9c-9f5d-2c0e7f37c72f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:15.615346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8696841f-be90-4a9c-9f5d-2c0e7f37c72f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:15.616274 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8696841f-be90-4a9c-9f5d-2c0e7f37c72f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:15.616913 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8696841f-be90-4a9c-9f5d-2c0e7f37c72f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:15.617685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8696841f-be90-4a9c-9f5d-2c0e7f37c72f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:15.651237 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8696841f-be90-4a9c-9f5d-2c0e7f37c72f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052713 Aug 30 14:47:15.652115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 298/586] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:15 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:47:15.720228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-02540579-ba1f-4ef3-82e3-9bf254436eb0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:15.728292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-02540579-ba1f-4ef3-82e3-9bf254436eb0 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.164902 Aug 30 14:47:15.728793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 289/587] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:15 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:15.729620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9c7e812c-a777-4a89-896b-a2b86749114c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:15.731854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9c7e812c-a777-4a89-896b-a2b86749114c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:15.737742 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c7e812c-a777-4a89-896b-a2b86749114c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:15.738221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c7e812c-a777-4a89-896b-a2b86749114c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:15.738658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c7e812c-a777-4a89-896b-a2b86749114c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:15.739415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c7e812c-a777-4a89-896b-a2b86749114c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:15.739867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c7e812c-a777-4a89-896b-a2b86749114c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:15.740289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c7e812c-a777-4a89-896b-a2b86749114c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:15.763325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.objects.instance [None req-9c7e812c-a777-4a89-896b-a2b86749114c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lazy-loading 'flavor' on Instance uuid e42a99ef-987b-4b7f-a6ef-5458fccc5c52 {{(pid=127089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:47:15.989239 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9c7e812c-a777-4a89-896b-a2b86749114c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "POST /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/action" status: 200 len: 32 microversion: 2.1 time: 0.263475 Aug 30 14:47:15.990623 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 299/588] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 14:47:15 2022] POST /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/action => generated 32 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 14:47:16.000706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-297dc5c3-13dd-496d-a8cb-af0c57e6fb11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:16.001320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-297dc5c3-13dd-496d-a8cb-af0c57e6fb11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:16.007537 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-297dc5c3-13dd-496d-a8cb-af0c57e6fb11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:16.008030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-297dc5c3-13dd-496d-a8cb-af0c57e6fb11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:16.008522 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-297dc5c3-13dd-496d-a8cb-af0c57e6fb11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:16.009340 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-297dc5c3-13dd-496d-a8cb-af0c57e6fb11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:16.009871 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-297dc5c3-13dd-496d-a8cb-af0c57e6fb11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:16.010314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-297dc5c3-13dd-496d-a8cb-af0c57e6fb11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:16.289959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-297dc5c3-13dd-496d-a8cb-af0c57e6fb11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:16.300550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-297dc5c3-13dd-496d-a8cb-af0c57e6fb11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.303408 Aug 30 14:47:16.301428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 290/589] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:15 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:16.665107 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9b66b102-9698-419c-aaf8-4c1d19695b9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:16.667879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9b66b102-9698-419c-aaf8-4c1d19695b9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:16.675175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b66b102-9698-419c-aaf8-4c1d19695b9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:16.675780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b66b102-9698-419c-aaf8-4c1d19695b9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:16.676354 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b66b102-9698-419c-aaf8-4c1d19695b9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:16.677139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b66b102-9698-419c-aaf8-4c1d19695b9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:16.677663 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b66b102-9698-419c-aaf8-4c1d19695b9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:16.678160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b66b102-9698-419c-aaf8-4c1d19695b9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:16.711665 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9b66b102-9698-419c-aaf8-4c1d19695b9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051074 Aug 30 14:47:16.712252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 300/590] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:16 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:16.750531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-acc0c5d1-abed-49ec-885f-9de7950e250c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:16.751150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-acc0c5d1-abed-49ec-885f-9de7950e250c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:16.757835 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acc0c5d1-abed-49ec-885f-9de7950e250c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:16.758323 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acc0c5d1-abed-49ec-885f-9de7950e250c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:16.758759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acc0c5d1-abed-49ec-885f-9de7950e250c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:16.759486 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acc0c5d1-abed-49ec-885f-9de7950e250c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:16.760763 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acc0c5d1-abed-49ec-885f-9de7950e250c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:16.761223 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acc0c5d1-abed-49ec-885f-9de7950e250c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:17.099286 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-acc0c5d1-abed-49ec-885f-9de7950e250c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:17.107544 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-acc0c5d1-abed-49ec-885f-9de7950e250c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1672 microversion: 2.1 time: 0.361080 Aug 30 14:47:17.108121 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 291/591] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:16 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1672 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:17.321937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-17297ab2-db66-49e4-9166-5e66b9c11127 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:17.322579 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-17297ab2-db66-49e4-9166-5e66b9c11127 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:17.329224 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17297ab2-db66-49e4-9166-5e66b9c11127 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:17.329709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17297ab2-db66-49e4-9166-5e66b9c11127 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:17.330137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17297ab2-db66-49e4-9166-5e66b9c11127 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:17.330872 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17297ab2-db66-49e4-9166-5e66b9c11127 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:17.331319 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17297ab2-db66-49e4-9166-5e66b9c11127 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:17.331743 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-17297ab2-db66-49e4-9166-5e66b9c11127 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:17.471672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-17297ab2-db66-49e4-9166-5e66b9c11127 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:17.481156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-17297ab2-db66-49e4-9166-5e66b9c11127 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.162954 Aug 30 14:47:17.482192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 301/592] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:17 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:17.667851 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-59e3242a-7165-4f18-9be3-3f54b77e6ca4 req-6b8c5124-9d14-4693-b0ea-d99cb6f58c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9dfd407-56eb-4670-8ee7-5e0cabe294e3", "name": "network-vif-deleted", "tag": "5494fd19-6c12-4b87-9225-d31bc888c0bc"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:17.677271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-59e3242a-7165-4f18-9be3-3f54b77e6ca4 req-6b8c5124-9d14-4693-b0ea-d99cb6f58c43 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:17.677751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-59e3242a-7165-4f18-9be3-3f54b77e6ca4 req-6b8c5124-9d14-4693-b0ea-d99cb6f58c43 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:17.678365 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-59e3242a-7165-4f18-9be3-3f54b77e6ca4 req-6b8c5124-9d14-4693-b0ea-d99cb6f58c43 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:17.689854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-59e3242a-7165-4f18-9be3-3f54b77e6ca4 req-6b8c5124-9d14-4693-b0ea-d99cb6f58c43 service nova] Creating event network-vif-deleted:5494fd19-6c12-4b87-9225-d31bc888c0bc for instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 on hv-cinder-82880 Aug 30 14:47:17.695399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-59e3242a-7165-4f18-9be3-3f54b77e6ca4 req-6b8c5124-9d14-4693-b0ea-d99cb6f58c43 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031384 Aug 30 14:47:17.696401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 292/593] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:47:17.725175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1639c6e1-ceb3-4ef7-be40-ae98184fb1fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:17.727403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1639c6e1-ceb3-4ef7-be40-ae98184fb1fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:17.734312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1639c6e1-ceb3-4ef7-be40-ae98184fb1fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:17.734928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1639c6e1-ceb3-4ef7-be40-ae98184fb1fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:17.735678 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1639c6e1-ceb3-4ef7-be40-ae98184fb1fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:17.736604 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1639c6e1-ceb3-4ef7-be40-ae98184fb1fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:17.737128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1639c6e1-ceb3-4ef7-be40-ae98184fb1fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:17.737783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1639c6e1-ceb3-4ef7-be40-ae98184fb1fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:17.769497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1639c6e1-ceb3-4ef7-be40-ae98184fb1fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048510 Aug 30 14:47:17.770310 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 302/594] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:17 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:18.130463 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7de05bf1-466f-4878-bff5-9fa96518fd7c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:18.131342 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7de05bf1-466f-4878-bff5-9fa96518fd7c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:18.140220 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7de05bf1-466f-4878-bff5-9fa96518fd7c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:18.141690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7de05bf1-466f-4878-bff5-9fa96518fd7c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:18.142224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7de05bf1-466f-4878-bff5-9fa96518fd7c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:18.143071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7de05bf1-466f-4878-bff5-9fa96518fd7c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:18.143760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7de05bf1-466f-4878-bff5-9fa96518fd7c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:18.144290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7de05bf1-466f-4878-bff5-9fa96518fd7c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:18.177063 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7de05bf1-466f-4878-bff5-9fa96518fd7c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:18.177699 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7de05bf1-466f-4878-bff5-9fa96518fd7c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:18.178233 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7de05bf1-466f-4878-bff5-9fa96518fd7c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:18.178779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-7de05bf1-466f-4878-bff5-9fa96518fd7c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lazy-loading 'fault' on Instance uuid c9dfd407-56eb-4670-8ee7-5e0cabe294e3 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:47:18.241453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7de05bf1-466f-4878-bff5-9fa96518fd7c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:18.249568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7de05bf1-466f-4878-bff5-9fa96518fd7c tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1327 microversion: 2.1 time: 0.123968 Aug 30 14:47:18.250150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 293/595] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:18 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1327 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:18.502401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-16d9a191-63e1-4ffa-9d60-ebe9237d74a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:18.503022 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-16d9a191-63e1-4ffa-9d60-ebe9237d74a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:18.509789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-16d9a191-63e1-4ffa-9d60-ebe9237d74a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:18.511043 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-16d9a191-63e1-4ffa-9d60-ebe9237d74a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:18.511545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-16d9a191-63e1-4ffa-9d60-ebe9237d74a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:18.512257 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-16d9a191-63e1-4ffa-9d60-ebe9237d74a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:18.512707 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-16d9a191-63e1-4ffa-9d60-ebe9237d74a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:18.513149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-16d9a191-63e1-4ffa-9d60-ebe9237d74a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:18.648361 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-16d9a191-63e1-4ffa-9d60-ebe9237d74a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:18.664738 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-16d9a191-63e1-4ffa-9d60-ebe9237d74a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.166428 Aug 30 14:47:18.665570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 303/596] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:18 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:18.782810 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ae3c7231-e16b-4d20-8c9c-1e3aa7f63d06 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:18.785067 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ae3c7231-e16b-4d20-8c9c-1e3aa7f63d06 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:18.790978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae3c7231-e16b-4d20-8c9c-1e3aa7f63d06 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:18.791829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae3c7231-e16b-4d20-8c9c-1e3aa7f63d06 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:18.792353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae3c7231-e16b-4d20-8c9c-1e3aa7f63d06 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:18.793107 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae3c7231-e16b-4d20-8c9c-1e3aa7f63d06 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:18.793623 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae3c7231-e16b-4d20-8c9c-1e3aa7f63d06 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:18.794048 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae3c7231-e16b-4d20-8c9c-1e3aa7f63d06 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:18.827721 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ae3c7231-e16b-4d20-8c9c-1e3aa7f63d06 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048727 Aug 30 14:47:18.828574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 294/597] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:18 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:19.270612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b39bd292-6756-4cf0-ae87-c776f85be73d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:19.271251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b39bd292-6756-4cf0-ae87-c776f85be73d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:19.278282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b39bd292-6756-4cf0-ae87-c776f85be73d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:19.278737 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b39bd292-6756-4cf0-ae87-c776f85be73d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:19.279182 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b39bd292-6756-4cf0-ae87-c776f85be73d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:19.279914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b39bd292-6756-4cf0-ae87-c776f85be73d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:19.280376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b39bd292-6756-4cf0-ae87-c776f85be73d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:19.280804 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b39bd292-6756-4cf0-ae87-c776f85be73d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:19.313228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b39bd292-6756-4cf0-ae87-c776f85be73d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:19.313705 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b39bd292-6756-4cf0-ae87-c776f85be73d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:19.314161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b39bd292-6756-4cf0-ae87-c776f85be73d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:19.314602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.objects.instance [None req-b39bd292-6756-4cf0-ae87-c776f85be73d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lazy-loading 'fault' on Instance uuid c9dfd407-56eb-4670-8ee7-5e0cabe294e3 {{(pid=127089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:47:19.356013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b39bd292-6756-4cf0-ae87-c776f85be73d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:19.363808 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b39bd292-6756-4cf0-ae87-c776f85be73d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 200 len: 1327 microversion: 2.1 time: 0.097088 Aug 30 14:47:19.364356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 304/598] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:19 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:19.686034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-507dd0c5-84e4-4ca5-b9fc-24f74a718c01 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:19.686647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-507dd0c5-84e4-4ca5-b9fc-24f74a718c01 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:19.693574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-507dd0c5-84e4-4ca5-b9fc-24f74a718c01 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:19.694060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-507dd0c5-84e4-4ca5-b9fc-24f74a718c01 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:19.694496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-507dd0c5-84e4-4ca5-b9fc-24f74a718c01 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:19.695246 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-507dd0c5-84e4-4ca5-b9fc-24f74a718c01 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:19.695705 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-507dd0c5-84e4-4ca5-b9fc-24f74a718c01 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:19.696129 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-507dd0c5-84e4-4ca5-b9fc-24f74a718c01 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:19.828185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-507dd0c5-84e4-4ca5-b9fc-24f74a718c01 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:19.836756 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-507dd0c5-84e4-4ca5-b9fc-24f74a718c01 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.154634 Aug 30 14:47:19.837261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 295/599] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:19 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:19.841082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-414a64e6-312c-4067-83c4-a70b051a4211 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:19.843358 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-414a64e6-312c-4067-83c4-a70b051a4211 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:19.849222 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-414a64e6-312c-4067-83c4-a70b051a4211 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:19.849710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-414a64e6-312c-4067-83c4-a70b051a4211 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:19.850149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-414a64e6-312c-4067-83c4-a70b051a4211 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:19.850843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-414a64e6-312c-4067-83c4-a70b051a4211 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:19.851323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-414a64e6-312c-4067-83c4-a70b051a4211 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:19.851755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-414a64e6-312c-4067-83c4-a70b051a4211 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:19.880051 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-414a64e6-312c-4067-83c4-a70b051a4211 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043741 Aug 30 14:47:19.880607 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 305/600] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:19 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:47:20.385312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-18b1217b-9060-4ba2-bc34-a385029e13f5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:20.385953 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-18b1217b-9060-4ba2-bc34-a385029e13f5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:20.392614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18b1217b-9060-4ba2-bc34-a385029e13f5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:20.393099 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18b1217b-9060-4ba2-bc34-a385029e13f5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:20.393534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18b1217b-9060-4ba2-bc34-a385029e13f5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:20.394225 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18b1217b-9060-4ba2-bc34-a385029e13f5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:20.394712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18b1217b-9060-4ba2-bc34-a385029e13f5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:20.395133 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18b1217b-9060-4ba2-bc34-a385029e13f5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:20.408303 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-18b1217b-9060-4ba2-bc34-a385029e13f5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] HTTP exception thrown: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-18b1217b-9060-4ba2-bc34-a385029e13f5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Request method failure captured: Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 HTTP/1.1 Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDiHXgeukw0ZNoeficrJEf5lm6v5wj-1PFcFAuJEVMG7EHf6PXGtj7rdqQW2W_0AJCo9VQHgduruYwxwCrpZ10VB9ejqPXjJYMY10nBr1H3zK66KAO8Jy47XLqCblx9Q6gEvo1HZaGbtdLUD5lU6Pc3W6-xhQLr_9vp1ZGNC261GauT4 Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: 04efb141e084405992bfc0418a74da2a Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeTestJSON-105252644 Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 14:47:20.409932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 14:47:20.411491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/04efb141e084405992bfc0418a74da2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_04efb141e084405992bfc0418a74da2a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/04efb141e084405992bfc0418a74da2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/04efb141e084405992bfc0418a74da2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:47:20.411491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeTestJSON-105252644 Aug 30 14:47:20.411491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 04efb141e084405992bfc0418a74da2a Aug 30 14:47:20.411491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeTestJSON-105252644 Aug 30 14:47:20.411491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeTestJSON-105252644-project Aug 30 14:47:20.411491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 14:47:20.411491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 14:47:20.411491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: ca9bafc5ff4e43719f37e62cad946cf7 Aug 30 14:47:20.411491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeTestJSON-105252644-project Aug 30 14:47:20.411491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 14:47:20.411491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. Aug 30 14:47:20.411491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': 'c9dfd407-56eb-4670-8ee7-5e0cabe294e3'} Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:47:20.412502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. Aug 30 14:47:20.413992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 14:47:20.415600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-18b1217b-9060-4ba2-bc34-a385029e13f5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Returning 404 to user: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:47:20.415600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-18b1217b-9060-4ba2-bc34-a385029e13f5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 404 len: 111 microversion: 2.1 time: 0.030179 Aug 30 14:47:20.415600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 296/601] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:20 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:47:20.420719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5ee14b36-f82e-41cc-b1f5-7d786cbf718e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '.version_select at 0x7f5cba9130d0>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:20.453716 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5ee14b36-f82e-41cc-b1f5-7d786cbf718e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-867043046" status: 202 len: 0 microversion: 2.1 time: 0.036696 Aug 30 14:47:20.454297 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 306/602] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 14:47:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-867043046 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:47:20.858562 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-40fc434a-1f1d-4b6f-8f3b-2b5c983cfd68 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:20.859171 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-40fc434a-1f1d-4b6f-8f3b-2b5c983cfd68 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:20.865001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40fc434a-1f1d-4b6f-8f3b-2b5c983cfd68 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:20.865478 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40fc434a-1f1d-4b6f-8f3b-2b5c983cfd68 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:20.865907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40fc434a-1f1d-4b6f-8f3b-2b5c983cfd68 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:20.866588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40fc434a-1f1d-4b6f-8f3b-2b5c983cfd68 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:20.867042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40fc434a-1f1d-4b6f-8f3b-2b5c983cfd68 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:20.867492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40fc434a-1f1d-4b6f-8f3b-2b5c983cfd68 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:20.892567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9da4706d-53a6-447f-82fd-89cc6fb9b5a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:20.895092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9da4706d-53a6-447f-82fd-89cc6fb9b5a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:20.901820 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9da4706d-53a6-447f-82fd-89cc6fb9b5a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:20.902314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9da4706d-53a6-447f-82fd-89cc6fb9b5a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:20.902750 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9da4706d-53a6-447f-82fd-89cc6fb9b5a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:20.903481 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9da4706d-53a6-447f-82fd-89cc6fb9b5a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:20.903933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9da4706d-53a6-447f-82fd-89cc6fb9b5a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:20.904350 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9da4706d-53a6-447f-82fd-89cc6fb9b5a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:20.931032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:20.936622 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9da4706d-53a6-447f-82fd-89cc6fb9b5a8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048226 Aug 30 14:47:20.937193 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 307/603] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:20 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:21.009399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-40fc434a-1f1d-4b6f-8f3b-2b5c983cfd68 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:21.018615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-40fc434a-1f1d-4b6f-8f3b-2b5c983cfd68 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.163879 Aug 30 14:47:21.019190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 297/604] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:20 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:21.109122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-36959fdd-c046-4d10-afe6-c13773f318c5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Action: 'create', calling method: .version_select at 0x7f5cba814dc0>, body: {"keypair": {"name": "tempest-keypair-422728477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMSY1/4hDZJ1TObh99qr0ksdE41fp1eD6s9pggoGsySw5In5+fosuzB/7THxlB5d4qMGphOccZJmKP4XZT0SNw1sPwrW8WxS7PJJ31X7EoS7Kr2nR0WIKbodX+vXryFUA=="}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:21.130577 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-36959fdd-c046-4d10-afe6-c13773f318c5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Getting quotas for project 04efb141e084405992bfc0418a74da2a. Resources: {'key_pairs'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:47:21.134400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-36959fdd-c046-4d10-afe6-c13773f318c5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Getting quotas for user ca9bafc5ff4e43719f37e62cad946cf7 and project 04efb141e084405992bfc0418a74da2a. Resources: {'key_pairs'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:47:21.157709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-36959fdd-c046-4d10-afe6-c13773f318c5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052757 Aug 30 14:47:21.158282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 308/605] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 14:47:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:47:21.949722 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fef1385e-d30c-4317-a8d3-a0083801eda7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:21.952657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fef1385e-d30c-4317-a8d3-a0083801eda7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:21.958996 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef1385e-d30c-4317-a8d3-a0083801eda7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:21.959506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef1385e-d30c-4317-a8d3-a0083801eda7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:21.959942 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef1385e-d30c-4317-a8d3-a0083801eda7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:21.960636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef1385e-d30c-4317-a8d3-a0083801eda7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:21.961088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef1385e-d30c-4317-a8d3-a0083801eda7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:21.961507 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef1385e-d30c-4317-a8d3-a0083801eda7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:21.995146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fef1385e-d30c-4317-a8d3-a0083801eda7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049062 Aug 30 14:47:21.995777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 298/606] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:21 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:22.040409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f7e6b4a3-51d7-4f30-8108-34f67f24487b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:22.041727 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f7e6b4a3-51d7-4f30-8108-34f67f24487b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:22.047850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7e6b4a3-51d7-4f30-8108-34f67f24487b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:22.048337 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7e6b4a3-51d7-4f30-8108-34f67f24487b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:22.048765 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7e6b4a3-51d7-4f30-8108-34f67f24487b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:22.049682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7e6b4a3-51d7-4f30-8108-34f67f24487b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:22.050171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7e6b4a3-51d7-4f30-8108-34f67f24487b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:22.050767 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7e6b4a3-51d7-4f30-8108-34f67f24487b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:22.206467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f7e6b4a3-51d7-4f30-8108-34f67f24487b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:22.215804 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f7e6b4a3-51d7-4f30-8108-34f67f24487b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.179670 Aug 30 14:47:22.229879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 309/607] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:22 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:22.436943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2073985950", "imageRef": "fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "32f975bc-8116-40a7-8ed9-ac5167528756"}], "security_groups": [{"name": "tempest-securitygroup--874845350"}], "key_name": "tempest-keypair-422728477", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:22.538444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] validate_networks() for [('32f975bc-8116-40a7-8ed9-ac5167528756', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 14:47:22.914740 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 14:47:22.915410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 14:47:22.915950 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 14:47:22.916644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 14:47:22.917060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 14:47:22.925596 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:22.926066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:22.926490 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:22.927202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:22.927671 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:22.928086 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:22.944753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Getting quotas for project 04efb141e084405992bfc0418a74da2a. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 14:47:22.949362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Getting quotas for user ca9bafc5ff4e43719f37e62cad946cf7 and project 04efb141e084405992bfc0418a74da2a. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 14:47:22.960200 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 14:47:22.962448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 14:47:23.007187 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-acc0bcd5-dcf5-445e-b086-104a7a8c4cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:23.011556 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f761b550-1345-45a9-8c4d-d65e8882c72d tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.579625 Aug 30 14:47:23.012037 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-acc0bcd5-dcf5-445e-b086-104a7a8c4cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:23.017895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 299/608] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 14:47:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 14:47:23.018595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-acc0bcd5-dcf5-445e-b086-104a7a8c4cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:23.019130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-acc0bcd5-dcf5-445e-b086-104a7a8c4cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:23.019536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-acc0bcd5-dcf5-445e-b086-104a7a8c4cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:23.020231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-acc0bcd5-dcf5-445e-b086-104a7a8c4cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:23.020706 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-acc0bcd5-dcf5-445e-b086-104a7a8c4cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:23.021129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-acc0bcd5-dcf5-445e-b086-104a7a8c4cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:23.022517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-da87e4be-6780-4581-81d3-8f1917ab147b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:23.023130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-da87e4be-6780-4581-81d3-8f1917ab147b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:23.057499 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-acc0bcd5-dcf5-445e-b086-104a7a8c4cff tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053308 Aug 30 14:47:23.062001 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 310/609] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:23 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:23.078053 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-da87e4be-6780-4581-81d3-8f1917ab147b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:23.085116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-da87e4be-6780-4581-81d3-8f1917ab147b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 200 len: 1237 microversion: 2.1 time: 0.066176 Aug 30 14:47:23.085843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 300/610] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:23 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:23.237135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5aa2ce8c-1f13-40af-9bd6-35d72194c115 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:23.237925 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5aa2ce8c-1f13-40af-9bd6-35d72194c115 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:23.244763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5aa2ce8c-1f13-40af-9bd6-35d72194c115 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:23.245249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5aa2ce8c-1f13-40af-9bd6-35d72194c115 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:23.245682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5aa2ce8c-1f13-40af-9bd6-35d72194c115 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:23.246373 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5aa2ce8c-1f13-40af-9bd6-35d72194c115 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:23.246824 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5aa2ce8c-1f13-40af-9bd6-35d72194c115 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:23.247260 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5aa2ce8c-1f13-40af-9bd6-35d72194c115 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:23.380619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5aa2ce8c-1f13-40af-9bd6-35d72194c115 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:23.390242 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5aa2ce8c-1f13-40af-9bd6-35d72194c115 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.157273 Aug 30 14:47:23.391033 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 311/611] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:23 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:24.069980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-327d29f7-aabe-450f-b872-0362b5e9551f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:24.072282 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-327d29f7-aabe-450f-b872-0362b5e9551f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:24.078597 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-327d29f7-aabe-450f-b872-0362b5e9551f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:24.079077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-327d29f7-aabe-450f-b872-0362b5e9551f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:24.079546 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-327d29f7-aabe-450f-b872-0362b5e9551f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:24.080232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-327d29f7-aabe-450f-b872-0362b5e9551f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:24.080678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-327d29f7-aabe-450f-b872-0362b5e9551f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:24.081097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-327d29f7-aabe-450f-b872-0362b5e9551f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:24.105701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-322d740a-d7b5-40a1-a949-c71e3804cb5f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:24.106298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-322d740a-d7b5-40a1-a949-c71e3804cb5f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:24.111435 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-327d29f7-aabe-450f-b872-0362b5e9551f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045599 Aug 30 14:47:24.111997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 301/612] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:24 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:24.112576 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-322d740a-d7b5-40a1-a949-c71e3804cb5f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:24.113127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-322d740a-d7b5-40a1-a949-c71e3804cb5f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:24.113564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-322d740a-d7b5-40a1-a949-c71e3804cb5f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:24.114255 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-322d740a-d7b5-40a1-a949-c71e3804cb5f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:24.114711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-322d740a-d7b5-40a1-a949-c71e3804cb5f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:24.115132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-322d740a-d7b5-40a1-a949-c71e3804cb5f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:24.178779 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-322d740a-d7b5-40a1-a949-c71e3804cb5f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:24.190201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-322d740a-d7b5-40a1-a949-c71e3804cb5f tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 200 len: 1289 microversion: 2.1 time: 0.088778 Aug 30 14:47:24.190772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 312/613] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:24 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:24.412200 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3a6c6dd6-6935-46b9-9301-409b5baad80e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:24.412992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3a6c6dd6-6935-46b9-9301-409b5baad80e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:24.419750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a6c6dd6-6935-46b9-9301-409b5baad80e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:24.420449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a6c6dd6-6935-46b9-9301-409b5baad80e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:24.421188 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a6c6dd6-6935-46b9-9301-409b5baad80e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:24.421988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a6c6dd6-6935-46b9-9301-409b5baad80e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:24.422585 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a6c6dd6-6935-46b9-9301-409b5baad80e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:24.423096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a6c6dd6-6935-46b9-9301-409b5baad80e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:24.598679 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3a6c6dd6-6935-46b9-9301-409b5baad80e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:24.606792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3a6c6dd6-6935-46b9-9301-409b5baad80e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.198585 Aug 30 14:47:24.607387 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 302/614] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:24 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:25.125036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ae766319-2bb7-4942-8e3a-3ac1973e53d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:25.128027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ae766319-2bb7-4942-8e3a-3ac1973e53d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:25.136153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae766319-2bb7-4942-8e3a-3ac1973e53d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:25.136749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae766319-2bb7-4942-8e3a-3ac1973e53d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:25.137274 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae766319-2bb7-4942-8e3a-3ac1973e53d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:25.138093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae766319-2bb7-4942-8e3a-3ac1973e53d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:25.139128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae766319-2bb7-4942-8e3a-3ac1973e53d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:25.139680 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae766319-2bb7-4942-8e3a-3ac1973e53d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:25.173674 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ae766319-2bb7-4942-8e3a-3ac1973e53d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053581 Aug 30 14:47:25.174421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 313/615] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:25 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:25.214348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bc9e0549-b8a6-46b3-831c-24e28bdc8531 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:25.215661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bc9e0549-b8a6-46b3-831c-24e28bdc8531 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:25.222977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc9e0549-b8a6-46b3-831c-24e28bdc8531 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:25.227870 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc9e0549-b8a6-46b3-831c-24e28bdc8531 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:25.229073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc9e0549-b8a6-46b3-831c-24e28bdc8531 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:25.229638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc9e0549-b8a6-46b3-831c-24e28bdc8531 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:25.230087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc9e0549-b8a6-46b3-831c-24e28bdc8531 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:25.230510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc9e0549-b8a6-46b3-831c-24e28bdc8531 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:25.484452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bc9e0549-b8a6-46b3-831c-24e28bdc8531 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:25.494136 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bc9e0549-b8a6-46b3-831c-24e28bdc8531 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 200 len: 1362 microversion: 2.1 time: 0.286245 Aug 30 14:47:25.494996 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 303/616] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:25 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:25.627551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8b88dbb6-557c-4d62-9f57-e6ed3202d3ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:25.628166 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8b88dbb6-557c-4d62-9f57-e6ed3202d3ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:25.634001 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b88dbb6-557c-4d62-9f57-e6ed3202d3ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:25.635022 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b88dbb6-557c-4d62-9f57-e6ed3202d3ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:25.635599 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b88dbb6-557c-4d62-9f57-e6ed3202d3ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:25.636308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b88dbb6-557c-4d62-9f57-e6ed3202d3ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:25.636760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b88dbb6-557c-4d62-9f57-e6ed3202d3ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:25.637179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b88dbb6-557c-4d62-9f57-e6ed3202d3ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:25.773011 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8b88dbb6-557c-4d62-9f57-e6ed3202d3ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:25.782252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8b88dbb6-557c-4d62-9f57-e6ed3202d3ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.158695 Aug 30 14:47:25.783042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 314/617] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:25 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:25.869290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-e7c11a93-056a-4ff9-bd90-35974c9536de req-530b9f2a-ac94-4d51-94ad-b59e5aa84dca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17fcd66f-fa4d-4b53-a76c-6d10cba8674a", "tag": "bf364e8d-8643-4832-8c3f-5107f56efd6b"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:25.878703 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-e7c11a93-056a-4ff9-bd90-35974c9536de req-530b9f2a-ac94-4d51-94ad-b59e5aa84dca service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:25.879440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-e7c11a93-056a-4ff9-bd90-35974c9536de req-530b9f2a-ac94-4d51-94ad-b59e5aa84dca service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:25.879885 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-e7c11a93-056a-4ff9-bd90-35974c9536de req-530b9f2a-ac94-4d51-94ad-b59e5aa84dca service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:25.892257 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-e7c11a93-056a-4ff9-bd90-35974c9536de req-530b9f2a-ac94-4d51-94ad-b59e5aa84dca service nova] Creating event network-changed:bf364e8d-8643-4832-8c3f-5107f56efd6b for instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a on hv-cinder-82880 Aug 30 14:47:25.897082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-e7c11a93-056a-4ff9-bd90-35974c9536de req-530b9f2a-ac94-4d51-94ad-b59e5aa84dca service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031804 Aug 30 14:47:25.897677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 304/618] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:47:26.187484 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7cdf2bd9-533d-4199-8418-a03dba9ae5f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:26.189544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7cdf2bd9-533d-4199-8418-a03dba9ae5f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:26.196142 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cdf2bd9-533d-4199-8418-a03dba9ae5f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:26.196619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cdf2bd9-533d-4199-8418-a03dba9ae5f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:26.197665 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cdf2bd9-533d-4199-8418-a03dba9ae5f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:26.198552 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cdf2bd9-533d-4199-8418-a03dba9ae5f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:26.199006 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cdf2bd9-533d-4199-8418-a03dba9ae5f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:26.199461 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cdf2bd9-533d-4199-8418-a03dba9ae5f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:26.231156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7cdf2bd9-533d-4199-8418-a03dba9ae5f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047764 Aug 30 14:47:26.231758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 315/619] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:26 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:26.516395 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-38599adb-393d-4a75-802c-f8eaa689d58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:26.517002 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-38599adb-393d-4a75-802c-f8eaa689d58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:26.523131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38599adb-393d-4a75-802c-f8eaa689d58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:26.523638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38599adb-393d-4a75-802c-f8eaa689d58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:26.524066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38599adb-393d-4a75-802c-f8eaa689d58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:26.524768 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38599adb-393d-4a75-802c-f8eaa689d58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:26.525258 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38599adb-393d-4a75-802c-f8eaa689d58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:26.525673 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38599adb-393d-4a75-802c-f8eaa689d58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:26.651796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-38599adb-393d-4a75-802c-f8eaa689d58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:26.659376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-38599adb-393d-4a75-802c-f8eaa689d58b tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 200 len: 1362 microversion: 2.1 time: 0.147781 Aug 30 14:47:26.659942 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 305/620] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:26 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:26.803458 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ec547ea2-2b41-4676-aa18-43bfc13afe1d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:26.804000 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ec547ea2-2b41-4676-aa18-43bfc13afe1d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:26.809923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec547ea2-2b41-4676-aa18-43bfc13afe1d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:26.810403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec547ea2-2b41-4676-aa18-43bfc13afe1d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:26.810837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec547ea2-2b41-4676-aa18-43bfc13afe1d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:26.811548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec547ea2-2b41-4676-aa18-43bfc13afe1d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:26.812001 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec547ea2-2b41-4676-aa18-43bfc13afe1d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:26.812423 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec547ea2-2b41-4676-aa18-43bfc13afe1d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:26.936519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ec547ea2-2b41-4676-aa18-43bfc13afe1d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:26.944851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ec547ea2-2b41-4676-aa18-43bfc13afe1d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.145363 Aug 30 14:47:26.945419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 316/621] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:26 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:27.243548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a32c574d-3ea5-49be-9ff2-363374b0d01a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:27.245838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a32c574d-3ea5-49be-9ff2-363374b0d01a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:27.251776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a32c574d-3ea5-49be-9ff2-363374b0d01a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:27.252251 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a32c574d-3ea5-49be-9ff2-363374b0d01a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:27.252680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a32c574d-3ea5-49be-9ff2-363374b0d01a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:27.253362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a32c574d-3ea5-49be-9ff2-363374b0d01a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:27.253805 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a32c574d-3ea5-49be-9ff2-363374b0d01a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:27.254229 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a32c574d-3ea5-49be-9ff2-363374b0d01a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:27.270914 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:27.285139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a32c574d-3ea5-49be-9ff2-363374b0d01a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045646 Aug 30 14:47:27.285693 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 306/622] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:27 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:27.682079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c2a3e39a-4fae-45cf-9674-fc2e40037e8a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:27.682816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c2a3e39a-4fae-45cf-9674-fc2e40037e8a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:27.689658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c2a3e39a-4fae-45cf-9674-fc2e40037e8a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:27.690146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c2a3e39a-4fae-45cf-9674-fc2e40037e8a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:27.690850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c2a3e39a-4fae-45cf-9674-fc2e40037e8a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:27.691845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c2a3e39a-4fae-45cf-9674-fc2e40037e8a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:27.692300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c2a3e39a-4fae-45cf-9674-fc2e40037e8a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:27.692728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c2a3e39a-4fae-45cf-9674-fc2e40037e8a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:27.820711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c2a3e39a-4fae-45cf-9674-fc2e40037e8a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:27.828964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c2a3e39a-4fae-45cf-9674-fc2e40037e8a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 200 len: 1362 microversion: 2.1 time: 0.152577 Aug 30 14:47:27.829515 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 317/623] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:27 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:27.965633 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-25840481-3049-448d-bde7-168855d62cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:27.966231 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-25840481-3049-448d-bde7-168855d62cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:27.972501 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25840481-3049-448d-bde7-168855d62cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:27.972976 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25840481-3049-448d-bde7-168855d62cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:27.973400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25840481-3049-448d-bde7-168855d62cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:27.974075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25840481-3049-448d-bde7-168855d62cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:27.974524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25840481-3049-448d-bde7-168855d62cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:27.974945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25840481-3049-448d-bde7-168855d62cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:28.299349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e74e89ec-3ca4-40e3-aa11-186a5795376e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:28.301625 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e74e89ec-3ca4-40e3-aa11-186a5795376e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:28.307996 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e74e89ec-3ca4-40e3-aa11-186a5795376e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:28.308490 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e74e89ec-3ca4-40e3-aa11-186a5795376e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:28.308922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e74e89ec-3ca4-40e3-aa11-186a5795376e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:28.309640 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e74e89ec-3ca4-40e3-aa11-186a5795376e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:28.310096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e74e89ec-3ca4-40e3-aa11-186a5795376e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:28.310522 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e74e89ec-3ca4-40e3-aa11-186a5795376e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:28.342176 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e74e89ec-3ca4-40e3-aa11-186a5795376e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046851 Aug 30 14:47:28.342749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 318/624] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:28 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:47:28.356176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-25840481-3049-448d-bde7-168855d62cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:28.364180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-25840481-3049-448d-bde7-168855d62cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.402636 Aug 30 14:47:28.364745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 307/625] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:27 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:28.849538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-61cba995-a761-4be1-861a-ee667cb9491a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:28.850393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-61cba995-a761-4be1-861a-ee667cb9491a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:28.857926 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61cba995-a761-4be1-861a-ee667cb9491a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:28.858504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61cba995-a761-4be1-861a-ee667cb9491a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:28.859197 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61cba995-a761-4be1-861a-ee667cb9491a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:28.859990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61cba995-a761-4be1-861a-ee667cb9491a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:28.860784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61cba995-a761-4be1-861a-ee667cb9491a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:28.861389 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61cba995-a761-4be1-861a-ee667cb9491a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:29.006919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-61cba995-a761-4be1-861a-ee667cb9491a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:29.015228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-61cba995-a761-4be1-861a-ee667cb9491a tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 200 len: 1362 microversion: 2.1 time: 0.169312 Aug 30 14:47:29.015966 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 319/626] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:28 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:29.354758 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e5dfce00-2285-4d7d-ae1e-00d7a0e9f570 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:29.356962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e5dfce00-2285-4d7d-ae1e-00d7a0e9f570 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:29.363286 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5dfce00-2285-4d7d-ae1e-00d7a0e9f570 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:29.363771 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5dfce00-2285-4d7d-ae1e-00d7a0e9f570 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:29.364205 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5dfce00-2285-4d7d-ae1e-00d7a0e9f570 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:29.364902 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5dfce00-2285-4d7d-ae1e-00d7a0e9f570 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:29.365350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5dfce00-2285-4d7d-ae1e-00d7a0e9f570 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:29.365772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5dfce00-2285-4d7d-ae1e-00d7a0e9f570 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:29.384243 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d464ecc6-c474-4a18-8152-5e6d0227f283 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:29.385511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d464ecc6-c474-4a18-8152-5e6d0227f283 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:29.391656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d464ecc6-c474-4a18-8152-5e6d0227f283 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:29.392462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d464ecc6-c474-4a18-8152-5e6d0227f283 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:29.392886 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d464ecc6-c474-4a18-8152-5e6d0227f283 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:29.393845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d464ecc6-c474-4a18-8152-5e6d0227f283 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:29.394542 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d464ecc6-c474-4a18-8152-5e6d0227f283 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:29.395185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d464ecc6-c474-4a18-8152-5e6d0227f283 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:29.398324 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e5dfce00-2285-4d7d-ae1e-00d7a0e9f570 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048203 Aug 30 14:47:29.398915 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 308/627] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:29 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:29.533534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d464ecc6-c474-4a18-8152-5e6d0227f283 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:29.541857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d464ecc6-c474-4a18-8152-5e6d0227f283 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.161489 Aug 30 14:47:29.542439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 320/628] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:29 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:30.036225 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b991318e-fa75-4e42-8f57-f13a3ba0a113 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:30.036754 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b991318e-fa75-4e42-8f57-f13a3ba0a113 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:30.042986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b991318e-fa75-4e42-8f57-f13a3ba0a113 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:30.043494 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b991318e-fa75-4e42-8f57-f13a3ba0a113 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:30.043934 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b991318e-fa75-4e42-8f57-f13a3ba0a113 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:30.044635 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b991318e-fa75-4e42-8f57-f13a3ba0a113 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:30.045088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b991318e-fa75-4e42-8f57-f13a3ba0a113 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:30.045511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b991318e-fa75-4e42-8f57-f13a3ba0a113 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:30.175407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b991318e-fa75-4e42-8f57-f13a3ba0a113 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:30.183853 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b991318e-fa75-4e42-8f57-f13a3ba0a113 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 200 len: 1362 microversion: 2.1 time: 0.151593 Aug 30 14:47:30.184426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 309/629] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:30 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:30.410873 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-46a7158f-4856-4121-8f9d-7952712eca87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:30.413034 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-46a7158f-4856-4121-8f9d-7952712eca87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:30.419499 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46a7158f-4856-4121-8f9d-7952712eca87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:30.419976 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46a7158f-4856-4121-8f9d-7952712eca87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:30.420539 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46a7158f-4856-4121-8f9d-7952712eca87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:30.421149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46a7158f-4856-4121-8f9d-7952712eca87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:30.421687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46a7158f-4856-4121-8f9d-7952712eca87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:30.422170 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46a7158f-4856-4121-8f9d-7952712eca87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:30.451715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-46a7158f-4856-4121-8f9d-7952712eca87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044751 Aug 30 14:47:30.452270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 321/630] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:30 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:30.677701 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9bf48409-e843-42a1-a980-f0d18c6d8ae3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:30.678312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9bf48409-e843-42a1-a980-f0d18c6d8ae3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:30.680222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:30.685985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bf48409-e843-42a1-a980-f0d18c6d8ae3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:30.686468 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bf48409-e843-42a1-a980-f0d18c6d8ae3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:30.686901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bf48409-e843-42a1-a980-f0d18c6d8ae3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:30.687621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bf48409-e843-42a1-a980-f0d18c6d8ae3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:30.688074 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bf48409-e843-42a1-a980-f0d18c6d8ae3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:30.688493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bf48409-e843-42a1-a980-f0d18c6d8ae3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:30.824973 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9bf48409-e843-42a1-a980-f0d18c6d8ae3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:30.833935 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9bf48409-e843-42a1-a980-f0d18c6d8ae3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1716 microversion: 2.1 time: 0.275351 Aug 30 14:47:30.834556 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 310/631] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:30 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1716 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:30.894510 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-868e9c3f-339e-4776-a8f7-17e41f820040 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:30.895120 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-868e9c3f-339e-4776-a8f7-17e41f820040 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:30.897061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:30.902829 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-868e9c3f-339e-4776-a8f7-17e41f820040 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:30.903425 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-868e9c3f-339e-4776-a8f7-17e41f820040 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:30.903967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-868e9c3f-339e-4776-a8f7-17e41f820040 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:30.904796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-868e9c3f-339e-4776-a8f7-17e41f820040 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:30.905315 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-868e9c3f-339e-4776-a8f7-17e41f820040 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:30.905863 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-868e9c3f-339e-4776-a8f7-17e41f820040 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:30.927753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-dd4e4936-7bf0-4c79-b006-b57c71f336b4 req-e657d66c-07fb-4cf7-bdbd-9c69e725541b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17fcd66f-fa4d-4b53-a76c-6d10cba8674a", "name": "network-vif-plugged", "status": "completed", "tag": "bf364e8d-8643-4832-8c3f-5107f56efd6b"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:30.939539 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-dd4e4936-7bf0-4c79-b006-b57c71f336b4 req-e657d66c-07fb-4cf7-bdbd-9c69e725541b service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:30.939968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-dd4e4936-7bf0-4c79-b006-b57c71f336b4 req-e657d66c-07fb-4cf7-bdbd-9c69e725541b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:30.940468 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-dd4e4936-7bf0-4c79-b006-b57c71f336b4 req-e657d66c-07fb-4cf7-bdbd-9c69e725541b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:30.953254 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-dd4e4936-7bf0-4c79-b006-b57c71f336b4 req-e657d66c-07fb-4cf7-bdbd-9c69e725541b service nova] Creating event network-vif-plugged:bf364e8d-8643-4832-8c3f-5107f56efd6b for instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a on hv-cinder-82880 Aug 30 14:47:30.959222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-dd4e4936-7bf0-4c79-b006-b57c71f336b4 req-e657d66c-07fb-4cf7-bdbd-9c69e725541b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036853 Aug 30 14:47:30.960130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 311/632] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:47:30.996591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-868e9c3f-339e-4776-a8f7-17e41f820040 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] HTTP exception thrown: Cannot 'detach_volume' instance e42a99ef-987b-4b7f-a6ef-5458fccc5c52 while it is in vm_state rescued Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-868e9c3f-339e-4776-a8f7-17e41f820040 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Request method failure captured: Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: DELETE /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments/9a4622f6-6d77-44f7-9672-b00addcd4459 HTTP/1.1 Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHV8l34OZZHwNsM6lH1lEq9yVrUpRfBmeZovqeGZdHzP-i2fdi3fDhAn1Yn4OqxAY-c8j3adWS2dsfjLxxuH2lkmuX086z2M_u_ap-gLP6YJy1Q6J4kjuRWRTjpojkyG-eVDtFa0STcuNEHUUsJRYwLv6xBXQ1t71A68FFQivqPRdQ Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: 65bab38256b44ad6b4b573a2441eb6d3 Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-420783002 Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 14:47:30.998204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 14:47:30.999858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65bab38256b44ad6b4b573a2441eb6d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_65bab38256b44ad6b4b573a2441eb6d3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65bab38256b44ad6b4b573a2441eb6d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/65bab38256b44ad6b4b573a2441eb6d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:47:30.999858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-ServerRescueNegativeTestJSON-420783002 Aug 30 14:47:30.999858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: 65bab38256b44ad6b4b573a2441eb6d3 Aug 30 14:47:30.999858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-420783002 Aug 30 14:47:30.999858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-ServerRescueNegativeTestJSON-420783002-project Aug 30 14:47:30.999858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 14:47:30.999858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 14:47:30.999858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: 35f28006916040c3b988de6c15093166 Aug 30 14:47:30.999858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-ServerRescueNegativeTestJSON-420783002-project Aug 30 14:47:30.999858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 14:47:30.999858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Cannot 'detach_volume' instance e42a99ef-987b-4b7f-a6ef-5458fccc5c52 while it is in vm_state rescued Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'server_id': 'e42a99ef-987b-4b7f-a6ef-5458fccc5c52', 'id': '9a4622f6-6d77-44f7-9672-b00addcd4459'} Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e42a99ef-987b-4b7f-a6ef-5458fccc5c52 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:47:31.000575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e42a99ef-987b-4b7f-a6ef-5458fccc5c52 while it is in vm_state rescued Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e42a99ef-987b-4b7f-a6ef-5458fccc5c52 while it is in vm_state rescued Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:47:31.002898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-868e9c3f-339e-4776-a8f7-17e41f820040 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Returning 409 to user: Cannot 'detach_volume' instance e42a99ef-987b-4b7f-a6ef-5458fccc5c52 while it is in vm_state rescued {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:47:31.004609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-868e9c3f-339e-4776-a8f7-17e41f820040 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments/9a4622f6-6d77-44f7-9672-b00addcd4459" status: 409 len: 152 microversion: 2.1 time: 0.109163 Aug 30 14:47:31.004609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 322/633] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 14:47:30 2022] DELETE /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments/9a4622f6-6d77-44f7-9672-b00addcd4459 => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 14:47:31.009685 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a5515e69-7dfb-4f98-a0ed-1081777796ae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:31.010390 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a5515e69-7dfb-4f98-a0ed-1081777796ae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:31.016534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5515e69-7dfb-4f98-a0ed-1081777796ae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.017352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5515e69-7dfb-4f98-a0ed-1081777796ae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.017542 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5515e69-7dfb-4f98-a0ed-1081777796ae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.018131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5515e69-7dfb-4f98-a0ed-1081777796ae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.018581 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5515e69-7dfb-4f98-a0ed-1081777796ae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.019003 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5515e69-7dfb-4f98-a0ed-1081777796ae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.089419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a5515e69-7dfb-4f98-a0ed-1081777796ae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "POST /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/action" status: 202 len: 0 microversion: 2.1 time: 0.084032 Aug 30 14:47:31.090051 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 312/634] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 14:47:31 2022] POST /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:47:31.099076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-53372cab-aabc-4c01-8498-c0b3e363686a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:31.100052 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-53372cab-aabc-4c01-8498-c0b3e363686a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:31.106900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53372cab-aabc-4c01-8498-c0b3e363686a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.107660 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53372cab-aabc-4c01-8498-c0b3e363686a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.108103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53372cab-aabc-4c01-8498-c0b3e363686a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.108916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53372cab-aabc-4c01-8498-c0b3e363686a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.109369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53372cab-aabc-4c01-8498-c0b3e363686a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.109791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53372cab-aabc-4c01-8498-c0b3e363686a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.141457 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=4 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:31.204961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-557d51fa-5963-42f3-908e-09ed9c3f31fc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:31.205830 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-557d51fa-5963-42f3-908e-09ed9c3f31fc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:31.213890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-557d51fa-5963-42f3-908e-09ed9c3f31fc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.214671 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-557d51fa-5963-42f3-908e-09ed9c3f31fc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.215186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-557d51fa-5963-42f3-908e-09ed9c3f31fc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.216061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-557d51fa-5963-42f3-908e-09ed9c3f31fc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.216690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-557d51fa-5963-42f3-908e-09ed9c3f31fc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.217118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-557d51fa-5963-42f3-908e-09ed9c3f31fc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.259734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-53372cab-aabc-4c01-8498-c0b3e363686a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:31.268582 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-53372cab-aabc-4c01-8498-c0b3e363686a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1724 microversion: 2.1 time: 0.174163 Aug 30 14:47:31.269173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 323/635] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:31 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:31.461354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-557d51fa-5963-42f3-908e-09ed9c3f31fc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:31.464362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-52cf4844-c0a6-40f4-972e-b468803153b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:31.466587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-52cf4844-c0a6-40f4-972e-b468803153b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:31.469761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-557d51fa-5963-42f3-908e-09ed9c3f31fc tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 200 len: 1362 microversion: 2.1 time: 0.269184 Aug 30 14:47:31.470331 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 313/636] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:31 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:31.473497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52cf4844-c0a6-40f4-972e-b468803153b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.473985 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52cf4844-c0a6-40f4-972e-b468803153b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.474416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52cf4844-c0a6-40f4-972e-b468803153b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.475103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52cf4844-c0a6-40f4-972e-b468803153b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:31.475593 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52cf4844-c0a6-40f4-972e-b468803153b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:31.475999 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52cf4844-c0a6-40f4-972e-b468803153b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:31.506067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-52cf4844-c0a6-40f4-972e-b468803153b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046488 Aug 30 14:47:31.506634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 324/637] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:31 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:47:32.289999 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0f404730-c9f5-487d-9d66-5de062b49ee5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:32.290838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0f404730-c9f5-487d-9d66-5de062b49ee5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:32.297313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f404730-c9f5-487d-9d66-5de062b49ee5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:32.297792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f404730-c9f5-487d-9d66-5de062b49ee5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:32.298221 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f404730-c9f5-487d-9d66-5de062b49ee5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:32.298910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f404730-c9f5-487d-9d66-5de062b49ee5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:32.299392 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f404730-c9f5-487d-9d66-5de062b49ee5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:32.299812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f404730-c9f5-487d-9d66-5de062b49ee5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:32.499431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0f404730-c9f5-487d-9d66-5de062b49ee5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:32.508355 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0f404730-c9f5-487d-9d66-5de062b49ee5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1724 microversion: 2.1 time: 0.222188 Aug 30 14:47:32.509207 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 314/638] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:32 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:32.528479 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d25600ac-6c65-418e-a884-f8904f0b33f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:32.530720 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d25600ac-6c65-418e-a884-f8904f0b33f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:32.536517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d25600ac-6c65-418e-a884-f8904f0b33f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:32.536998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d25600ac-6c65-418e-a884-f8904f0b33f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:32.537428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d25600ac-6c65-418e-a884-f8904f0b33f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:32.538114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d25600ac-6c65-418e-a884-f8904f0b33f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:32.538554 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d25600ac-6c65-418e-a884-f8904f0b33f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:32.538976 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d25600ac-6c65-418e-a884-f8904f0b33f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:32.553184 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-14d4f3f1-05fc-49c3-9fd1-b00094f1f241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:32.553802 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-14d4f3f1-05fc-49c3-9fd1-b00094f1f241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:32.560594 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-14d4f3f1-05fc-49c3-9fd1-b00094f1f241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:32.561085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-14d4f3f1-05fc-49c3-9fd1-b00094f1f241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:32.561515 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-14d4f3f1-05fc-49c3-9fd1-b00094f1f241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:32.562407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-14d4f3f1-05fc-49c3-9fd1-b00094f1f241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:32.562862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-14d4f3f1-05fc-49c3-9fd1-b00094f1f241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:32.563308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-14d4f3f1-05fc-49c3-9fd1-b00094f1f241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:32.581140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d25600ac-6c65-418e-a884-f8904f0b33f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056700 Aug 30 14:47:32.585781 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 315/639] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:32 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:32.585942 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:32.700868 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-14d4f3f1-05fc-49c3-9fd1-b00094f1f241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:32.713765 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-14d4f3f1-05fc-49c3-9fd1-b00094f1f241 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 200 len: 1362 microversion: 2.1 time: 0.227508 Aug 30 14:47:32.714345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 325/640] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:32 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:47:33.530938 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1d30597b-d58a-46d3-b39c-02244b516946 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:33.531628 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1d30597b-d58a-46d3-b39c-02244b516946 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:33.534717 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:33.535513 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=8 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:33.536968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 14:47:33.537107 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 14:47:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 (ip 10.222.0.30) !!! Aug 30 14:47:33.544467 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d30597b-d58a-46d3-b39c-02244b516946 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:33.544951 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d30597b-d58a-46d3-b39c-02244b516946 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:33.545387 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d30597b-d58a-46d3-b39c-02244b516946 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:33.546083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d30597b-d58a-46d3-b39c-02244b516946 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:33.546536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d30597b-d58a-46d3-b39c-02244b516946 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:33.546959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d30597b-d58a-46d3-b39c-02244b516946 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:33.593087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f1be6ed0-2247-4636-b3fe-b7a91e48d778 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:33.595400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f1be6ed0-2247-4636-b3fe-b7a91e48d778 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:33.601903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f1be6ed0-2247-4636-b3fe-b7a91e48d778 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:33.602414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f1be6ed0-2247-4636-b3fe-b7a91e48d778 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:33.602845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f1be6ed0-2247-4636-b3fe-b7a91e48d778 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:33.603710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f1be6ed0-2247-4636-b3fe-b7a91e48d778 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:33.604162 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f1be6ed0-2247-4636-b3fe-b7a91e48d778 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:33.604581 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f1be6ed0-2247-4636-b3fe-b7a91e48d778 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:33.635182 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f1be6ed0-2247-4636-b3fe-b7a91e48d778 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045372 Aug 30 14:47:33.635882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 326/641] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:33 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:47:33.680002 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1d30597b-d58a-46d3-b39c-02244b516946 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:33.688662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1d30597b-d58a-46d3-b39c-02244b516946 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1724 microversion: 2.1 time: 0.161654 Aug 30 14:47:33.689228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 316/642] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:33 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:33.733948 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b3746c31-905b-4977-b0e6-4670e228dbc5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:33.734226 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b3746c31-905b-4977-b0e6-4670e228dbc5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:33.740119 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3746c31-905b-4977-b0e6-4670e228dbc5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:33.740602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3746c31-905b-4977-b0e6-4670e228dbc5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:33.741044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3746c31-905b-4977-b0e6-4670e228dbc5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:33.741735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3746c31-905b-4977-b0e6-4670e228dbc5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:33.742188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3746c31-905b-4977-b0e6-4670e228dbc5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:33.742612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3746c31-905b-4977-b0e6-4670e228dbc5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:33.885180 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b3746c31-905b-4977-b0e6-4670e228dbc5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:33.892599 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b3746c31-905b-4977-b0e6-4670e228dbc5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 200 len: 1547 microversion: 2.1 time: 0.162732 Aug 30 14:47:33.893305 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 327/643] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:33 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:33.913350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f5f647c6-3d48-4f59-acf6-321cbad87cca tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:33.913842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f5f647c6-3d48-4f59-acf6-321cbad87cca tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:33.920368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5f647c6-3d48-4f59-acf6-321cbad87cca tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:33.920851 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5f647c6-3d48-4f59-acf6-321cbad87cca tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:33.921279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5f647c6-3d48-4f59-acf6-321cbad87cca tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:33.921996 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5f647c6-3d48-4f59-acf6-321cbad87cca tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:33.922451 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5f647c6-3d48-4f59-acf6-321cbad87cca tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:33.922877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5f647c6-3d48-4f59-acf6-321cbad87cca tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:33.998923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f5f647c6-3d48-4f59-acf6-321cbad87cca tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089381 Aug 30 14:47:33.999585 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 317/644] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 14:47:33 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:47:34.647192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ec2d5f6f-3f10-47de-9a5e-b2925790d04f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:34.649517 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ec2d5f6f-3f10-47de-9a5e-b2925790d04f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:34.656163 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec2d5f6f-3f10-47de-9a5e-b2925790d04f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:34.656645 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec2d5f6f-3f10-47de-9a5e-b2925790d04f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:34.657070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec2d5f6f-3f10-47de-9a5e-b2925790d04f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:34.657788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec2d5f6f-3f10-47de-9a5e-b2925790d04f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:34.658236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec2d5f6f-3f10-47de-9a5e-b2925790d04f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:34.658653 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec2d5f6f-3f10-47de-9a5e-b2925790d04f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:34.689477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ec2d5f6f-3f10-47de-9a5e-b2925790d04f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046258 Aug 30 14:47:34.690041 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 328/645] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:34 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:34.710423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-797ac223-47ea-4823-9bca-0ba4877610a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:34.711027 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-797ac223-47ea-4823-9bca-0ba4877610a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:34.716956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-797ac223-47ea-4823-9bca-0ba4877610a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:34.717459 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-797ac223-47ea-4823-9bca-0ba4877610a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:34.717891 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-797ac223-47ea-4823-9bca-0ba4877610a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:34.718573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-797ac223-47ea-4823-9bca-0ba4877610a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:34.719094 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-797ac223-47ea-4823-9bca-0ba4877610a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:34.719473 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-797ac223-47ea-4823-9bca-0ba4877610a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:34.904977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-797ac223-47ea-4823-9bca-0ba4877610a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:34.913989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-797ac223-47ea-4823-9bca-0ba4877610a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1724 microversion: 2.1 time: 0.208039 Aug 30 14:47:34.914559 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 318/646] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:34 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:34.994794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-8a94f0b0-bb27-4246-badc-c6fffb19507a req-9d393d7a-f5aa-4524-b132-9262a7477a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17fcd66f-fa4d-4b53-a76c-6d10cba8674a", "tag": "bf364e8d-8643-4832-8c3f-5107f56efd6b"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:35.005771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-8a94f0b0-bb27-4246-badc-c6fffb19507a req-9d393d7a-f5aa-4524-b132-9262a7477a02 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:35.006256 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-8a94f0b0-bb27-4246-badc-c6fffb19507a req-9d393d7a-f5aa-4524-b132-9262a7477a02 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:35.006688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-8a94f0b0-bb27-4246-badc-c6fffb19507a req-9d393d7a-f5aa-4524-b132-9262a7477a02 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:35.020583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-8a94f0b0-bb27-4246-badc-c6fffb19507a req-9d393d7a-f5aa-4524-b132-9262a7477a02 service nova] Creating event network-changed:bf364e8d-8643-4832-8c3f-5107f56efd6b for instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a on hv-cinder-82880 Aug 30 14:47:35.027345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-8a94f0b0-bb27-4246-badc-c6fffb19507a req-9d393d7a-f5aa-4524-b132-9262a7477a02 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037495 Aug 30 14:47:35.028275 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 329/647] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:47:35.834721 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c9e622fe-f675-4bf4-b32a-af1823e2a8d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:35.841506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c9e622fe-f675-4bf4-b32a-af1823e2a8d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:35.850773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9e622fe-f675-4bf4-b32a-af1823e2a8d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:35.851712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9e622fe-f675-4bf4-b32a-af1823e2a8d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:35.852348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9e622fe-f675-4bf4-b32a-af1823e2a8d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:35.856189 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9e622fe-f675-4bf4-b32a-af1823e2a8d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:35.856748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9e622fe-f675-4bf4-b32a-af1823e2a8d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:35.857349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9e622fe-f675-4bf4-b32a-af1823e2a8d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:35.909904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c9e622fe-f675-4bf4-b32a-af1823e2a8d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.211019 Aug 30 14:47:35.910496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 319/648] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:35 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:35.937669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b2ac5f17-203e-43f5-af23-280d3f21f460 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:35.938385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b2ac5f17-203e-43f5-af23-280d3f21f460 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:35.945792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2ac5f17-203e-43f5-af23-280d3f21f460 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:35.946270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2ac5f17-203e-43f5-af23-280d3f21f460 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:35.947852 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2ac5f17-203e-43f5-af23-280d3f21f460 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:35.948563 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2ac5f17-203e-43f5-af23-280d3f21f460 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:35.949014 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2ac5f17-203e-43f5-af23-280d3f21f460 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:35.949429 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2ac5f17-203e-43f5-af23-280d3f21f460 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:36.088249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b2ac5f17-203e-43f5-af23-280d3f21f460 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:47:36.096560 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b2ac5f17-203e-43f5-af23-280d3f21f460 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1730 microversion: 2.1 time: 0.163540 Aug 30 14:47:36.097153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 330/649] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:47:35 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:47:36.117073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a5b68c5b-13c7-46c5-a4dc-6cb3cf708dfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:36.117562 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a5b68c5b-13c7-46c5-a4dc-6cb3cf708dfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:36.124001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5b68c5b-13c7-46c5-a4dc-6cb3cf708dfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:36.124682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5b68c5b-13c7-46c5-a4dc-6cb3cf708dfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:36.125116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5b68c5b-13c7-46c5-a4dc-6cb3cf708dfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:36.125807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5b68c5b-13c7-46c5-a4dc-6cb3cf708dfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:36.126255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5b68c5b-13c7-46c5-a4dc-6cb3cf708dfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:36.126676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5b68c5b-13c7-46c5-a4dc-6cb3cf708dfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:36.206934 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a5b68c5b-13c7-46c5-a4dc-6cb3cf708dfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093651 Aug 30 14:47:36.207578 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 320/650] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 14:47:36 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:47:36.922877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5f1d1a1d-b874-4cd4-9782-2d41509f82ba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:36.925202 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5f1d1a1d-b874-4cd4-9782-2d41509f82ba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:36.933130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5f1d1a1d-b874-4cd4-9782-2d41509f82ba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:36.933710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5f1d1a1d-b874-4cd4-9782-2d41509f82ba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:36.934217 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5f1d1a1d-b874-4cd4-9782-2d41509f82ba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:36.934998 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5f1d1a1d-b874-4cd4-9782-2d41509f82ba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:36.935556 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5f1d1a1d-b874-4cd4-9782-2d41509f82ba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:36.936090 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5f1d1a1d-b874-4cd4-9782-2d41509f82ba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:36.967942 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5f1d1a1d-b874-4cd4-9782-2d41509f82ba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049005 Aug 30 14:47:36.968540 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 331/651] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:36 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:37.061364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-fa030d12-eae8-410c-9787-32c1dbdb7fb0 req-046f1f9a-c7b8-417f-bd18-1ad467fa5cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42a99ef-987b-4b7f-a6ef-5458fccc5c52", "tag": "de9192f0-7fd0-49c1-8393-b52baf316782"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:37.076269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-fa030d12-eae8-410c-9787-32c1dbdb7fb0 req-046f1f9a-c7b8-417f-bd18-1ad467fa5cf8 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:37.077102 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-fa030d12-eae8-410c-9787-32c1dbdb7fb0 req-046f1f9a-c7b8-417f-bd18-1ad467fa5cf8 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:37.077605 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-fa030d12-eae8-410c-9787-32c1dbdb7fb0 req-046f1f9a-c7b8-417f-bd18-1ad467fa5cf8 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:37.090767 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-fa030d12-eae8-410c-9787-32c1dbdb7fb0 req-046f1f9a-c7b8-417f-bd18-1ad467fa5cf8 service nova] Creating event network-changed:de9192f0-7fd0-49c1-8393-b52baf316782 for instance e42a99ef-987b-4b7f-a6ef-5458fccc5c52 on hv-cinder-82880 Aug 30 14:47:37.095754 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-fa030d12-eae8-410c-9787-32c1dbdb7fb0 req-046f1f9a-c7b8-417f-bd18-1ad467fa5cf8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038657 Aug 30 14:47:37.096471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 321/652] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:47:37.980419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5b80ac71-000e-453b-b50c-4d943ae2acb5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:37.982605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5b80ac71-000e-453b-b50c-4d943ae2acb5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:37.989221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b80ac71-000e-453b-b50c-4d943ae2acb5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:37.989961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b80ac71-000e-453b-b50c-4d943ae2acb5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:37.990573 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b80ac71-000e-453b-b50c-4d943ae2acb5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:37.991296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b80ac71-000e-453b-b50c-4d943ae2acb5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:37.991748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b80ac71-000e-453b-b50c-4d943ae2acb5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:37.992173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b80ac71-000e-453b-b50c-4d943ae2acb5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:38.022683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5b80ac71-000e-453b-b50c-4d943ae2acb5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046406 Aug 30 14:47:38.023248 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 332/653] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:37 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:39.036445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-40f06884-4918-468d-b955-824f7100e067 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:39.038649 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-40f06884-4918-468d-b955-824f7100e067 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:39.045669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40f06884-4918-468d-b955-824f7100e067 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:39.046154 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40f06884-4918-468d-b955-824f7100e067 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:39.046579 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40f06884-4918-468d-b955-824f7100e067 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:39.047291 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40f06884-4918-468d-b955-824f7100e067 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:39.047738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40f06884-4918-468d-b955-824f7100e067 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:39.048148 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40f06884-4918-468d-b955-824f7100e067 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:39.077912 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-40f06884-4918-468d-b955-824f7100e067 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046598 Aug 30 14:47:39.078403 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 322/654] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:39 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:39.110269 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-deeacfff-b673-465c-bda0-5785510370d9 req-0b94289e-ee5f-41c0-859b-c8a34562868f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42a99ef-987b-4b7f-a6ef-5458fccc5c52", "tag": "de9192f0-7fd0-49c1-8393-b52baf316782"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:47:39.121454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-deeacfff-b673-465c-bda0-5785510370d9 req-0b94289e-ee5f-41c0-859b-c8a34562868f service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:39.121921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-deeacfff-b673-465c-bda0-5785510370d9 req-0b94289e-ee5f-41c0-859b-c8a34562868f service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:39.122339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-deeacfff-b673-465c-bda0-5785510370d9 req-0b94289e-ee5f-41c0-859b-c8a34562868f service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:39.135620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-deeacfff-b673-465c-bda0-5785510370d9 req-0b94289e-ee5f-41c0-859b-c8a34562868f service nova] Creating event network-changed:de9192f0-7fd0-49c1-8393-b52baf316782 for instance e42a99ef-987b-4b7f-a6ef-5458fccc5c52 on hv-cinder-82880 Aug 30 14:47:39.140563 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-deeacfff-b673-465c-bda0-5785510370d9 req-0b94289e-ee5f-41c0-859b-c8a34562868f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033799 Aug 30 14:47:39.141145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 333/655] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:47:40.090669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-eac7654d-8436-4b30-9955-2f60fbb3151f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:40.093039 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-eac7654d-8436-4b30-9955-2f60fbb3151f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:40.099231 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eac7654d-8436-4b30-9955-2f60fbb3151f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:40.099719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eac7654d-8436-4b30-9955-2f60fbb3151f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:40.100149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eac7654d-8436-4b30-9955-2f60fbb3151f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:40.100843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eac7654d-8436-4b30-9955-2f60fbb3151f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:40.101292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eac7654d-8436-4b30-9955-2f60fbb3151f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:40.101715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eac7654d-8436-4b30-9955-2f60fbb3151f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:40.132350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-eac7654d-8436-4b30-9955-2f60fbb3151f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046227 Aug 30 14:47:40.132911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 323/656] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:40 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:41.147034 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4b2d394d-9727-4d2f-9073-b24e233fa457 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:41.149458 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4b2d394d-9727-4d2f-9073-b24e233fa457 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:41.156455 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b2d394d-9727-4d2f-9073-b24e233fa457 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:41.156794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b2d394d-9727-4d2f-9073-b24e233fa457 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:41.157235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b2d394d-9727-4d2f-9073-b24e233fa457 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:41.157932 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b2d394d-9727-4d2f-9073-b24e233fa457 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:41.158387 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b2d394d-9727-4d2f-9073-b24e233fa457 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:41.158806 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b2d394d-9727-4d2f-9073-b24e233fa457 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:41.188362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4b2d394d-9727-4d2f-9073-b24e233fa457 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047550 Aug 30 14:47:41.188918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 334/657] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:41 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:42.201679 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0aa4f401-50c0-4f3e-9d5d-4c0a05ef802e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:42.204071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0aa4f401-50c0-4f3e-9d5d-4c0a05ef802e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:42.211017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0aa4f401-50c0-4f3e-9d5d-4c0a05ef802e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:42.211532 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0aa4f401-50c0-4f3e-9d5d-4c0a05ef802e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:42.212580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0aa4f401-50c0-4f3e-9d5d-4c0a05ef802e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:42.213838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0aa4f401-50c0-4f3e-9d5d-4c0a05ef802e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:42.213939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0aa4f401-50c0-4f3e-9d5d-4c0a05ef802e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:42.214361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0aa4f401-50c0-4f3e-9d5d-4c0a05ef802e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:42.218327 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:47:42.246285 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0aa4f401-50c0-4f3e-9d5d-4c0a05ef802e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048818 Aug 30 14:47:42.246854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 324/658] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:42 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:43.257828 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ae5549fa-b875-4847-aaa6-dc95ae1b953f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:43.260104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ae5549fa-b875-4847-aaa6-dc95ae1b953f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:43.266479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae5549fa-b875-4847-aaa6-dc95ae1b953f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:43.266956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae5549fa-b875-4847-aaa6-dc95ae1b953f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:43.267420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae5549fa-b875-4847-aaa6-dc95ae1b953f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:43.268111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae5549fa-b875-4847-aaa6-dc95ae1b953f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:43.268555 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae5549fa-b875-4847-aaa6-dc95ae1b953f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:43.268999 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae5549fa-b875-4847-aaa6-dc95ae1b953f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:43.298455 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ae5549fa-b875-4847-aaa6-dc95ae1b953f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044486 Aug 30 14:47:43.298998 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 335/659] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:43 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:44.311324 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ed0bd9ee-5cbe-41a2-8ad8-a4b5067fa096 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:44.313116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ed0bd9ee-5cbe-41a2-8ad8-a4b5067fa096 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:44.319923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed0bd9ee-5cbe-41a2-8ad8-a4b5067fa096 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:44.320397 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed0bd9ee-5cbe-41a2-8ad8-a4b5067fa096 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:44.320823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed0bd9ee-5cbe-41a2-8ad8-a4b5067fa096 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:44.322288 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed0bd9ee-5cbe-41a2-8ad8-a4b5067fa096 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:44.322838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed0bd9ee-5cbe-41a2-8ad8-a4b5067fa096 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:44.323277 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed0bd9ee-5cbe-41a2-8ad8-a4b5067fa096 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:44.352639 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ed0bd9ee-5cbe-41a2-8ad8-a4b5067fa096 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045699 Aug 30 14:47:44.353383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 325/660] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:44 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:45.364851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-675d7aee-e3a1-4e4a-a952-1ad3d6ef0977 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:45.366982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-675d7aee-e3a1-4e4a-a952-1ad3d6ef0977 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:45.373031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-675d7aee-e3a1-4e4a-a952-1ad3d6ef0977 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:45.373517 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-675d7aee-e3a1-4e4a-a952-1ad3d6ef0977 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:45.373952 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-675d7aee-e3a1-4e4a-a952-1ad3d6ef0977 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:45.374658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-675d7aee-e3a1-4e4a-a952-1ad3d6ef0977 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:45.375111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-675d7aee-e3a1-4e4a-a952-1ad3d6ef0977 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:45.375563 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-675d7aee-e3a1-4e4a-a952-1ad3d6ef0977 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:45.405305 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-675d7aee-e3a1-4e4a-a952-1ad3d6ef0977 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044458 Aug 30 14:47:45.405852 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 336/661] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:45 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:46.417420 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a5e6fe0a-9a96-44a7-b4b9-bbf842e7566b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:46.419601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a5e6fe0a-9a96-44a7-b4b9-bbf842e7566b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:46.426266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5e6fe0a-9a96-44a7-b4b9-bbf842e7566b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:46.426749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5e6fe0a-9a96-44a7-b4b9-bbf842e7566b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:46.427189 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5e6fe0a-9a96-44a7-b4b9-bbf842e7566b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:46.427905 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5e6fe0a-9a96-44a7-b4b9-bbf842e7566b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:46.428353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5e6fe0a-9a96-44a7-b4b9-bbf842e7566b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:46.428775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5e6fe0a-9a96-44a7-b4b9-bbf842e7566b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:46.458633 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a5e6fe0a-9a96-44a7-b4b9-bbf842e7566b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045304 Aug 30 14:47:46.459199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 326/662] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:46 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:47.471954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b810a0a7-b2c7-447d-81ea-3359c1b8c6ad tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:47.474137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b810a0a7-b2c7-447d-81ea-3359c1b8c6ad tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:47.481126 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b810a0a7-b2c7-447d-81ea-3359c1b8c6ad tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:47.481629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b810a0a7-b2c7-447d-81ea-3359c1b8c6ad tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:47.482068 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b810a0a7-b2c7-447d-81ea-3359c1b8c6ad tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:47.482745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b810a0a7-b2c7-447d-81ea-3359c1b8c6ad tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:47.483186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b810a0a7-b2c7-447d-81ea-3359c1b8c6ad tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:47.483628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b810a0a7-b2c7-447d-81ea-3359c1b8c6ad tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:47.513765 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b810a0a7-b2c7-447d-81ea-3359c1b8c6ad tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045768 Aug 30 14:47:47.514309 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 337/663] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:47 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:48.525621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-96881683-7e16-4865-a64e-5b0d5ceb7c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:48.527758 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-96881683-7e16-4865-a64e-5b0d5ceb7c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:48.534044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96881683-7e16-4865-a64e-5b0d5ceb7c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:48.534522 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96881683-7e16-4865-a64e-5b0d5ceb7c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:48.534954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96881683-7e16-4865-a64e-5b0d5ceb7c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:48.535663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96881683-7e16-4865-a64e-5b0d5ceb7c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:48.536112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96881683-7e16-4865-a64e-5b0d5ceb7c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:48.536531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96881683-7e16-4865-a64e-5b0d5ceb7c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:48.565737 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-96881683-7e16-4865-a64e-5b0d5ceb7c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044589 Aug 30 14:47:48.566556 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 327/664] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:48 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:49.578507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1b049081-1067-4493-826f-9b14b5b5f041 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:49.580641 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1b049081-1067-4493-826f-9b14b5b5f041 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:49.587545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b049081-1067-4493-826f-9b14b5b5f041 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:49.588119 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b049081-1067-4493-826f-9b14b5b5f041 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:49.588547 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b049081-1067-4493-826f-9b14b5b5f041 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:49.589225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b049081-1067-4493-826f-9b14b5b5f041 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:49.589669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b049081-1067-4493-826f-9b14b5b5f041 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:49.590082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b049081-1067-4493-826f-9b14b5b5f041 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:49.619579 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1b049081-1067-4493-826f-9b14b5b5f041 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045121 Aug 30 14:47:49.620139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 338/665] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:49 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:50.631844 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b4dd633d-e6d0-4724-9328-2f6664302f14 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:50.634528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b4dd633d-e6d0-4724-9328-2f6664302f14 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:50.640611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4dd633d-e6d0-4724-9328-2f6664302f14 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:50.641087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4dd633d-e6d0-4724-9328-2f6664302f14 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:50.641514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4dd633d-e6d0-4724-9328-2f6664302f14 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:50.642202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4dd633d-e6d0-4724-9328-2f6664302f14 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:50.642646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4dd633d-e6d0-4724-9328-2f6664302f14 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:50.643072 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4dd633d-e6d0-4724-9328-2f6664302f14 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:50.672361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b4dd633d-e6d0-4724-9328-2f6664302f14 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044495 Aug 30 14:47:50.672917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 328/666] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:50 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:51.684353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f988a1e3-b4a1-4848-a795-7ff8e404ddcf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:51.686513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f988a1e3-b4a1-4848-a795-7ff8e404ddcf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:51.693175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f988a1e3-b4a1-4848-a795-7ff8e404ddcf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:51.693655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f988a1e3-b4a1-4848-a795-7ff8e404ddcf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:51.694084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f988a1e3-b4a1-4848-a795-7ff8e404ddcf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:51.694774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f988a1e3-b4a1-4848-a795-7ff8e404ddcf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:51.695243 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f988a1e3-b4a1-4848-a795-7ff8e404ddcf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:51.695671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f988a1e3-b4a1-4848-a795-7ff8e404ddcf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:51.726580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f988a1e3-b4a1-4848-a795-7ff8e404ddcf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046198 Aug 30 14:47:51.727133 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 339/667] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:51 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:52.739522 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4540bd64-f8ee-4430-bc1d-ea9c0c4a9df1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:52.741606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4540bd64-f8ee-4430-bc1d-ea9c0c4a9df1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:52.748860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4540bd64-f8ee-4430-bc1d-ea9c0c4a9df1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:52.749328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4540bd64-f8ee-4430-bc1d-ea9c0c4a9df1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:52.749749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4540bd64-f8ee-4430-bc1d-ea9c0c4a9df1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:52.750420 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4540bd64-f8ee-4430-bc1d-ea9c0c4a9df1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:52.750857 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4540bd64-f8ee-4430-bc1d-ea9c0c4a9df1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:52.751290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4540bd64-f8ee-4430-bc1d-ea9c0c4a9df1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:52.780094 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4540bd64-f8ee-4430-bc1d-ea9c0c4a9df1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044642 Aug 30 14:47:52.780640 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 329/668] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:52 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:53.792958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-909d49e8-ee41-46f7-a48c-88533b43d647 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:53.795075 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-909d49e8-ee41-46f7-a48c-88533b43d647 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:53.801476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-909d49e8-ee41-46f7-a48c-88533b43d647 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:53.801964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-909d49e8-ee41-46f7-a48c-88533b43d647 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:53.802401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-909d49e8-ee41-46f7-a48c-88533b43d647 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:53.803090 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-909d49e8-ee41-46f7-a48c-88533b43d647 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:53.803569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-909d49e8-ee41-46f7-a48c-88533b43d647 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:53.803991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-909d49e8-ee41-46f7-a48c-88533b43d647 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:53.833831 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-909d49e8-ee41-46f7-a48c-88533b43d647 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045081 Aug 30 14:47:53.834393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 340/669] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:53 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:54.845969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b99877b9-79a4-4c53-a67d-d4c0be8f92f9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:54.848106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b99877b9-79a4-4c53-a67d-d4c0be8f92f9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:54.855118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b99877b9-79a4-4c53-a67d-d4c0be8f92f9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:54.855626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b99877b9-79a4-4c53-a67d-d4c0be8f92f9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:54.856049 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b99877b9-79a4-4c53-a67d-d4c0be8f92f9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:54.856722 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b99877b9-79a4-4c53-a67d-d4c0be8f92f9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:54.857160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b99877b9-79a4-4c53-a67d-d4c0be8f92f9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:54.857596 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b99877b9-79a4-4c53-a67d-d4c0be8f92f9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:54.886699 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b99877b9-79a4-4c53-a67d-d4c0be8f92f9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044637 Aug 30 14:47:54.887253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 330/670] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:54 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:55.897999 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d458c2ef-5480-46a6-81f4-bcd784109537 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:55.900554 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d458c2ef-5480-46a6-81f4-bcd784109537 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:55.906981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d458c2ef-5480-46a6-81f4-bcd784109537 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:55.907496 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d458c2ef-5480-46a6-81f4-bcd784109537 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:55.907929 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d458c2ef-5480-46a6-81f4-bcd784109537 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:55.908613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d458c2ef-5480-46a6-81f4-bcd784109537 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:55.909063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d458c2ef-5480-46a6-81f4-bcd784109537 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:55.909480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d458c2ef-5480-46a6-81f4-bcd784109537 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:55.938890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d458c2ef-5480-46a6-81f4-bcd784109537 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044849 Aug 30 14:47:55.939464 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 341/671] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:55 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:56.952012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-40b56266-32bc-4506-99e4-2626f6917df7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:56.954103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-40b56266-32bc-4506-99e4-2626f6917df7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:56.960448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40b56266-32bc-4506-99e4-2626f6917df7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:56.960920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40b56266-32bc-4506-99e4-2626f6917df7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:56.961428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40b56266-32bc-4506-99e4-2626f6917df7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:56.962109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40b56266-32bc-4506-99e4-2626f6917df7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:56.962549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40b56266-32bc-4506-99e4-2626f6917df7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:56.962962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40b56266-32bc-4506-99e4-2626f6917df7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:56.991725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-40b56266-32bc-4506-99e4-2626f6917df7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043643 Aug 30 14:47:56.992275 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 331/672] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:56 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:58.004342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c755ee29-8cbe-49ed-bfb6-4a44ade012b6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:58.006450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c755ee29-8cbe-49ed-bfb6-4a44ade012b6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:58.013730 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c755ee29-8cbe-49ed-bfb6-4a44ade012b6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:58.014208 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c755ee29-8cbe-49ed-bfb6-4a44ade012b6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:58.014641 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c755ee29-8cbe-49ed-bfb6-4a44ade012b6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:58.015362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c755ee29-8cbe-49ed-bfb6-4a44ade012b6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:58.015811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c755ee29-8cbe-49ed-bfb6-4a44ade012b6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:58.016231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c755ee29-8cbe-49ed-bfb6-4a44ade012b6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:58.045474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c755ee29-8cbe-49ed-bfb6-4a44ade012b6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045028 Aug 30 14:47:58.046026 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 342/673] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:57 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:47:59.057341 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-523bb2f5-01f9-4c0d-a454-76a944419ae2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:47:59.059501 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-523bb2f5-01f9-4c0d-a454-76a944419ae2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:47:59.065858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-523bb2f5-01f9-4c0d-a454-76a944419ae2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:59.066595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-523bb2f5-01f9-4c0d-a454-76a944419ae2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:59.067029 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-523bb2f5-01f9-4c0d-a454-76a944419ae2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:59.067744 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-523bb2f5-01f9-4c0d-a454-76a944419ae2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:47:59.068198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-523bb2f5-01f9-4c0d-a454-76a944419ae2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:47:59.068626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-523bb2f5-01f9-4c0d-a454-76a944419ae2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:47:59.097882 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-523bb2f5-01f9-4c0d-a454-76a944419ae2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044502 Aug 30 14:47:59.098365 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 332/674] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:47:59 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:00.109861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bd7d0e4a-2170-4710-a965-407208907adc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:00.112027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bd7d0e4a-2170-4710-a965-407208907adc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:00.119113 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd7d0e4a-2170-4710-a965-407208907adc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:00.119623 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd7d0e4a-2170-4710-a965-407208907adc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:00.120062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd7d0e4a-2170-4710-a965-407208907adc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:00.120760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd7d0e4a-2170-4710-a965-407208907adc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:00.121214 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd7d0e4a-2170-4710-a965-407208907adc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:00.121893 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd7d0e4a-2170-4710-a965-407208907adc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:00.139103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:00.152706 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bd7d0e4a-2170-4710-a965-407208907adc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046770 Aug 30 14:48:00.153269 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 343/675] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:00 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:01.165176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2468b1a3-4bf1-49ac-a97c-50fcb5870eef tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:01.167360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2468b1a3-4bf1-49ac-a97c-50fcb5870eef tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:01.169658 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=46 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:01.174910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2468b1a3-4bf1-49ac-a97c-50fcb5870eef tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:01.175427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2468b1a3-4bf1-49ac-a97c-50fcb5870eef tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:01.175924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2468b1a3-4bf1-49ac-a97c-50fcb5870eef tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:01.176617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2468b1a3-4bf1-49ac-a97c-50fcb5870eef tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:01.177071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2468b1a3-4bf1-49ac-a97c-50fcb5870eef tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:01.177493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2468b1a3-4bf1-49ac-a97c-50fcb5870eef tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:01.207079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2468b1a3-4bf1-49ac-a97c-50fcb5870eef tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046051 Aug 30 14:48:01.207675 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 333/676] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:01 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:02.220029 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cbf7c057-7376-42eb-a14e-483a7f6e9626 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:02.222161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cbf7c057-7376-42eb-a14e-483a7f6e9626 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:02.224569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=44 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:02.231106 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbf7c057-7376-42eb-a14e-483a7f6e9626 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:02.231629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbf7c057-7376-42eb-a14e-483a7f6e9626 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:02.232069 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbf7c057-7376-42eb-a14e-483a7f6e9626 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:02.232762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbf7c057-7376-42eb-a14e-483a7f6e9626 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:02.233214 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbf7c057-7376-42eb-a14e-483a7f6e9626 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:02.233638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbf7c057-7376-42eb-a14e-483a7f6e9626 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:02.262353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cbf7c057-7376-42eb-a14e-483a7f6e9626 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046305 Aug 30 14:48:02.262909 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 344/677] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:02 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:03.273922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2fe88f13-0315-4e55-996b-a9d574688295 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:03.276152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2fe88f13-0315-4e55-996b-a9d574688295 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:03.282491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fe88f13-0315-4e55-996b-a9d574688295 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:03.282970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fe88f13-0315-4e55-996b-a9d574688295 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:03.283445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fe88f13-0315-4e55-996b-a9d574688295 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:03.284138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fe88f13-0315-4e55-996b-a9d574688295 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:03.284588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fe88f13-0315-4e55-996b-a9d574688295 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:03.285008 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fe88f13-0315-4e55-996b-a9d574688295 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:03.314915 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2fe88f13-0315-4e55-996b-a9d574688295 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044910 Aug 30 14:48:03.315494 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 334/678] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:03 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:04.327874 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b3be734d-2434-46d5-8753-86189250a01d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:04.330073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b3be734d-2434-46d5-8753-86189250a01d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:04.336467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3be734d-2434-46d5-8753-86189250a01d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:04.336994 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3be734d-2434-46d5-8753-86189250a01d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:04.337414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3be734d-2434-46d5-8753-86189250a01d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:04.338094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3be734d-2434-46d5-8753-86189250a01d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:04.338535 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3be734d-2434-46d5-8753-86189250a01d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:04.338948 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3be734d-2434-46d5-8753-86189250a01d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:04.368486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b3be734d-2434-46d5-8753-86189250a01d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044491 Aug 30 14:48:04.369033 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 345/679] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:04 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:05.380744 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-da831388-dab0-4132-b0ac-8d385fcb5e76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:05.382869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-da831388-dab0-4132-b0ac-8d385fcb5e76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:05.390066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da831388-dab0-4132-b0ac-8d385fcb5e76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:05.390542 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da831388-dab0-4132-b0ac-8d385fcb5e76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:05.390972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da831388-dab0-4132-b0ac-8d385fcb5e76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:05.391694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da831388-dab0-4132-b0ac-8d385fcb5e76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:05.392137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da831388-dab0-4132-b0ac-8d385fcb5e76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:05.392547 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da831388-dab0-4132-b0ac-8d385fcb5e76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:05.421843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-da831388-dab0-4132-b0ac-8d385fcb5e76 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045051 Aug 30 14:48:05.422391 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 335/680] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:05 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:06.434604 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3b60dc50-ef8b-4b15-82a9-920e1b06972b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:06.436746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3b60dc50-ef8b-4b15-82a9-920e1b06972b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:06.443591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b60dc50-ef8b-4b15-82a9-920e1b06972b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:06.444082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b60dc50-ef8b-4b15-82a9-920e1b06972b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:06.444515 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b60dc50-ef8b-4b15-82a9-920e1b06972b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:06.445202 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b60dc50-ef8b-4b15-82a9-920e1b06972b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:06.446167 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b60dc50-ef8b-4b15-82a9-920e1b06972b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:06.446589 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b60dc50-ef8b-4b15-82a9-920e1b06972b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:06.475787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3b60dc50-ef8b-4b15-82a9-920e1b06972b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044997 Aug 30 14:48:06.476279 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 346/681] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:06 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:07.488138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4a1d86b5-d5f4-4b16-bc9a-34be07bbd9b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:07.490178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4a1d86b5-d5f4-4b16-bc9a-34be07bbd9b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:07.496623 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a1d86b5-d5f4-4b16-bc9a-34be07bbd9b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:07.497104 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a1d86b5-d5f4-4b16-bc9a-34be07bbd9b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:07.497534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a1d86b5-d5f4-4b16-bc9a-34be07bbd9b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:07.498218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a1d86b5-d5f4-4b16-bc9a-34be07bbd9b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:07.498665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a1d86b5-d5f4-4b16-bc9a-34be07bbd9b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:07.499086 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a1d86b5-d5f4-4b16-bc9a-34be07bbd9b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:07.528260 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4a1d86b5-d5f4-4b16-bc9a-34be07bbd9b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044154 Aug 30 14:48:07.528812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 336/682] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:07 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:08.540996 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4bd79a35-6af2-47e9-a0fe-72deb94b9682 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:08.543097 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4bd79a35-6af2-47e9-a0fe-72deb94b9682 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:08.549859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bd79a35-6af2-47e9-a0fe-72deb94b9682 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:08.550350 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bd79a35-6af2-47e9-a0fe-72deb94b9682 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:08.550790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bd79a35-6af2-47e9-a0fe-72deb94b9682 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:08.551564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bd79a35-6af2-47e9-a0fe-72deb94b9682 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:08.552038 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bd79a35-6af2-47e9-a0fe-72deb94b9682 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:08.552494 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bd79a35-6af2-47e9-a0fe-72deb94b9682 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:08.582514 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4bd79a35-6af2-47e9-a0fe-72deb94b9682 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046229 Aug 30 14:48:08.583070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 347/683] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:08 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:09.327441 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-42e529ba-c0c3-4c2f-9257-1cf6dbf2a574 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:09.327958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-42e529ba-c0c3-4c2f-9257-1cf6dbf2a574 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:09.334077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42e529ba-c0c3-4c2f-9257-1cf6dbf2a574 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:09.334551 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42e529ba-c0c3-4c2f-9257-1cf6dbf2a574 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:09.334981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42e529ba-c0c3-4c2f-9257-1cf6dbf2a574 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:09.335680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42e529ba-c0c3-4c2f-9257-1cf6dbf2a574 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:09.336839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42e529ba-c0c3-4c2f-9257-1cf6dbf2a574 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:09.337300 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42e529ba-c0c3-4c2f-9257-1cf6dbf2a574 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:09.416990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-42e529ba-c0c3-4c2f-9257-1cf6dbf2a574 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lazy-loading 'services' on Instance uuid e42a99ef-987b-4b7f-a6ef-5458fccc5c52 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:48:09.488172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-42e529ba-c0c3-4c2f-9257-1cf6dbf2a574 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments/9a4622f6-6d77-44f7-9672-b00addcd4459" status: 202 len: 0 microversion: 2.1 time: 0.164468 Aug 30 14:48:09.488819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 337/684] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 14:48:09 2022] DELETE /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments/9a4622f6-6d77-44f7-9672-b00addcd4459 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:48:09.497702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f4cf2a55-3171-4cdb-8b95-3e19f083898e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:09.499861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f4cf2a55-3171-4cdb-8b95-3e19f083898e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:09.506627 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4cf2a55-3171-4cdb-8b95-3e19f083898e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:09.507326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4cf2a55-3171-4cdb-8b95-3e19f083898e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:09.508584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4cf2a55-3171-4cdb-8b95-3e19f083898e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:09.509450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4cf2a55-3171-4cdb-8b95-3e19f083898e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:09.509943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4cf2a55-3171-4cdb-8b95-3e19f083898e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:09.510372 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4cf2a55-3171-4cdb-8b95-3e19f083898e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:09.542479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f4cf2a55-3171-4cdb-8b95-3e19f083898e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048602 Aug 30 14:48:09.543082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 348/685] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:09 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:09.595767 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bc657f20-6120-477f-9dec-605234251f15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:09.598060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bc657f20-6120-477f-9dec-605234251f15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:09.604684 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc657f20-6120-477f-9dec-605234251f15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:09.605164 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc657f20-6120-477f-9dec-605234251f15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:09.605597 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc657f20-6120-477f-9dec-605234251f15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:09.606280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc657f20-6120-477f-9dec-605234251f15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:09.606729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc657f20-6120-477f-9dec-605234251f15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:09.607149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc657f20-6120-477f-9dec-605234251f15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:09.640081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bc657f20-6120-477f-9dec-605234251f15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048606 Aug 30 14:48:09.645086 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 338/686] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:09 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:10.554587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ef4f9cee-9390-46b7-a910-f956fd392309 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:10.556791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ef4f9cee-9390-46b7-a910-f956fd392309 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:10.564693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef4f9cee-9390-46b7-a910-f956fd392309 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:10.565184 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef4f9cee-9390-46b7-a910-f956fd392309 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:10.565614 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef4f9cee-9390-46b7-a910-f956fd392309 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:10.566561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef4f9cee-9390-46b7-a910-f956fd392309 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:10.567043 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef4f9cee-9390-46b7-a910-f956fd392309 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:10.567492 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef4f9cee-9390-46b7-a910-f956fd392309 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:10.597961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ef4f9cee-9390-46b7-a910-f956fd392309 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047368 Aug 30 14:48:10.598520 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 349/687] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:10 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:10.652990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c8910ff8-ec09-4be2-9541-2acc3052205e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:10.655099 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c8910ff8-ec09-4be2-9541-2acc3052205e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:10.661502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8910ff8-ec09-4be2-9541-2acc3052205e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:10.661977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8910ff8-ec09-4be2-9541-2acc3052205e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:10.662406 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8910ff8-ec09-4be2-9541-2acc3052205e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:10.663087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8910ff8-ec09-4be2-9541-2acc3052205e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:10.663558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8910ff8-ec09-4be2-9541-2acc3052205e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:10.664001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8910ff8-ec09-4be2-9541-2acc3052205e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:10.692664 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c8910ff8-ec09-4be2-9541-2acc3052205e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044224 Aug 30 14:48:10.693211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 339/688] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:10 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:10.953793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-68fb806c-9b8a-4751-8372-002f66c2efd5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:10.954367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-68fb806c-9b8a-4751-8372-002f66c2efd5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:10.960254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-68fb806c-9b8a-4751-8372-002f66c2efd5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:10.960728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-68fb806c-9b8a-4751-8372-002f66c2efd5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:10.961736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-68fb806c-9b8a-4751-8372-002f66c2efd5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:10.962447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-68fb806c-9b8a-4751-8372-002f66c2efd5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:10.962893 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-68fb806c-9b8a-4751-8372-002f66c2efd5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:10.963332 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-68fb806c-9b8a-4751-8372-002f66c2efd5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:10.985437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-68fb806c-9b8a-4751-8372-002f66c2efd5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a/ips" status: 200 len: 144 microversion: 2.1 time: 0.035542 Aug 30 14:48:10.985991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 350/689] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 14:48:10 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:11.610950 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-39643861-2e1e-44f0-adec-578832d15d1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:11.613125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-39643861-2e1e-44f0-adec-578832d15d1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:11.619978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39643861-2e1e-44f0-adec-578832d15d1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:11.620606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39643861-2e1e-44f0-adec-578832d15d1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:11.621058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39643861-2e1e-44f0-adec-578832d15d1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:11.621763 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39643861-2e1e-44f0-adec-578832d15d1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:11.622218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39643861-2e1e-44f0-adec-578832d15d1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:11.622644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39643861-2e1e-44f0-adec-578832d15d1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:11.627480 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:11.656097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-39643861-2e1e-44f0-adec-578832d15d1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049094 Aug 30 14:48:11.656745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 340/690] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:11 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:11.707715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4eda1628-a510-4dfd-8053-bd935e7f6ed3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:11.709961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4eda1628-a510-4dfd-8053-bd935e7f6ed3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:11.716568 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4eda1628-a510-4dfd-8053-bd935e7f6ed3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:11.717428 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4eda1628-a510-4dfd-8053-bd935e7f6ed3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:11.717938 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4eda1628-a510-4dfd-8053-bd935e7f6ed3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:11.718637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4eda1628-a510-4dfd-8053-bd935e7f6ed3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:11.719085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4eda1628-a510-4dfd-8053-bd935e7f6ed3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:11.719542 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4eda1628-a510-4dfd-8053-bd935e7f6ed3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:11.755755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4eda1628-a510-4dfd-8053-bd935e7f6ed3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054152 Aug 30 14:48:11.756313 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 351/691] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:11 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:12.668419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3333ee5f-e5a4-4a95-ab48-e664380b4a8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:12.670588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3333ee5f-e5a4-4a95-ab48-e664380b4a8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:12.677389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3333ee5f-e5a4-4a95-ab48-e664380b4a8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:12.677657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3333ee5f-e5a4-4a95-ab48-e664380b4a8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:12.678091 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3333ee5f-e5a4-4a95-ab48-e664380b4a8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:12.678815 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3333ee5f-e5a4-4a95-ab48-e664380b4a8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:12.679294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3333ee5f-e5a4-4a95-ab48-e664380b4a8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:12.680362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3333ee5f-e5a4-4a95-ab48-e664380b4a8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:12.711906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3333ee5f-e5a4-4a95-ab48-e664380b4a8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047425 Aug 30 14:48:12.716586 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 341/692] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:12 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:48:12.770145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-496cee16-a736-4c66-988c-0223ea6d5e04 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:12.772291 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-496cee16-a736-4c66-988c-0223ea6d5e04 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:12.778689 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-496cee16-a736-4c66-988c-0223ea6d5e04 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:12.779172 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-496cee16-a736-4c66-988c-0223ea6d5e04 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:12.779642 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-496cee16-a736-4c66-988c-0223ea6d5e04 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:12.780324 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-496cee16-a736-4c66-988c-0223ea6d5e04 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:12.780774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-496cee16-a736-4c66-988c-0223ea6d5e04 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:12.781201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-496cee16-a736-4c66-988c-0223ea6d5e04 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:12.810122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-496cee16-a736-4c66-988c-0223ea6d5e04 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043919 Aug 30 14:48:12.810664 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 352/693] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:12 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:13.724410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-963f09b9-6064-460b-b2f8-e5c46312cf63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:13.727138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-963f09b9-6064-460b-b2f8-e5c46312cf63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:13.733759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-963f09b9-6064-460b-b2f8-e5c46312cf63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:13.734237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-963f09b9-6064-460b-b2f8-e5c46312cf63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:13.734696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-963f09b9-6064-460b-b2f8-e5c46312cf63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:13.735364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-963f09b9-6064-460b-b2f8-e5c46312cf63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:13.735808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-963f09b9-6064-460b-b2f8-e5c46312cf63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:13.736236 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-963f09b9-6064-460b-b2f8-e5c46312cf63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:13.767976 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-963f09b9-6064-460b-b2f8-e5c46312cf63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047513 Aug 30 14:48:13.768711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 342/694] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:13 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:13.823073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-333459c6-fabf-4f52-91f9-d0595c72751f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:13.825236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-333459c6-fabf-4f52-91f9-d0595c72751f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:13.831560 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-333459c6-fabf-4f52-91f9-d0595c72751f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:13.832041 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-333459c6-fabf-4f52-91f9-d0595c72751f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:13.832477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-333459c6-fabf-4f52-91f9-d0595c72751f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:13.833166 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-333459c6-fabf-4f52-91f9-d0595c72751f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:13.833616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-333459c6-fabf-4f52-91f9-d0595c72751f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:13.834038 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-333459c6-fabf-4f52-91f9-d0595c72751f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:13.863345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-333459c6-fabf-4f52-91f9-d0595c72751f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044909 Aug 30 14:48:13.863896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 353/695] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:13 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:14.781011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e99322cb-9796-487a-9cce-c18579c73e45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:14.783184 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e99322cb-9796-487a-9cce-c18579c73e45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:14.790693 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e99322cb-9796-487a-9cce-c18579c73e45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:14.791172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e99322cb-9796-487a-9cce-c18579c73e45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:14.791629 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e99322cb-9796-487a-9cce-c18579c73e45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:14.792320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e99322cb-9796-487a-9cce-c18579c73e45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:14.792769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e99322cb-9796-487a-9cce-c18579c73e45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:14.793179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e99322cb-9796-487a-9cce-c18579c73e45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:14.823667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e99322cb-9796-487a-9cce-c18579c73e45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046544 Aug 30 14:48:14.824417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 343/696] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:14 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:14.875034 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-63ab1ed4-04d9-4c1f-b781-c28ed9373f66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:14.877172 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-63ab1ed4-04d9-4c1f-b781-c28ed9373f66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:14.883006 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63ab1ed4-04d9-4c1f-b781-c28ed9373f66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:14.883511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63ab1ed4-04d9-4c1f-b781-c28ed9373f66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:14.883943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63ab1ed4-04d9-4c1f-b781-c28ed9373f66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:14.884618 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63ab1ed4-04d9-4c1f-b781-c28ed9373f66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:14.885065 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63ab1ed4-04d9-4c1f-b781-c28ed9373f66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:14.885480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63ab1ed4-04d9-4c1f-b781-c28ed9373f66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:14.914154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-63ab1ed4-04d9-4c1f-b781-c28ed9373f66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043076 Aug 30 14:48:14.915628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 354/697] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:14 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:15.834842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1db6b927-6fb4-4312-ab14-ca2c834e638f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:15.837154 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1db6b927-6fb4-4312-ab14-ca2c834e638f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:15.843725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1db6b927-6fb4-4312-ab14-ca2c834e638f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:15.844210 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1db6b927-6fb4-4312-ab14-ca2c834e638f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:15.844649 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1db6b927-6fb4-4312-ab14-ca2c834e638f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:15.845348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1db6b927-6fb4-4312-ab14-ca2c834e638f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:15.845797 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1db6b927-6fb4-4312-ab14-ca2c834e638f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:15.846218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1db6b927-6fb4-4312-ab14-ca2c834e638f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:15.876955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1db6b927-6fb4-4312-ab14-ca2c834e638f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046062 Aug 30 14:48:15.877659 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 344/698] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:15 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:15.927320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f0e028cc-430e-4cd4-8438-f11dcf5879b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:15.929421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f0e028cc-430e-4cd4-8438-f11dcf5879b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:15.936524 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f0e028cc-430e-4cd4-8438-f11dcf5879b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:15.936999 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f0e028cc-430e-4cd4-8438-f11dcf5879b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:15.937425 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f0e028cc-430e-4cd4-8438-f11dcf5879b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:15.938105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f0e028cc-430e-4cd4-8438-f11dcf5879b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:15.938550 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f0e028cc-430e-4cd4-8438-f11dcf5879b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:15.938969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f0e028cc-430e-4cd4-8438-f11dcf5879b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:15.967909 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f0e028cc-430e-4cd4-8438-f11dcf5879b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044510 Aug 30 14:48:15.968456 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 355/699] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:15 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:16.890126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1ea220a9-933f-47a2-a009-1213577bfa88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:16.892326 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1ea220a9-933f-47a2-a009-1213577bfa88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:16.898481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ea220a9-933f-47a2-a009-1213577bfa88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:16.900378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ea220a9-933f-47a2-a009-1213577bfa88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:16.900815 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ea220a9-933f-47a2-a009-1213577bfa88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:16.901502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ea220a9-933f-47a2-a009-1213577bfa88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:16.901944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ea220a9-933f-47a2-a009-1213577bfa88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:16.902358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ea220a9-933f-47a2-a009-1213577bfa88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:16.937617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1ea220a9-933f-47a2-a009-1213577bfa88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051415 Aug 30 14:48:16.938220 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 345/700] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:16 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:16.980749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e0427355-bbe1-4594-af56-1eda1a6e0e86 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:16.982861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e0427355-bbe1-4594-af56-1eda1a6e0e86 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:16.989313 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e0427355-bbe1-4594-af56-1eda1a6e0e86 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:16.989796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e0427355-bbe1-4594-af56-1eda1a6e0e86 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:16.990226 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e0427355-bbe1-4594-af56-1eda1a6e0e86 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:16.990915 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e0427355-bbe1-4594-af56-1eda1a6e0e86 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:16.991392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e0427355-bbe1-4594-af56-1eda1a6e0e86 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:16.991820 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e0427355-bbe1-4594-af56-1eda1a6e0e86 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:17.021034 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e0427355-bbe1-4594-af56-1eda1a6e0e86 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044929 Aug 30 14:48:17.021580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 356/701] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:16 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:17.949980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-48862280-acd3-46fa-a69f-a34549da8b9a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:17.952130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-48862280-acd3-46fa-a69f-a34549da8b9a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:17.958313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48862280-acd3-46fa-a69f-a34549da8b9a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:17.958790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48862280-acd3-46fa-a69f-a34549da8b9a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:17.959239 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48862280-acd3-46fa-a69f-a34549da8b9a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:17.959948 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48862280-acd3-46fa-a69f-a34549da8b9a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:17.960393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48862280-acd3-46fa-a69f-a34549da8b9a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:17.960808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48862280-acd3-46fa-a69f-a34549da8b9a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:17.990971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-48862280-acd3-46fa-a69f-a34549da8b9a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045695 Aug 30 14:48:17.994882 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 346/702] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:17 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:18.033745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5a4a8bc4-11bf-4c05-9f2e-ba8688f7a41b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:18.035878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5a4a8bc4-11bf-4c05-9f2e-ba8688f7a41b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:18.042202 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a4a8bc4-11bf-4c05-9f2e-ba8688f7a41b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:18.042683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a4a8bc4-11bf-4c05-9f2e-ba8688f7a41b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:18.043118 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a4a8bc4-11bf-4c05-9f2e-ba8688f7a41b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:18.043828 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a4a8bc4-11bf-4c05-9f2e-ba8688f7a41b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:18.044274 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a4a8bc4-11bf-4c05-9f2e-ba8688f7a41b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:18.044691 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a4a8bc4-11bf-4c05-9f2e-ba8688f7a41b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:18.075562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5a4a8bc4-11bf-4c05-9f2e-ba8688f7a41b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045751 Aug 30 14:48:18.076115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 357/703] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:18 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:19.003813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1d39c500-96f1-40c8-9554-8a64df871161 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:19.005940 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1d39c500-96f1-40c8-9554-8a64df871161 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:19.012908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d39c500-96f1-40c8-9554-8a64df871161 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:19.013388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d39c500-96f1-40c8-9554-8a64df871161 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:19.013822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d39c500-96f1-40c8-9554-8a64df871161 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:19.014622 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d39c500-96f1-40c8-9554-8a64df871161 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:19.014960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d39c500-96f1-40c8-9554-8a64df871161 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:19.015415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d39c500-96f1-40c8-9554-8a64df871161 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:19.047858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1d39c500-96f1-40c8-9554-8a64df871161 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047992 Aug 30 14:48:19.048671 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 347/704] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:18 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:19.088711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8535a4ad-11b5-44a6-8e3f-cbf85b06797d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:19.090895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8535a4ad-11b5-44a6-8e3f-cbf85b06797d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:19.097270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8535a4ad-11b5-44a6-8e3f-cbf85b06797d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:19.097752 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8535a4ad-11b5-44a6-8e3f-cbf85b06797d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:19.098232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8535a4ad-11b5-44a6-8e3f-cbf85b06797d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:19.098872 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8535a4ad-11b5-44a6-8e3f-cbf85b06797d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:19.099345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8535a4ad-11b5-44a6-8e3f-cbf85b06797d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:19.099763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8535a4ad-11b5-44a6-8e3f-cbf85b06797d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:19.128591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8535a4ad-11b5-44a6-8e3f-cbf85b06797d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044683 Aug 30 14:48:19.129156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 358/705] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:19 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:20.060728 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e6942144-673f-4014-b3e6-1eb56abaa873 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:20.063820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e6942144-673f-4014-b3e6-1eb56abaa873 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:20.070017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6942144-673f-4014-b3e6-1eb56abaa873 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:20.070509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6942144-673f-4014-b3e6-1eb56abaa873 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:20.071678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6942144-673f-4014-b3e6-1eb56abaa873 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:20.072396 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6942144-673f-4014-b3e6-1eb56abaa873 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:20.072842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6942144-673f-4014-b3e6-1eb56abaa873 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:20.073261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6942144-673f-4014-b3e6-1eb56abaa873 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:20.104076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e6942144-673f-4014-b3e6-1eb56abaa873 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047593 Aug 30 14:48:20.104789 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 348/706] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:20 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:20.140750 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8fb8fa8f-32b0-4077-97ae-2290cb007749 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:20.142901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8fb8fa8f-32b0-4077-97ae-2290cb007749 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:20.149271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8fb8fa8f-32b0-4077-97ae-2290cb007749 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:20.149748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8fb8fa8f-32b0-4077-97ae-2290cb007749 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:20.150180 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8fb8fa8f-32b0-4077-97ae-2290cb007749 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:20.150867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8fb8fa8f-32b0-4077-97ae-2290cb007749 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:20.151353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8fb8fa8f-32b0-4077-97ae-2290cb007749 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:20.151778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8fb8fa8f-32b0-4077-97ae-2290cb007749 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:20.181258 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8fb8fa8f-32b0-4077-97ae-2290cb007749 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044391 Aug 30 14:48:20.181851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 359/707] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:20 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:21.116036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e3a9c7da-ef03-4c11-a351-d747a4940c1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:21.118850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e3a9c7da-ef03-4c11-a351-d747a4940c1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:21.125128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3a9c7da-ef03-4c11-a351-d747a4940c1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:21.125606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3a9c7da-ef03-4c11-a351-d747a4940c1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:21.126035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3a9c7da-ef03-4c11-a351-d747a4940c1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:21.126723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3a9c7da-ef03-4c11-a351-d747a4940c1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:21.127166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3a9c7da-ef03-4c11-a351-d747a4940c1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:21.127615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3a9c7da-ef03-4c11-a351-d747a4940c1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:21.158607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e3a9c7da-ef03-4c11-a351-d747a4940c1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046538 Aug 30 14:48:21.159172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 349/708] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:21 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:21.194118 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8ccc6640-a041-44fd-9c9d-0d99b30edcd9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:21.196817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8ccc6640-a041-44fd-9c9d-0d99b30edcd9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:21.203741 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ccc6640-a041-44fd-9c9d-0d99b30edcd9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:21.204219 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ccc6640-a041-44fd-9c9d-0d99b30edcd9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:21.204649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ccc6640-a041-44fd-9c9d-0d99b30edcd9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:21.205339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ccc6640-a041-44fd-9c9d-0d99b30edcd9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:21.205784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ccc6640-a041-44fd-9c9d-0d99b30edcd9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:21.206204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ccc6640-a041-44fd-9c9d-0d99b30edcd9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:21.223519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:21.237114 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8ccc6640-a041-44fd-9c9d-0d99b30edcd9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047222 Aug 30 14:48:21.237666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 360/709] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:21 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:22.170707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-454b8fe2-b62d-4046-bcee-1ced6ee0d57b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:22.172864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-454b8fe2-b62d-4046-bcee-1ced6ee0d57b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:22.179421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-454b8fe2-b62d-4046-bcee-1ced6ee0d57b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:22.180663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-454b8fe2-b62d-4046-bcee-1ced6ee0d57b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:22.181110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-454b8fe2-b62d-4046-bcee-1ced6ee0d57b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:22.181837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-454b8fe2-b62d-4046-bcee-1ced6ee0d57b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:22.182292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-454b8fe2-b62d-4046-bcee-1ced6ee0d57b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:22.182843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-454b8fe2-b62d-4046-bcee-1ced6ee0d57b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:22.225419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-454b8fe2-b62d-4046-bcee-1ced6ee0d57b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058698 Aug 30 14:48:22.225982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 350/710] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:22 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:48:22.249769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cfc5b15b-fde5-418b-b83c-9a043541ec54 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:22.251952 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cfc5b15b-fde5-418b-b83c-9a043541ec54 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:22.258181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cfc5b15b-fde5-418b-b83c-9a043541ec54 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:22.258663 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cfc5b15b-fde5-418b-b83c-9a043541ec54 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:22.259084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cfc5b15b-fde5-418b-b83c-9a043541ec54 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:22.259791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cfc5b15b-fde5-418b-b83c-9a043541ec54 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:22.260238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cfc5b15b-fde5-418b-b83c-9a043541ec54 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:22.260649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cfc5b15b-fde5-418b-b83c-9a043541ec54 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:22.290278 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cfc5b15b-fde5-418b-b83c-9a043541ec54 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043800 Aug 30 14:48:22.290825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 361/711] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:22 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:23.237813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6961974e-983d-4452-b187-acdaeec2ca16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:23.240069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6961974e-983d-4452-b187-acdaeec2ca16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:23.246762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6961974e-983d-4452-b187-acdaeec2ca16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:23.247261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6961974e-983d-4452-b187-acdaeec2ca16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:23.247687 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6961974e-983d-4452-b187-acdaeec2ca16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:23.248381 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6961974e-983d-4452-b187-acdaeec2ca16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:23.248829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6961974e-983d-4452-b187-acdaeec2ca16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:23.249242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6961974e-983d-4452-b187-acdaeec2ca16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:23.279508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6961974e-983d-4452-b187-acdaeec2ca16 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045579 Aug 30 14:48:23.280058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 351/712] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:23 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:23.302093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7b78d5d4-22d5-4ba6-b719-027afa0ea7a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:23.304405 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7b78d5d4-22d5-4ba6-b719-027afa0ea7a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:23.311652 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b78d5d4-22d5-4ba6-b719-027afa0ea7a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:23.312131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b78d5d4-22d5-4ba6-b719-027afa0ea7a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:23.312566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b78d5d4-22d5-4ba6-b719-027afa0ea7a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:23.313273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b78d5d4-22d5-4ba6-b719-027afa0ea7a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:23.313715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b78d5d4-22d5-4ba6-b719-027afa0ea7a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:23.314131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b78d5d4-22d5-4ba6-b719-027afa0ea7a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:23.343249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7b78d5d4-22d5-4ba6-b719-027afa0ea7a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045237 Aug 30 14:48:23.343797 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 362/713] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:23 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:24.291938 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5d7ac1ab-c2cc-4a39-b1a4-959e5bc73052 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:24.294086 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5d7ac1ab-c2cc-4a39-b1a4-959e5bc73052 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:24.300451 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d7ac1ab-c2cc-4a39-b1a4-959e5bc73052 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:24.300926 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d7ac1ab-c2cc-4a39-b1a4-959e5bc73052 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:24.301356 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d7ac1ab-c2cc-4a39-b1a4-959e5bc73052 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:24.302073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d7ac1ab-c2cc-4a39-b1a4-959e5bc73052 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:24.302522 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d7ac1ab-c2cc-4a39-b1a4-959e5bc73052 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:24.302934 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d7ac1ab-c2cc-4a39-b1a4-959e5bc73052 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:24.333122 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5d7ac1ab-c2cc-4a39-b1a4-959e5bc73052 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045684 Aug 30 14:48:24.333677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 352/714] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:24 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:24.356630 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3b318596-a5e1-4420-90cd-fbcfa8f2bee7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:24.358778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3b318596-a5e1-4420-90cd-fbcfa8f2bee7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:24.364650 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b318596-a5e1-4420-90cd-fbcfa8f2bee7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:24.365142 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b318596-a5e1-4420-90cd-fbcfa8f2bee7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:24.365580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b318596-a5e1-4420-90cd-fbcfa8f2bee7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:24.366273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b318596-a5e1-4420-90cd-fbcfa8f2bee7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:24.366726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b318596-a5e1-4420-90cd-fbcfa8f2bee7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:24.367151 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b318596-a5e1-4420-90cd-fbcfa8f2bee7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:24.396266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3b318596-a5e1-4420-90cd-fbcfa8f2bee7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044681 Aug 30 14:48:24.396823 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 363/715] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:24 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:25.345402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7cc038df-8572-4acf-a613-d5e4397a1f99 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:25.347566 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7cc038df-8572-4acf-a613-d5e4397a1f99 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:25.354624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cc038df-8572-4acf-a613-d5e4397a1f99 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:25.355100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cc038df-8572-4acf-a613-d5e4397a1f99 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:25.355616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cc038df-8572-4acf-a613-d5e4397a1f99 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:25.356369 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cc038df-8572-4acf-a613-d5e4397a1f99 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:25.356672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cc038df-8572-4acf-a613-d5e4397a1f99 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:25.357151 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cc038df-8572-4acf-a613-d5e4397a1f99 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:25.386415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7cc038df-8572-4acf-a613-d5e4397a1f99 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044927 Aug 30 14:48:25.386977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 353/716] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:25 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:25.408612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-039beca6-a6d2-4606-91da-eb603a6e355e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:25.410724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-039beca6-a6d2-4606-91da-eb603a6e355e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:25.417665 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-039beca6-a6d2-4606-91da-eb603a6e355e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:25.418146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-039beca6-a6d2-4606-91da-eb603a6e355e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:25.418581 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-039beca6-a6d2-4606-91da-eb603a6e355e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:25.419293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-039beca6-a6d2-4606-91da-eb603a6e355e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:25.419746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-039beca6-a6d2-4606-91da-eb603a6e355e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:25.420168 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-039beca6-a6d2-4606-91da-eb603a6e355e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:25.449385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-039beca6-a6d2-4606-91da-eb603a6e355e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044657 Aug 30 14:48:25.449943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 364/717] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:25 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:26.398006 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-afcfe50d-80ae-4512-9025-f2a090685d6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:26.400271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-afcfe50d-80ae-4512-9025-f2a090685d6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:26.406562 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afcfe50d-80ae-4512-9025-f2a090685d6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:26.407040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afcfe50d-80ae-4512-9025-f2a090685d6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:26.407541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afcfe50d-80ae-4512-9025-f2a090685d6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:26.408179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afcfe50d-80ae-4512-9025-f2a090685d6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:26.408668 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afcfe50d-80ae-4512-9025-f2a090685d6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:26.409046 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afcfe50d-80ae-4512-9025-f2a090685d6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:26.440438 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-afcfe50d-80ae-4512-9025-f2a090685d6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046301 Aug 30 14:48:26.441005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 354/718] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:26 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:26.461552 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-15767524-a5e7-423e-9d3a-2406e4cb27c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:26.463812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-15767524-a5e7-423e-9d3a-2406e4cb27c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:26.470044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-15767524-a5e7-423e-9d3a-2406e4cb27c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:26.470531 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-15767524-a5e7-423e-9d3a-2406e4cb27c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:26.470961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-15767524-a5e7-423e-9d3a-2406e4cb27c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:26.471679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-15767524-a5e7-423e-9d3a-2406e4cb27c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:26.472131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-15767524-a5e7-423e-9d3a-2406e4cb27c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:26.472551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-15767524-a5e7-423e-9d3a-2406e4cb27c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:26.502049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-15767524-a5e7-423e-9d3a-2406e4cb27c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044445 Aug 30 14:48:26.502596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 365/719] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:26 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:27.453120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b19ebf25-5fbe-473c-9889-63e90a911611 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:27.455253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b19ebf25-5fbe-473c-9889-63e90a911611 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:27.470315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b19ebf25-5fbe-473c-9889-63e90a911611 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:27.470873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b19ebf25-5fbe-473c-9889-63e90a911611 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:27.471618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b19ebf25-5fbe-473c-9889-63e90a911611 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:27.472318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b19ebf25-5fbe-473c-9889-63e90a911611 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:27.472766 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b19ebf25-5fbe-473c-9889-63e90a911611 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:27.473186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b19ebf25-5fbe-473c-9889-63e90a911611 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:27.503572 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b19ebf25-5fbe-473c-9889-63e90a911611 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054319 Aug 30 14:48:27.504116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 355/720] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:27 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:27.514530 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f23bf435-1a18-4ccd-8427-4e95fdb15789 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:27.516701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f23bf435-1a18-4ccd-8427-4e95fdb15789 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:27.522994 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f23bf435-1a18-4ccd-8427-4e95fdb15789 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:27.523513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f23bf435-1a18-4ccd-8427-4e95fdb15789 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:27.523945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f23bf435-1a18-4ccd-8427-4e95fdb15789 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:27.524652 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f23bf435-1a18-4ccd-8427-4e95fdb15789 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:27.525224 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f23bf435-1a18-4ccd-8427-4e95fdb15789 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:27.525648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f23bf435-1a18-4ccd-8427-4e95fdb15789 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:27.554394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f23bf435-1a18-4ccd-8427-4e95fdb15789 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043738 Aug 30 14:48:27.554967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 366/721] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:27 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:28.515641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-79eefb30-08e7-43ff-bcfd-734fe7000e92 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:28.517812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-79eefb30-08e7-43ff-bcfd-734fe7000e92 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:28.524223 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79eefb30-08e7-43ff-bcfd-734fe7000e92 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:28.525216 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79eefb30-08e7-43ff-bcfd-734fe7000e92 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:28.525675 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79eefb30-08e7-43ff-bcfd-734fe7000e92 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:28.526364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79eefb30-08e7-43ff-bcfd-734fe7000e92 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:28.526809 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79eefb30-08e7-43ff-bcfd-734fe7000e92 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:28.527270 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79eefb30-08e7-43ff-bcfd-734fe7000e92 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:28.552679 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:28.557976 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-79eefb30-08e7-43ff-bcfd-734fe7000e92 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046303 Aug 30 14:48:28.558531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 356/722] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:28 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:28.566837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-844d77a8-c203-4a61-8a1d-fc44b11b7e64 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:28.569031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-844d77a8-c203-4a61-8a1d-fc44b11b7e64 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:28.576099 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-844d77a8-c203-4a61-8a1d-fc44b11b7e64 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:28.576586 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-844d77a8-c203-4a61-8a1d-fc44b11b7e64 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:28.577023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-844d77a8-c203-4a61-8a1d-fc44b11b7e64 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:28.577716 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-844d77a8-c203-4a61-8a1d-fc44b11b7e64 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:28.578167 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-844d77a8-c203-4a61-8a1d-fc44b11b7e64 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:28.578591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-844d77a8-c203-4a61-8a1d-fc44b11b7e64 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:28.608021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-844d77a8-c203-4a61-8a1d-fc44b11b7e64 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045431 Aug 30 14:48:28.608564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 367/723] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:28 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:29.570087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-98c01d94-babd-471e-b86b-55ef040f75a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:29.572294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-98c01d94-babd-471e-b86b-55ef040f75a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:29.578432 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98c01d94-babd-471e-b86b-55ef040f75a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:29.579013 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98c01d94-babd-471e-b86b-55ef040f75a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:29.579355 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98c01d94-babd-471e-b86b-55ef040f75a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:29.580043 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98c01d94-babd-471e-b86b-55ef040f75a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:29.580488 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98c01d94-babd-471e-b86b-55ef040f75a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:29.580907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98c01d94-babd-471e-b86b-55ef040f75a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:29.610238 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-98c01d94-babd-471e-b86b-55ef040f75a2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044239 Aug 30 14:48:29.610777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 357/724] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:29 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:29.620890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-efb17bab-10ae-4a01-a928-8278e9ec3cb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:29.623011 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-efb17bab-10ae-4a01-a928-8278e9ec3cb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:29.629341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efb17bab-10ae-4a01-a928-8278e9ec3cb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:29.629824 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efb17bab-10ae-4a01-a928-8278e9ec3cb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:29.630259 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efb17bab-10ae-4a01-a928-8278e9ec3cb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:29.630954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efb17bab-10ae-4a01-a928-8278e9ec3cb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:29.631444 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efb17bab-10ae-4a01-a928-8278e9ec3cb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:29.631872 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efb17bab-10ae-4a01-a928-8278e9ec3cb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:29.660549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-efb17bab-10ae-4a01-a928-8278e9ec3cb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044316 Aug 30 14:48:29.661097 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 368/725] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:29 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:30.622823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-175820bc-a32b-40ee-bda7-303628b34bd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:30.625500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-175820bc-a32b-40ee-bda7-303628b34bd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:30.631591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-175820bc-a32b-40ee-bda7-303628b34bd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:30.632076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-175820bc-a32b-40ee-bda7-303628b34bd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:30.632487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-175820bc-a32b-40ee-bda7-303628b34bd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:30.633166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-175820bc-a32b-40ee-bda7-303628b34bd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:30.633608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-175820bc-a32b-40ee-bda7-303628b34bd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:30.635279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-175820bc-a32b-40ee-bda7-303628b34bd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:30.664274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-175820bc-a32b-40ee-bda7-303628b34bd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046353 Aug 30 14:48:30.665031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 358/726] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:30 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:30.672341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ac2c42fd-4fd2-4fed-a546-5183f9a85bd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:30.674437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ac2c42fd-4fd2-4fed-a546-5183f9a85bd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:30.681238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac2c42fd-4fd2-4fed-a546-5183f9a85bd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:30.682229 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac2c42fd-4fd2-4fed-a546-5183f9a85bd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:30.682662 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac2c42fd-4fd2-4fed-a546-5183f9a85bd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:30.683380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac2c42fd-4fd2-4fed-a546-5183f9a85bd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:30.683831 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac2c42fd-4fd2-4fed-a546-5183f9a85bd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:30.684247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac2c42fd-4fd2-4fed-a546-5183f9a85bd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:30.715055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ac2c42fd-4fd2-4fed-a546-5183f9a85bd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046572 Aug 30 14:48:30.715858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 369/727] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:30 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:48:31.677138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ea821f5e-b087-436b-9bed-5bc802c75717 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:31.679349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ea821f5e-b087-436b-9bed-5bc802c75717 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:31.681754 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=52 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:31.686846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea821f5e-b087-436b-9bed-5bc802c75717 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:31.687344 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea821f5e-b087-436b-9bed-5bc802c75717 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:31.687773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea821f5e-b087-436b-9bed-5bc802c75717 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:31.688461 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea821f5e-b087-436b-9bed-5bc802c75717 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:31.688906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea821f5e-b087-436b-9bed-5bc802c75717 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:31.689318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea821f5e-b087-436b-9bed-5bc802c75717 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:31.719987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ea821f5e-b087-436b-9bed-5bc802c75717 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046907 Aug 30 14:48:31.720531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 359/728] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:31 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:31.727326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5cc5c8f9-9af0-473a-ac79-05d445384c0c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:31.729483 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5cc5c8f9-9af0-473a-ac79-05d445384c0c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:31.735769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cc5c8f9-9af0-473a-ac79-05d445384c0c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:31.736240 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cc5c8f9-9af0-473a-ac79-05d445384c0c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:31.736667 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cc5c8f9-9af0-473a-ac79-05d445384c0c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:31.737344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cc5c8f9-9af0-473a-ac79-05d445384c0c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:31.737788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cc5c8f9-9af0-473a-ac79-05d445384c0c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:31.738202 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cc5c8f9-9af0-473a-ac79-05d445384c0c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:31.767054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5cc5c8f9-9af0-473a-ac79-05d445384c0c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043608 Aug 30 14:48:31.767638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 370/729] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:31 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:32.732520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4a8dd0b7-5866-4aca-a835-8d7f91618a2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:32.734685 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4a8dd0b7-5866-4aca-a835-8d7f91618a2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:32.741108 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a8dd0b7-5866-4aca-a835-8d7f91618a2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:32.741594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a8dd0b7-5866-4aca-a835-8d7f91618a2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:32.742028 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a8dd0b7-5866-4aca-a835-8d7f91618a2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:32.742721 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a8dd0b7-5866-4aca-a835-8d7f91618a2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:32.743227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a8dd0b7-5866-4aca-a835-8d7f91618a2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:32.743683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a8dd0b7-5866-4aca-a835-8d7f91618a2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:32.772399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4a8dd0b7-5866-4aca-a835-8d7f91618a2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Aug 30 14:48:32.772989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 360/730] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:32 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:32.780035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9f1d06c2-82a5-428c-b3a5-c31171ac0da9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:32.782130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9f1d06c2-82a5-428c-b3a5-c31171ac0da9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:32.784463 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=54 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:32.789844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9f1d06c2-82a5-428c-b3a5-c31171ac0da9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:32.791012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9f1d06c2-82a5-428c-b3a5-c31171ac0da9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:32.791471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9f1d06c2-82a5-428c-b3a5-c31171ac0da9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:32.792161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9f1d06c2-82a5-428c-b3a5-c31171ac0da9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:32.792639 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9f1d06c2-82a5-428c-b3a5-c31171ac0da9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:32.793058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9f1d06c2-82a5-428c-b3a5-c31171ac0da9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:32.822471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9f1d06c2-82a5-428c-b3a5-c31171ac0da9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046436 Aug 30 14:48:32.823017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 371/731] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:32 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:33.787663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-88bfb238-6d64-4941-a5ac-2637afbd05d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:33.790103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-88bfb238-6d64-4941-a5ac-2637afbd05d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:33.797082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88bfb238-6d64-4941-a5ac-2637afbd05d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:33.797560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88bfb238-6d64-4941-a5ac-2637afbd05d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:33.797990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88bfb238-6d64-4941-a5ac-2637afbd05d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:33.798833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88bfb238-6d64-4941-a5ac-2637afbd05d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:33.799305 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88bfb238-6d64-4941-a5ac-2637afbd05d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:33.799722 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88bfb238-6d64-4941-a5ac-2637afbd05d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:33.831798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-88bfb238-6d64-4941-a5ac-2637afbd05d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050176 Aug 30 14:48:33.832356 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 361/732] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:33 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:33.833986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6a2e3e6a-f820-4227-b304-d682492cf541 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:33.836124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6a2e3e6a-f820-4227-b304-d682492cf541 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:33.843729 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a2e3e6a-f820-4227-b304-d682492cf541 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:33.844362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a2e3e6a-f820-4227-b304-d682492cf541 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:33.850286 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a2e3e6a-f820-4227-b304-d682492cf541 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:33.851166 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a2e3e6a-f820-4227-b304-d682492cf541 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:33.851653 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a2e3e6a-f820-4227-b304-d682492cf541 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:33.852084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a2e3e6a-f820-4227-b304-d682492cf541 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:33.883253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6a2e3e6a-f820-4227-b304-d682492cf541 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053063 Aug 30 14:48:33.883968 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 372/733] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:33 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:48:34.844552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3e65a110-4708-4e67-8c09-ba0e22af6cf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:34.846711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3e65a110-4708-4e67-8c09-ba0e22af6cf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:34.853198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e65a110-4708-4e67-8c09-ba0e22af6cf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:34.853702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e65a110-4708-4e67-8c09-ba0e22af6cf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:34.854128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e65a110-4708-4e67-8c09-ba0e22af6cf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:34.855157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e65a110-4708-4e67-8c09-ba0e22af6cf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:34.855275 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e65a110-4708-4e67-8c09-ba0e22af6cf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:34.855678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e65a110-4708-4e67-8c09-ba0e22af6cf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:34.885373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3e65a110-4708-4e67-8c09-ba0e22af6cf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044953 Aug 30 14:48:34.885930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 362/734] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:34 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:48:34.894817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fd6aa245-86e5-4ba8-bce6-45c279ecb7c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:34.896998 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fd6aa245-86e5-4ba8-bce6-45c279ecb7c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:34.904078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd6aa245-86e5-4ba8-bce6-45c279ecb7c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:34.904563 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd6aa245-86e5-4ba8-bce6-45c279ecb7c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:34.904995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd6aa245-86e5-4ba8-bce6-45c279ecb7c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:34.905687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd6aa245-86e5-4ba8-bce6-45c279ecb7c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:34.906140 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd6aa245-86e5-4ba8-bce6-45c279ecb7c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:34.906566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd6aa245-86e5-4ba8-bce6-45c279ecb7c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:34.934839 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fd6aa245-86e5-4ba8-bce6-45c279ecb7c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043998 Aug 30 14:48:34.935395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 373/735] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:34 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:35.897250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c9aa915a-2f31-4733-a874-ff6cafb03695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:35.900106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c9aa915a-2f31-4733-a874-ff6cafb03695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:35.906725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9aa915a-2f31-4733-a874-ff6cafb03695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:35.907201 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9aa915a-2f31-4733-a874-ff6cafb03695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:35.907661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9aa915a-2f31-4733-a874-ff6cafb03695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:35.908342 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9aa915a-2f31-4733-a874-ff6cafb03695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:35.908783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9aa915a-2f31-4733-a874-ff6cafb03695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:35.909199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9aa915a-2f31-4733-a874-ff6cafb03695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:35.939020 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c9aa915a-2f31-4733-a874-ff6cafb03695 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045817 Aug 30 14:48:35.939593 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 363/736] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:35 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:35.947131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-73800f4c-e069-4439-82bc-34395c33490f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:35.949273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-73800f4c-e069-4439-82bc-34395c33490f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:35.955631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73800f4c-e069-4439-82bc-34395c33490f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:35.956111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73800f4c-e069-4439-82bc-34395c33490f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:35.956546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73800f4c-e069-4439-82bc-34395c33490f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:35.957228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73800f4c-e069-4439-82bc-34395c33490f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:35.957676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73800f4c-e069-4439-82bc-34395c33490f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:35.958096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73800f4c-e069-4439-82bc-34395c33490f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:35.988285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-73800f4c-e069-4439-82bc-34395c33490f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045126 Aug 30 14:48:35.988841 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 374/737] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:35 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:36.950723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-81eaf06e-7736-4672-b850-5f91a8005827 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:36.952903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-81eaf06e-7736-4672-b850-5f91a8005827 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:36.959341 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81eaf06e-7736-4672-b850-5f91a8005827 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:36.959820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81eaf06e-7736-4672-b850-5f91a8005827 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:36.960249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81eaf06e-7736-4672-b850-5f91a8005827 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:36.960935 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81eaf06e-7736-4672-b850-5f91a8005827 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:36.961380 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81eaf06e-7736-4672-b850-5f91a8005827 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:36.961915 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81eaf06e-7736-4672-b850-5f91a8005827 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:36.991058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-81eaf06e-7736-4672-b850-5f91a8005827 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044221 Aug 30 14:48:36.991649 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 364/738] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:36 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:37.000502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-dbafedd8-b934-4583-bc70-3369e823e17c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:37.002686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-dbafedd8-b934-4583-bc70-3369e823e17c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:37.009262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dbafedd8-b934-4583-bc70-3369e823e17c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:37.009738 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dbafedd8-b934-4583-bc70-3369e823e17c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:37.010198 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dbafedd8-b934-4583-bc70-3369e823e17c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:37.010894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dbafedd8-b934-4583-bc70-3369e823e17c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:37.011377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dbafedd8-b934-4583-bc70-3369e823e17c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:37.011803 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dbafedd8-b934-4583-bc70-3369e823e17c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:37.040701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-dbafedd8-b934-4583-bc70-3369e823e17c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043616 Aug 30 14:48:37.041251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 375/739] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:36 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:38.003922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-77026cb5-6f58-4f50-975a-f315ee382c8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:38.006093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-77026cb5-6f58-4f50-975a-f315ee382c8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:38.013201 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77026cb5-6f58-4f50-975a-f315ee382c8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:38.013705 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77026cb5-6f58-4f50-975a-f315ee382c8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:38.014123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77026cb5-6f58-4f50-975a-f315ee382c8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:38.014816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77026cb5-6f58-4f50-975a-f315ee382c8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:38.015362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77026cb5-6f58-4f50-975a-f315ee382c8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:38.015794 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77026cb5-6f58-4f50-975a-f315ee382c8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:38.044757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-77026cb5-6f58-4f50-975a-f315ee382c8b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044778 Aug 30 14:48:38.045309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 365/740] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:37 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:38.052577 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c5f05d30-88c5-46da-88cf-607a630004e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:38.054754 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c5f05d30-88c5-46da-88cf-607a630004e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:38.061830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5f05d30-88c5-46da-88cf-607a630004e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:38.062311 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5f05d30-88c5-46da-88cf-607a630004e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:38.062744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5f05d30-88c5-46da-88cf-607a630004e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:38.063461 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5f05d30-88c5-46da-88cf-607a630004e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:38.063918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5f05d30-88c5-46da-88cf-607a630004e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:38.064368 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5f05d30-88c5-46da-88cf-607a630004e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:38.093459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c5f05d30-88c5-46da-88cf-607a630004e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044877 Aug 30 14:48:38.094006 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 376/741] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:38 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:39.056782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-33a82bbe-307e-4e3d-ad54-8c282def2b48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:39.059076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-33a82bbe-307e-4e3d-ad54-8c282def2b48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:39.065444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33a82bbe-307e-4e3d-ad54-8c282def2b48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:39.065925 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33a82bbe-307e-4e3d-ad54-8c282def2b48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:39.066626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33a82bbe-307e-4e3d-ad54-8c282def2b48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:39.067501 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33a82bbe-307e-4e3d-ad54-8c282def2b48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:39.068015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33a82bbe-307e-4e3d-ad54-8c282def2b48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:39.068441 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33a82bbe-307e-4e3d-ad54-8c282def2b48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:39.098889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-33a82bbe-307e-4e3d-ad54-8c282def2b48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046098 Aug 30 14:48:39.099498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 366/742] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:39 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:39.105990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fb49c869-4ec7-41f3-ab9d-b95b113d5907 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:39.108224 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fb49c869-4ec7-41f3-ab9d-b95b113d5907 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:39.114487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb49c869-4ec7-41f3-ab9d-b95b113d5907 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:39.114973 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb49c869-4ec7-41f3-ab9d-b95b113d5907 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:39.115443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb49c869-4ec7-41f3-ab9d-b95b113d5907 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:39.116137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb49c869-4ec7-41f3-ab9d-b95b113d5907 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:39.116617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb49c869-4ec7-41f3-ab9d-b95b113d5907 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:39.117040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb49c869-4ec7-41f3-ab9d-b95b113d5907 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:39.120972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:39.146660 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fb49c869-4ec7-41f3-ab9d-b95b113d5907 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044932 Aug 30 14:48:39.147223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 377/743] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:39 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:40.110907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bf20dc3d-1591-456b-9ac2-e2de1064f928 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:40.113056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bf20dc3d-1591-456b-9ac2-e2de1064f928 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:40.120051 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf20dc3d-1591-456b-9ac2-e2de1064f928 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:40.120555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf20dc3d-1591-456b-9ac2-e2de1064f928 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:40.120988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf20dc3d-1591-456b-9ac2-e2de1064f928 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:40.121667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf20dc3d-1591-456b-9ac2-e2de1064f928 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:40.122114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf20dc3d-1591-456b-9ac2-e2de1064f928 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:40.122531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf20dc3d-1591-456b-9ac2-e2de1064f928 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:40.151192 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bf20dc3d-1591-456b-9ac2-e2de1064f928 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044159 Aug 30 14:48:40.151752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 367/744] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:40 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:40.159516 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e425d255-d0d5-4d0a-b5e0-c906a10ece6f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:40.161613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e425d255-d0d5-4d0a-b5e0-c906a10ece6f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:40.169150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e425d255-d0d5-4d0a-b5e0-c906a10ece6f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:40.169626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e425d255-d0d5-4d0a-b5e0-c906a10ece6f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:40.170049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e425d255-d0d5-4d0a-b5e0-c906a10ece6f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:40.170725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e425d255-d0d5-4d0a-b5e0-c906a10ece6f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:40.171166 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e425d255-d0d5-4d0a-b5e0-c906a10ece6f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:40.171608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e425d255-d0d5-4d0a-b5e0-c906a10ece6f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:40.200999 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e425d255-d0d5-4d0a-b5e0-c906a10ece6f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045474 Aug 30 14:48:40.201544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 378/745] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:40 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:41.163231 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0c35f145-c189-4e47-bceb-c60e1c1f7acb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:41.165423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0c35f145-c189-4e47-bceb-c60e1c1f7acb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:41.171691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c35f145-c189-4e47-bceb-c60e1c1f7acb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:41.172171 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c35f145-c189-4e47-bceb-c60e1c1f7acb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:41.172607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c35f145-c189-4e47-bceb-c60e1c1f7acb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:41.173289 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c35f145-c189-4e47-bceb-c60e1c1f7acb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:41.173739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c35f145-c189-4e47-bceb-c60e1c1f7acb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:41.174160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c35f145-c189-4e47-bceb-c60e1c1f7acb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:41.204465 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0c35f145-c189-4e47-bceb-c60e1c1f7acb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045051 Aug 30 14:48:41.205301 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 368/746] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:41 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:41.213496 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0a92fdb2-4976-4f36-88c7-a5dcaf1f8534 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:41.215654 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0a92fdb2-4976-4f36-88c7-a5dcaf1f8534 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:41.222048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a92fdb2-4976-4f36-88c7-a5dcaf1f8534 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:41.222536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a92fdb2-4976-4f36-88c7-a5dcaf1f8534 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:41.222974 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a92fdb2-4976-4f36-88c7-a5dcaf1f8534 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:41.223708 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a92fdb2-4976-4f36-88c7-a5dcaf1f8534 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:41.224159 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a92fdb2-4976-4f36-88c7-a5dcaf1f8534 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:41.224585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a92fdb2-4976-4f36-88c7-a5dcaf1f8534 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:41.253961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0a92fdb2-4976-4f36-88c7-a5dcaf1f8534 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044566 Aug 30 14:48:41.254537 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 379/747] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:41 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:42.217910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8d6720ca-f825-4625-9947-3b1ba138b8f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:42.220168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8d6720ca-f825-4625-9947-3b1ba138b8f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:42.226536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d6720ca-f825-4625-9947-3b1ba138b8f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.227012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d6720ca-f825-4625-9947-3b1ba138b8f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.227498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d6720ca-f825-4625-9947-3b1ba138b8f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.228191 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d6720ca-f825-4625-9947-3b1ba138b8f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.228645 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d6720ca-f825-4625-9947-3b1ba138b8f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.229070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d6720ca-f825-4625-9947-3b1ba138b8f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.257922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8d6720ca-f825-4625-9947-3b1ba138b8f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044007 Aug 30 14:48:42.259031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 369/748] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:42 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:42.267748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3a8b8146-19bc-4d4c-bf35-491cba471d83 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:42.269909 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3a8b8146-19bc-4d4c-bf35-491cba471d83 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:42.276832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a8b8146-19bc-4d4c-bf35-491cba471d83 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.277319 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a8b8146-19bc-4d4c-bf35-491cba471d83 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.277758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a8b8146-19bc-4d4c-bf35-491cba471d83 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.278450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a8b8146-19bc-4d4c-bf35-491cba471d83 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:42.278904 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a8b8146-19bc-4d4c-bf35-491cba471d83 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:42.279356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a8b8146-19bc-4d4c-bf35-491cba471d83 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:42.308850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3a8b8146-19bc-4d4c-bf35-491cba471d83 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045141 Aug 30 14:48:42.309406 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 380/749] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:42 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:43.270163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f5982c02-31c1-4b65-a8ef-ca881cd04a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:43.272357 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f5982c02-31c1-4b65-a8ef-ca881cd04a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:43.279185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5982c02-31c1-4b65-a8ef-ca881cd04a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:43.279691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5982c02-31c1-4b65-a8ef-ca881cd04a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:43.280127 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5982c02-31c1-4b65-a8ef-ca881cd04a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:43.280783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5982c02-31c1-4b65-a8ef-ca881cd04a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:43.281224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5982c02-31c1-4b65-a8ef-ca881cd04a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:43.281635 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5982c02-31c1-4b65-a8ef-ca881cd04a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:43.314953 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f5982c02-31c1-4b65-a8ef-ca881cd04a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048648 Aug 30 14:48:43.315546 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 370/750] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:43 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:43.321562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-648e0a13-27fe-4dc9-ae42-6fd13132edd6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:43.323735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-648e0a13-27fe-4dc9-ae42-6fd13132edd6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:43.329973 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-648e0a13-27fe-4dc9-ae42-6fd13132edd6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:43.330449 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-648e0a13-27fe-4dc9-ae42-6fd13132edd6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:43.330886 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-648e0a13-27fe-4dc9-ae42-6fd13132edd6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:43.331706 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-648e0a13-27fe-4dc9-ae42-6fd13132edd6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:43.332151 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-648e0a13-27fe-4dc9-ae42-6fd13132edd6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:43.332566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-648e0a13-27fe-4dc9-ae42-6fd13132edd6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:43.363159 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-648e0a13-27fe-4dc9-ae42-6fd13132edd6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045835 Aug 30 14:48:43.363744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 381/751] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:43 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:44.327909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-00298162-f7a2-436c-be7d-200501ff69b9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:44.330074 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-00298162-f7a2-436c-be7d-200501ff69b9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:44.336673 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00298162-f7a2-436c-be7d-200501ff69b9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:44.337251 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00298162-f7a2-436c-be7d-200501ff69b9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:44.337682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00298162-f7a2-436c-be7d-200501ff69b9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:44.338363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00298162-f7a2-436c-be7d-200501ff69b9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:44.338826 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00298162-f7a2-436c-be7d-200501ff69b9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:44.339283 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00298162-f7a2-436c-be7d-200501ff69b9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:44.369320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-00298162-f7a2-436c-be7d-200501ff69b9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045129 Aug 30 14:48:44.369875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 371/752] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:44 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:44.375620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f55c82ad-c16f-498e-8244-4e0150d4ffbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:44.377743 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f55c82ad-c16f-498e-8244-4e0150d4ffbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:44.384288 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f55c82ad-c16f-498e-8244-4e0150d4ffbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:44.384767 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f55c82ad-c16f-498e-8244-4e0150d4ffbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:44.385198 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f55c82ad-c16f-498e-8244-4e0150d4ffbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:44.385882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f55c82ad-c16f-498e-8244-4e0150d4ffbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:44.386329 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f55c82ad-c16f-498e-8244-4e0150d4ffbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:44.386748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f55c82ad-c16f-498e-8244-4e0150d4ffbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:44.415935 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f55c82ad-c16f-498e-8244-4e0150d4ffbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044335 Aug 30 14:48:44.416486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 382/753] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:44 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:45.381347 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6a9931f2-707b-45d5-856b-09f1426ae2b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:45.383558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6a9931f2-707b-45d5-856b-09f1426ae2b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:45.390331 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9931f2-707b-45d5-856b-09f1426ae2b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:45.390803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9931f2-707b-45d5-856b-09f1426ae2b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:45.391252 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9931f2-707b-45d5-856b-09f1426ae2b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:45.391925 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9931f2-707b-45d5-856b-09f1426ae2b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:45.392368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9931f2-707b-45d5-856b-09f1426ae2b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:45.392778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9931f2-707b-45d5-856b-09f1426ae2b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:45.421643 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6a9931f2-707b-45d5-856b-09f1426ae2b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 Aug 30 14:48:45.422194 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 372/754] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:45 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:45.428719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1f917e54-0d0b-4903-aa50-2c9dfd3967b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:45.431436 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1f917e54-0d0b-4903-aa50-2c9dfd3967b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:45.437437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f917e54-0d0b-4903-aa50-2c9dfd3967b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:45.437919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f917e54-0d0b-4903-aa50-2c9dfd3967b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:45.438360 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f917e54-0d0b-4903-aa50-2c9dfd3967b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:45.439050 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f917e54-0d0b-4903-aa50-2c9dfd3967b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:45.439537 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f917e54-0d0b-4903-aa50-2c9dfd3967b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:45.439959 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f917e54-0d0b-4903-aa50-2c9dfd3967b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:45.470315 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1f917e54-0d0b-4903-aa50-2c9dfd3967b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045951 Aug 30 14:48:45.470884 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 383/755] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:45 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:46.434140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5c99bec6-eafa-4522-93d1-81dd28fc8465 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:46.436341 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5c99bec6-eafa-4522-93d1-81dd28fc8465 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:46.442901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c99bec6-eafa-4522-93d1-81dd28fc8465 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:46.443423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c99bec6-eafa-4522-93d1-81dd28fc8465 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:46.443857 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c99bec6-eafa-4522-93d1-81dd28fc8465 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:46.444542 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c99bec6-eafa-4522-93d1-81dd28fc8465 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:46.444989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c99bec6-eafa-4522-93d1-81dd28fc8465 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:46.445410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c99bec6-eafa-4522-93d1-81dd28fc8465 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:46.461512 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:46.475227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5c99bec6-eafa-4522-93d1-81dd28fc8465 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045174 Aug 30 14:48:46.475969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 373/756] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:46 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:46.482488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a270d2db-d1b9-47e8-bca3-e5c4782ef387 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:46.484629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a270d2db-d1b9-47e8-bca3-e5c4782ef387 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:46.490916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a270d2db-d1b9-47e8-bca3-e5c4782ef387 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:46.491436 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a270d2db-d1b9-47e8-bca3-e5c4782ef387 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:46.491867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a270d2db-d1b9-47e8-bca3-e5c4782ef387 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:46.492547 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a270d2db-d1b9-47e8-bca3-e5c4782ef387 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:46.492993 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a270d2db-d1b9-47e8-bca3-e5c4782ef387 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:46.493416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a270d2db-d1b9-47e8-bca3-e5c4782ef387 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:46.522065 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a270d2db-d1b9-47e8-bca3-e5c4782ef387 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044071 Aug 30 14:48:46.522610 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 384/757] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:46 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:47.487801 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3e9ae338-53f0-45dd-b017-3fc3033cf494 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:47.489992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3e9ae338-53f0-45dd-b017-3fc3033cf494 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:47.497062 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e9ae338-53f0-45dd-b017-3fc3033cf494 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:47.497535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e9ae338-53f0-45dd-b017-3fc3033cf494 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:47.497965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e9ae338-53f0-45dd-b017-3fc3033cf494 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:47.498646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e9ae338-53f0-45dd-b017-3fc3033cf494 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:47.499091 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e9ae338-53f0-45dd-b017-3fc3033cf494 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:47.499540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e9ae338-53f0-45dd-b017-3fc3033cf494 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:47.528093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3e9ae338-53f0-45dd-b017-3fc3033cf494 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044192 Aug 30 14:48:47.528650 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 374/758] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:47 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:47.534751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c5a8c1d3-7d8c-4a46-9f82-f9850b28b551 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:47.536911 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c5a8c1d3-7d8c-4a46-9f82-f9850b28b551 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:47.543936 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5a8c1d3-7d8c-4a46-9f82-f9850b28b551 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:47.544421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5a8c1d3-7d8c-4a46-9f82-f9850b28b551 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:47.544862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5a8c1d3-7d8c-4a46-9f82-f9850b28b551 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:47.545557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5a8c1d3-7d8c-4a46-9f82-f9850b28b551 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:47.546007 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5a8c1d3-7d8c-4a46-9f82-f9850b28b551 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:47.546439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c5a8c1d3-7d8c-4a46-9f82-f9850b28b551 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:47.576130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c5a8c1d3-7d8c-4a46-9f82-f9850b28b551 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045408 Aug 30 14:48:47.576682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 385/759] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:47 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:48.540156 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-69b44ccc-fff3-43da-b9b8-522fbb0ddae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:48.542461 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-69b44ccc-fff3-43da-b9b8-522fbb0ddae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:48.548810 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69b44ccc-fff3-43da-b9b8-522fbb0ddae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:48.549290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69b44ccc-fff3-43da-b9b8-522fbb0ddae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:48.549725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69b44ccc-fff3-43da-b9b8-522fbb0ddae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:48.550411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69b44ccc-fff3-43da-b9b8-522fbb0ddae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:48.550860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69b44ccc-fff3-43da-b9b8-522fbb0ddae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:48.551310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69b44ccc-fff3-43da-b9b8-522fbb0ddae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:48.581152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-69b44ccc-fff3-43da-b9b8-522fbb0ddae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044993 Aug 30 14:48:48.581702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 375/760] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:48 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:48.589320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b29714ab-73a0-45a9-a44c-16dc424fed41 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:48.591472 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b29714ab-73a0-45a9-a44c-16dc424fed41 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:48.597867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b29714ab-73a0-45a9-a44c-16dc424fed41 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:48.598351 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b29714ab-73a0-45a9-a44c-16dc424fed41 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:48.598790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b29714ab-73a0-45a9-a44c-16dc424fed41 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:48.599540 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b29714ab-73a0-45a9-a44c-16dc424fed41 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:48.599991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b29714ab-73a0-45a9-a44c-16dc424fed41 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:48.600414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b29714ab-73a0-45a9-a44c-16dc424fed41 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:48.629599 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b29714ab-73a0-45a9-a44c-16dc424fed41 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044400 Aug 30 14:48:48.630159 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 386/761] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:48 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:49.593640 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-aafc9bfb-0da2-4393-a587-ba03d134b9fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:49.595765 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-aafc9bfb-0da2-4393-a587-ba03d134b9fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:49.602032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aafc9bfb-0da2-4393-a587-ba03d134b9fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:49.602499 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aafc9bfb-0da2-4393-a587-ba03d134b9fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:49.602925 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aafc9bfb-0da2-4393-a587-ba03d134b9fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:49.603629 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aafc9bfb-0da2-4393-a587-ba03d134b9fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:49.604070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aafc9bfb-0da2-4393-a587-ba03d134b9fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:49.604481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aafc9bfb-0da2-4393-a587-ba03d134b9fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:49.632793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-aafc9bfb-0da2-4393-a587-ba03d134b9fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042995 Aug 30 14:48:49.633366 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 376/762] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:49 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:49.643101 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b9f2a35c-41c7-41e3-8fe0-691e517ff342 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:49.645449 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b9f2a35c-41c7-41e3-8fe0-691e517ff342 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:49.652621 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b9f2a35c-41c7-41e3-8fe0-691e517ff342 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:49.653098 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b9f2a35c-41c7-41e3-8fe0-691e517ff342 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:49.653530 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b9f2a35c-41c7-41e3-8fe0-691e517ff342 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:49.654211 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b9f2a35c-41c7-41e3-8fe0-691e517ff342 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:49.654655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b9f2a35c-41c7-41e3-8fe0-691e517ff342 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:49.655071 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b9f2a35c-41c7-41e3-8fe0-691e517ff342 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:49.684344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b9f2a35c-41c7-41e3-8fe0-691e517ff342 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045162 Aug 30 14:48:49.684897 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 387/763] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:49 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:50.645153 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-02740d46-c6cc-48af-847c-4f5f733d2cb0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:50.647195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-02740d46-c6cc-48af-847c-4f5f733d2cb0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:50.653323 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02740d46-c6cc-48af-847c-4f5f733d2cb0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:50.653798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02740d46-c6cc-48af-847c-4f5f733d2cb0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:50.654229 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02740d46-c6cc-48af-847c-4f5f733d2cb0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:50.654908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02740d46-c6cc-48af-847c-4f5f733d2cb0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:50.655390 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02740d46-c6cc-48af-847c-4f5f733d2cb0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:50.655810 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02740d46-c6cc-48af-847c-4f5f733d2cb0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:50.685205 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-02740d46-c6cc-48af-847c-4f5f733d2cb0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044105 Aug 30 14:48:50.685746 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 377/764] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:50 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:50.696695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f3dfc0ce-c0ca-4806-9849-4a0b3f26abb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:50.698829 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f3dfc0ce-c0ca-4806-9849-4a0b3f26abb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:50.705128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3dfc0ce-c0ca-4806-9849-4a0b3f26abb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:50.705612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3dfc0ce-c0ca-4806-9849-4a0b3f26abb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:50.706042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3dfc0ce-c0ca-4806-9849-4a0b3f26abb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:50.706727 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3dfc0ce-c0ca-4806-9849-4a0b3f26abb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:50.707173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3dfc0ce-c0ca-4806-9849-4a0b3f26abb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:50.707620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3dfc0ce-c0ca-4806-9849-4a0b3f26abb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:50.737329 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f3dfc0ce-c0ca-4806-9849-4a0b3f26abb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044564 Aug 30 14:48:50.737875 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 388/765] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:50 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:51.698328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e534ecf7-2379-480a-83e3-ada412ac8316 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:51.700499 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e534ecf7-2379-480a-83e3-ada412ac8316 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:51.706777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e534ecf7-2379-480a-83e3-ada412ac8316 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:51.707292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e534ecf7-2379-480a-83e3-ada412ac8316 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:51.707729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e534ecf7-2379-480a-83e3-ada412ac8316 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:51.708417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e534ecf7-2379-480a-83e3-ada412ac8316 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:51.708869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e534ecf7-2379-480a-83e3-ada412ac8316 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:51.709294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e534ecf7-2379-480a-83e3-ada412ac8316 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:51.738657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e534ecf7-2379-480a-83e3-ada412ac8316 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Aug 30 14:48:51.739234 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 378/766] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:51 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:51.750655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-48694191-bf49-4826-81d5-5f170fcc1367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:51.752803 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-48694191-bf49-4826-81d5-5f170fcc1367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:51.759772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-48694191-bf49-4826-81d5-5f170fcc1367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:51.760358 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-48694191-bf49-4826-81d5-5f170fcc1367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:51.760791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-48694191-bf49-4826-81d5-5f170fcc1367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:51.761483 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-48694191-bf49-4826-81d5-5f170fcc1367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:51.761932 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-48694191-bf49-4826-81d5-5f170fcc1367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:51.762356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-48694191-bf49-4826-81d5-5f170fcc1367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:51.797816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-48694191-bf49-4826-81d5-5f170fcc1367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051003 Aug 30 14:48:51.798380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 389/767] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:51 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:52.749902 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9e0fbfb4-955f-4e46-b93a-675f31dc2bb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:52.752031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9e0fbfb4-955f-4e46-b93a-675f31dc2bb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:52.758228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e0fbfb4-955f-4e46-b93a-675f31dc2bb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:52.758699 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e0fbfb4-955f-4e46-b93a-675f31dc2bb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:52.759752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e0fbfb4-955f-4e46-b93a-675f31dc2bb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:52.760435 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e0fbfb4-955f-4e46-b93a-675f31dc2bb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:52.760908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e0fbfb4-955f-4e46-b93a-675f31dc2bb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:52.761320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e0fbfb4-955f-4e46-b93a-675f31dc2bb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:52.789951 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9e0fbfb4-955f-4e46-b93a-675f31dc2bb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043923 Aug 30 14:48:52.790870 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 379/768] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:52 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:52.810145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8a04e32c-9be8-48ed-91b4-8692b1261156 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:52.812273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8a04e32c-9be8-48ed-91b4-8692b1261156 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:52.819103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a04e32c-9be8-48ed-91b4-8692b1261156 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:52.819622 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a04e32c-9be8-48ed-91b4-8692b1261156 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:52.820562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a04e32c-9be8-48ed-91b4-8692b1261156 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:52.820877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a04e32c-9be8-48ed-91b4-8692b1261156 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:52.822091 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a04e32c-9be8-48ed-91b4-8692b1261156 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:52.822569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a04e32c-9be8-48ed-91b4-8692b1261156 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:52.852432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8a04e32c-9be8-48ed-91b4-8692b1261156 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046411 Aug 30 14:48:52.853179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 390/769] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:52 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:48:53.801879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4d213797-3900-4c1c-b01f-99f5891262df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:53.804043 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4d213797-3900-4c1c-b01f-99f5891262df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:53.810295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d213797-3900-4c1c-b01f-99f5891262df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:53.810770 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d213797-3900-4c1c-b01f-99f5891262df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:53.811198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d213797-3900-4c1c-b01f-99f5891262df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:53.811895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d213797-3900-4c1c-b01f-99f5891262df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:53.812339 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d213797-3900-4c1c-b01f-99f5891262df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:53.812757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d213797-3900-4c1c-b01f-99f5891262df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:53.842145 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4d213797-3900-4c1c-b01f-99f5891262df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044208 Aug 30 14:48:53.842690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 380/770] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:53 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:53.864793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-91d3b820-0148-4687-85dd-76d885a3d097 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:53.866896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-91d3b820-0148-4687-85dd-76d885a3d097 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:53.873595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-91d3b820-0148-4687-85dd-76d885a3d097 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:53.874079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-91d3b820-0148-4687-85dd-76d885a3d097 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:53.874687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-91d3b820-0148-4687-85dd-76d885a3d097 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:53.875422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-91d3b820-0148-4687-85dd-76d885a3d097 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:53.875878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-91d3b820-0148-4687-85dd-76d885a3d097 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:53.876299 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-91d3b820-0148-4687-85dd-76d885a3d097 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:53.906397 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-91d3b820-0148-4687-85dd-76d885a3d097 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045491 Aug 30 14:48:53.906956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 391/771] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:53 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:54.854976 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-eadbb81c-c01d-47ba-8382-60bb5902c147 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:54.857129 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-eadbb81c-c01d-47ba-8382-60bb5902c147 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:54.863482 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eadbb81c-c01d-47ba-8382-60bb5902c147 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:54.864288 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eadbb81c-c01d-47ba-8382-60bb5902c147 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:54.864397 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eadbb81c-c01d-47ba-8382-60bb5902c147 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:54.865027 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eadbb81c-c01d-47ba-8382-60bb5902c147 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:54.865471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eadbb81c-c01d-47ba-8382-60bb5902c147 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:54.865886 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eadbb81c-c01d-47ba-8382-60bb5902c147 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:54.895190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-eadbb81c-c01d-47ba-8382-60bb5902c147 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045054 Aug 30 14:48:54.895757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 381/772] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:54 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:54.918837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-719544f7-7bd6-46ca-b77f-fb7cbe260773 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:54.920926 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-719544f7-7bd6-46ca-b77f-fb7cbe260773 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:54.927234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-719544f7-7bd6-46ca-b77f-fb7cbe260773 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:54.927733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-719544f7-7bd6-46ca-b77f-fb7cbe260773 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:54.928211 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-719544f7-7bd6-46ca-b77f-fb7cbe260773 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:54.928894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-719544f7-7bd6-46ca-b77f-fb7cbe260773 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:54.929341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-719544f7-7bd6-46ca-b77f-fb7cbe260773 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:54.929759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-719544f7-7bd6-46ca-b77f-fb7cbe260773 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:54.958757 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-719544f7-7bd6-46ca-b77f-fb7cbe260773 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044542 Aug 30 14:48:54.959325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 392/773] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:54 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:55.907329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f49c26b7-d83b-4ba2-82e0-ac5c6643e555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:55.909448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f49c26b7-d83b-4ba2-82e0-ac5c6643e555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:55.915819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f49c26b7-d83b-4ba2-82e0-ac5c6643e555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:55.916296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f49c26b7-d83b-4ba2-82e0-ac5c6643e555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:55.916727 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f49c26b7-d83b-4ba2-82e0-ac5c6643e555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:55.917406 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f49c26b7-d83b-4ba2-82e0-ac5c6643e555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:55.917852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f49c26b7-d83b-4ba2-82e0-ac5c6643e555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:55.918269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f49c26b7-d83b-4ba2-82e0-ac5c6643e555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:55.948384 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f49c26b7-d83b-4ba2-82e0-ac5c6643e555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044979 Aug 30 14:48:55.948936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 382/774] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:55 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:55.971573 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2569cf62-4d20-434a-a7ef-c9ed2ce8fe3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:55.973694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2569cf62-4d20-434a-a7ef-c9ed2ce8fe3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:55.980070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2569cf62-4d20-434a-a7ef-c9ed2ce8fe3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:55.980549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2569cf62-4d20-434a-a7ef-c9ed2ce8fe3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:55.980982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2569cf62-4d20-434a-a7ef-c9ed2ce8fe3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:55.981672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2569cf62-4d20-434a-a7ef-c9ed2ce8fe3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:55.982124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2569cf62-4d20-434a-a7ef-c9ed2ce8fe3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:55.982546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2569cf62-4d20-434a-a7ef-c9ed2ce8fe3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:56.007850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:48:56.013808 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2569cf62-4d20-434a-a7ef-c9ed2ce8fe3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046319 Aug 30 14:48:56.014370 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 393/775] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:55 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:56.960458 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-85c5ae2b-e533-4688-98a5-c4953f456bc9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:56.963101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-85c5ae2b-e533-4688-98a5-c4953f456bc9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:56.969371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85c5ae2b-e533-4688-98a5-c4953f456bc9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:56.969844 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85c5ae2b-e533-4688-98a5-c4953f456bc9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:56.970269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85c5ae2b-e533-4688-98a5-c4953f456bc9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:56.970946 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85c5ae2b-e533-4688-98a5-c4953f456bc9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:56.971422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85c5ae2b-e533-4688-98a5-c4953f456bc9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:56.971838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85c5ae2b-e533-4688-98a5-c4953f456bc9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:57.000338 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-85c5ae2b-e533-4688-98a5-c4953f456bc9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043845 Aug 30 14:48:57.000877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 383/776] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:56 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:57.026679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5bc2f282-7861-49bd-8694-224ee2c8870d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:57.028890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5bc2f282-7861-49bd-8694-224ee2c8870d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:57.035342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bc2f282-7861-49bd-8694-224ee2c8870d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:57.035822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bc2f282-7861-49bd-8694-224ee2c8870d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:57.036257 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bc2f282-7861-49bd-8694-224ee2c8870d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:57.036942 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bc2f282-7861-49bd-8694-224ee2c8870d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:57.037391 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bc2f282-7861-49bd-8694-224ee2c8870d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:57.037811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bc2f282-7861-49bd-8694-224ee2c8870d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:57.067112 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5bc2f282-7861-49bd-8694-224ee2c8870d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045012 Aug 30 14:48:57.067695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 394/777] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:57 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:58.012493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b1bd8909-87e9-4f7b-af5f-c8c109f39bff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:58.014619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b1bd8909-87e9-4f7b-af5f-c8c109f39bff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:58.021034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1bd8909-87e9-4f7b-af5f-c8c109f39bff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:58.021519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1bd8909-87e9-4f7b-af5f-c8c109f39bff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:58.021954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1bd8909-87e9-4f7b-af5f-c8c109f39bff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:58.022643 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1bd8909-87e9-4f7b-af5f-c8c109f39bff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:58.023096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1bd8909-87e9-4f7b-af5f-c8c109f39bff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:58.023546 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1bd8909-87e9-4f7b-af5f-c8c109f39bff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:58.052574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b1bd8909-87e9-4f7b-af5f-c8c109f39bff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044184 Aug 30 14:48:58.053123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 384/778] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:58 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:58.080264 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-64b3c600-1957-4ca2-9e97-948a679c09c9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:58.082393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-64b3c600-1957-4ca2-9e97-948a679c09c9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:58.088775 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64b3c600-1957-4ca2-9e97-948a679c09c9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:58.089262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64b3c600-1957-4ca2-9e97-948a679c09c9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:58.089704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64b3c600-1957-4ca2-9e97-948a679c09c9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:58.090395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64b3c600-1957-4ca2-9e97-948a679c09c9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:58.090850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64b3c600-1957-4ca2-9e97-948a679c09c9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:58.091303 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64b3c600-1957-4ca2-9e97-948a679c09c9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:58.120985 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-64b3c600-1957-4ca2-9e97-948a679c09c9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044623 Aug 30 14:48:58.121550 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 395/779] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:58 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:48:59.064837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-514fab2e-010e-46c1-9174-5ff4b23a1024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:59.067342 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-514fab2e-010e-46c1-9174-5ff4b23a1024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:59.074324 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-514fab2e-010e-46c1-9174-5ff4b23a1024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:59.074803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-514fab2e-010e-46c1-9174-5ff4b23a1024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:59.075267 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-514fab2e-010e-46c1-9174-5ff4b23a1024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:59.075957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-514fab2e-010e-46c1-9174-5ff4b23a1024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:59.076426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-514fab2e-010e-46c1-9174-5ff4b23a1024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:59.076831 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-514fab2e-010e-46c1-9174-5ff4b23a1024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:59.105229 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-514fab2e-010e-46c1-9174-5ff4b23a1024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044283 Aug 30 14:48:59.105785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 385/780] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:48:59 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:48:59.133252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-850e10a9-2cd3-4f07-a981-a1757ef6825d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:48:59.136357 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-850e10a9-2cd3-4f07-a981-a1757ef6825d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:48:59.142663 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-850e10a9-2cd3-4f07-a981-a1757ef6825d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:59.143134 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-850e10a9-2cd3-4f07-a981-a1757ef6825d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:59.143591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-850e10a9-2cd3-4f07-a981-a1757ef6825d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:59.144268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-850e10a9-2cd3-4f07-a981-a1757ef6825d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:48:59.144714 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-850e10a9-2cd3-4f07-a981-a1757ef6825d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:48:59.145129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-850e10a9-2cd3-4f07-a981-a1757ef6825d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:48:59.173837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-850e10a9-2cd3-4f07-a981-a1757ef6825d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044644 Aug 30 14:48:59.174377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 396/781] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:48:59 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:00.117098 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dfa29f85-862d-4841-96d0-b72c51379095 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:00.119303 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dfa29f85-862d-4841-96d0-b72c51379095 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:00.125731 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dfa29f85-862d-4841-96d0-b72c51379095 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:00.126215 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dfa29f85-862d-4841-96d0-b72c51379095 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:00.126647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dfa29f85-862d-4841-96d0-b72c51379095 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:00.127400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dfa29f85-862d-4841-96d0-b72c51379095 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:00.127848 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dfa29f85-862d-4841-96d0-b72c51379095 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:00.128270 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dfa29f85-862d-4841-96d0-b72c51379095 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:00.157691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dfa29f85-862d-4841-96d0-b72c51379095 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044510 Aug 30 14:49:00.158239 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 386/782] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:00 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:00.186008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f7e8216b-71ff-470d-9ac4-69bea3244509 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:00.188140 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f7e8216b-71ff-470d-9ac4-69bea3244509 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:00.194682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7e8216b-71ff-470d-9ac4-69bea3244509 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:00.195155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7e8216b-71ff-470d-9ac4-69bea3244509 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:00.195625 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7e8216b-71ff-470d-9ac4-69bea3244509 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:00.196868 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7e8216b-71ff-470d-9ac4-69bea3244509 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:00.197312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7e8216b-71ff-470d-9ac4-69bea3244509 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:00.197729 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7e8216b-71ff-470d-9ac4-69bea3244509 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:00.226850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f7e8216b-71ff-470d-9ac4-69bea3244509 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044773 Aug 30 14:49:00.227428 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 397/783] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:00 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:01.170304 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7327fb95-7cf0-4a32-a36c-56f92ee2082f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:01.172565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7327fb95-7cf0-4a32-a36c-56f92ee2082f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:01.178809 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7327fb95-7cf0-4a32-a36c-56f92ee2082f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:01.179335 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7327fb95-7cf0-4a32-a36c-56f92ee2082f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:01.179752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7327fb95-7cf0-4a32-a36c-56f92ee2082f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:01.181228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7327fb95-7cf0-4a32-a36c-56f92ee2082f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:01.181778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7327fb95-7cf0-4a32-a36c-56f92ee2082f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:01.182200 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7327fb95-7cf0-4a32-a36c-56f92ee2082f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:01.210711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7327fb95-7cf0-4a32-a36c-56f92ee2082f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044273 Aug 30 14:49:01.211291 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 387/784] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:01 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:49:01.238422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b2dcebd9-8d4a-4954-a712-5c7704499347 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:01.240609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b2dcebd9-8d4a-4954-a712-5c7704499347 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:01.247307 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2dcebd9-8d4a-4954-a712-5c7704499347 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:01.247794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2dcebd9-8d4a-4954-a712-5c7704499347 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:01.248233 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2dcebd9-8d4a-4954-a712-5c7704499347 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:01.248979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2dcebd9-8d4a-4954-a712-5c7704499347 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:01.249453 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2dcebd9-8d4a-4954-a712-5c7704499347 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:01.249864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2dcebd9-8d4a-4954-a712-5c7704499347 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:01.279871 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b2dcebd9-8d4a-4954-a712-5c7704499347 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045385 Aug 30 14:49:01.280444 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 398/785] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:01 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:02.223337 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cc31b08a-9fb5-4f3c-baf2-6c3b6d896b3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:02.225542 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cc31b08a-9fb5-4f3c-baf2-6c3b6d896b3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:02.228136 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=58 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:02.233219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc31b08a-9fb5-4f3c-baf2-6c3b6d896b3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:02.233702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc31b08a-9fb5-4f3c-baf2-6c3b6d896b3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:02.234138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc31b08a-9fb5-4f3c-baf2-6c3b6d896b3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:02.234816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc31b08a-9fb5-4f3c-baf2-6c3b6d896b3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:02.235299 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc31b08a-9fb5-4f3c-baf2-6c3b6d896b3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:02.235719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc31b08a-9fb5-4f3c-baf2-6c3b6d896b3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:02.265644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cc31b08a-9fb5-4f3c-baf2-6c3b6d896b3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046245 Aug 30 14:49:02.266195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 388/786] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:02 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:02.292443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b3251eaa-c5d2-403f-a57c-2dba13534f1d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:02.294577 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b3251eaa-c5d2-403f-a57c-2dba13534f1d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:02.300921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3251eaa-c5d2-403f-a57c-2dba13534f1d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:02.301393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3251eaa-c5d2-403f-a57c-2dba13534f1d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:02.301819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3251eaa-c5d2-403f-a57c-2dba13534f1d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:02.302491 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3251eaa-c5d2-403f-a57c-2dba13534f1d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:02.302931 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3251eaa-c5d2-403f-a57c-2dba13534f1d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:02.303376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3251eaa-c5d2-403f-a57c-2dba13534f1d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:02.333192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b3251eaa-c5d2-403f-a57c-2dba13534f1d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045047 Aug 30 14:49:02.333743 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 399/787] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:02 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:03.278248 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bf05950c-1cb8-464d-8a89-c21c06202266 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:03.280428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bf05950c-1cb8-464d-8a89-c21c06202266 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:03.286686 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf05950c-1cb8-464d-8a89-c21c06202266 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:03.287162 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf05950c-1cb8-464d-8a89-c21c06202266 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:03.287627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf05950c-1cb8-464d-8a89-c21c06202266 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:03.288306 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf05950c-1cb8-464d-8a89-c21c06202266 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:03.288783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf05950c-1cb8-464d-8a89-c21c06202266 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:03.289209 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf05950c-1cb8-464d-8a89-c21c06202266 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:03.317694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bf05950c-1cb8-464d-8a89-c21c06202266 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043974 Aug 30 14:49:03.318233 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 389/788] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:03 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:03.345426 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6881853c-bcc2-4adb-890c-f95833bca64b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:03.347622 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6881853c-bcc2-4adb-890c-f95833bca64b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:03.349900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=58 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:03.355089 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6881853c-bcc2-4adb-890c-f95833bca64b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:03.355607 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6881853c-bcc2-4adb-890c-f95833bca64b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:03.356046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6881853c-bcc2-4adb-890c-f95833bca64b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:03.356742 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6881853c-bcc2-4adb-890c-f95833bca64b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:03.357196 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6881853c-bcc2-4adb-890c-f95833bca64b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:03.357623 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6881853c-bcc2-4adb-890c-f95833bca64b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:03.387156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6881853c-bcc2-4adb-890c-f95833bca64b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045704 Aug 30 14:49:03.387740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 400/789] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:03 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:04.330159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ae6db143-7018-4592-9be8-6ff7a693bae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:04.332372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ae6db143-7018-4592-9be8-6ff7a693bae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:04.339233 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae6db143-7018-4592-9be8-6ff7a693bae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:04.339721 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae6db143-7018-4592-9be8-6ff7a693bae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:04.340151 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae6db143-7018-4592-9be8-6ff7a693bae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:04.340829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae6db143-7018-4592-9be8-6ff7a693bae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:04.341277 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae6db143-7018-4592-9be8-6ff7a693bae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:04.341693 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae6db143-7018-4592-9be8-6ff7a693bae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:04.345303 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:04.371932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ae6db143-7018-4592-9be8-6ff7a693bae6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045735 Aug 30 14:49:04.372495 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 390/790] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:04 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:04.400400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5cdb3bcd-dc40-44d9-9b52-3aa92d11ca55 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:04.402507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5cdb3bcd-dc40-44d9-9b52-3aa92d11ca55 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:04.408954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cdb3bcd-dc40-44d9-9b52-3aa92d11ca55 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:04.409433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cdb3bcd-dc40-44d9-9b52-3aa92d11ca55 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:04.409864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cdb3bcd-dc40-44d9-9b52-3aa92d11ca55 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:04.410548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cdb3bcd-dc40-44d9-9b52-3aa92d11ca55 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:04.410992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cdb3bcd-dc40-44d9-9b52-3aa92d11ca55 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:04.411440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cdb3bcd-dc40-44d9-9b52-3aa92d11ca55 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:04.441868 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5cdb3bcd-dc40-44d9-9b52-3aa92d11ca55 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046446 Aug 30 14:49:04.442421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 401/791] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:04 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:05.384299 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4141b752-85bf-4641-98cf-8dd662552566 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:05.386491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4141b752-85bf-4641-98cf-8dd662552566 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:05.392797 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4141b752-85bf-4641-98cf-8dd662552566 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:05.393274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4141b752-85bf-4641-98cf-8dd662552566 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:05.393732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4141b752-85bf-4641-98cf-8dd662552566 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:05.394411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4141b752-85bf-4641-98cf-8dd662552566 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:05.394856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4141b752-85bf-4641-98cf-8dd662552566 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:05.395308 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4141b752-85bf-4641-98cf-8dd662552566 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:05.423962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4141b752-85bf-4641-98cf-8dd662552566 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043745 Aug 30 14:49:05.424490 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 391/792] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:05 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:05.454677 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cc6d1058-7163-42cc-b630-f5a7cfa399bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:05.456857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cc6d1058-7163-42cc-b630-f5a7cfa399bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:05.463512 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc6d1058-7163-42cc-b630-f5a7cfa399bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:05.463937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc6d1058-7163-42cc-b630-f5a7cfa399bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:05.464369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc6d1058-7163-42cc-b630-f5a7cfa399bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:05.465252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc6d1058-7163-42cc-b630-f5a7cfa399bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:05.465715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc6d1058-7163-42cc-b630-f5a7cfa399bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:05.466147 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc6d1058-7163-42cc-b630-f5a7cfa399bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:05.499427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cc6d1058-7163-42cc-b630-f5a7cfa399bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048692 Aug 30 14:49:05.499987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 402/793] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:05 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:06.436465 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-423cfbf4-2325-4ee5-92e5-a581fe056ab2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:06.438567 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-423cfbf4-2325-4ee5-92e5-a581fe056ab2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:06.445139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-423cfbf4-2325-4ee5-92e5-a581fe056ab2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:06.445613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-423cfbf4-2325-4ee5-92e5-a581fe056ab2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:06.446709 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-423cfbf4-2325-4ee5-92e5-a581fe056ab2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:06.447418 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-423cfbf4-2325-4ee5-92e5-a581fe056ab2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:06.447860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-423cfbf4-2325-4ee5-92e5-a581fe056ab2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:06.448274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-423cfbf4-2325-4ee5-92e5-a581fe056ab2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:06.476736 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-423cfbf4-2325-4ee5-92e5-a581fe056ab2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044186 Aug 30 14:49:06.477212 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 392/794] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:06 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:06.512350 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a1c511d0-1888-410a-a9de-355abb351174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:06.514557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a1c511d0-1888-410a-a9de-355abb351174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:06.520835 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a1c511d0-1888-410a-a9de-355abb351174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:06.521316 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a1c511d0-1888-410a-a9de-355abb351174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:06.521750 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a1c511d0-1888-410a-a9de-355abb351174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:06.522437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a1c511d0-1888-410a-a9de-355abb351174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:06.522887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a1c511d0-1888-410a-a9de-355abb351174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:06.523335 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a1c511d0-1888-410a-a9de-355abb351174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:06.552103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a1c511d0-1888-410a-a9de-355abb351174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044457 Aug 30 14:49:06.552652 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 403/795] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:06 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:07.488670 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c8756e9a-fee1-42f7-927d-e195b15622eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:07.490714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c8756e9a-fee1-42f7-927d-e195b15622eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:07.497206 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8756e9a-fee1-42f7-927d-e195b15622eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:07.497683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8756e9a-fee1-42f7-927d-e195b15622eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:07.498113 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8756e9a-fee1-42f7-927d-e195b15622eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:07.498793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8756e9a-fee1-42f7-927d-e195b15622eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:07.499261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8756e9a-fee1-42f7-927d-e195b15622eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:07.499686 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8756e9a-fee1-42f7-927d-e195b15622eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:07.528647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c8756e9a-fee1-42f7-927d-e195b15622eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043919 Aug 30 14:49:07.529192 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 393/796] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:07 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:07.564863 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0b594f55-ffe3-46af-b3ac-a5d30565a06c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:07.567244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0b594f55-ffe3-46af-b3ac-a5d30565a06c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:07.574585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b594f55-ffe3-46af-b3ac-a5d30565a06c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:07.575053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b594f55-ffe3-46af-b3ac-a5d30565a06c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:07.575504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b594f55-ffe3-46af-b3ac-a5d30565a06c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:07.576181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b594f55-ffe3-46af-b3ac-a5d30565a06c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:07.576622 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b594f55-ffe3-46af-b3ac-a5d30565a06c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:07.577033 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b594f55-ffe3-46af-b3ac-a5d30565a06c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:07.606571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0b594f55-ffe3-46af-b3ac-a5d30565a06c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045719 Aug 30 14:49:07.607127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 404/797] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:07 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:08.541167 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8cf6cb8f-a7b8-4410-903d-e61bf87383b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:08.543310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8cf6cb8f-a7b8-4410-903d-e61bf87383b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:08.549680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cf6cb8f-a7b8-4410-903d-e61bf87383b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:08.550159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cf6cb8f-a7b8-4410-903d-e61bf87383b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:08.550587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cf6cb8f-a7b8-4410-903d-e61bf87383b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:08.551300 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cf6cb8f-a7b8-4410-903d-e61bf87383b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:08.551749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cf6cb8f-a7b8-4410-903d-e61bf87383b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:08.552167 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cf6cb8f-a7b8-4410-903d-e61bf87383b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:08.582079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8cf6cb8f-a7b8-4410-903d-e61bf87383b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045384 Aug 30 14:49:08.582642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 394/798] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:08 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:08.619521 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-83256aa8-0ef1-4f7b-ad19-4634c085a181 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:08.621630 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-83256aa8-0ef1-4f7b-ad19-4634c085a181 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:08.627918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83256aa8-0ef1-4f7b-ad19-4634c085a181 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:08.628402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83256aa8-0ef1-4f7b-ad19-4634c085a181 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:08.628835 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83256aa8-0ef1-4f7b-ad19-4634c085a181 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:08.629519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83256aa8-0ef1-4f7b-ad19-4634c085a181 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:08.629967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83256aa8-0ef1-4f7b-ad19-4634c085a181 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:08.630388 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83256aa8-0ef1-4f7b-ad19-4634c085a181 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:08.659229 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-83256aa8-0ef1-4f7b-ad19-4634c085a181 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044489 Aug 30 14:49:08.659940 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 405/799] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:08 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:09.593981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-efa088b9-4f10-43ba-8b26-f7ace845b4ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:09.596169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-efa088b9-4f10-43ba-8b26-f7ace845b4ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:09.603189 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efa088b9-4f10-43ba-8b26-f7ace845b4ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:09.603699 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efa088b9-4f10-43ba-8b26-f7ace845b4ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:09.604134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efa088b9-4f10-43ba-8b26-f7ace845b4ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:09.604816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efa088b9-4f10-43ba-8b26-f7ace845b4ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:09.605268 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efa088b9-4f10-43ba-8b26-f7ace845b4ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:09.605693 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efa088b9-4f10-43ba-8b26-f7ace845b4ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:09.634135 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-efa088b9-4f10-43ba-8b26-f7ace845b4ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044031 Aug 30 14:49:09.634674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 395/800] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:09 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:09.671856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3b245362-c9e7-430d-9877-70dccbf70eda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:09.673976 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3b245362-c9e7-430d-9877-70dccbf70eda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:09.680666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b245362-c9e7-430d-9877-70dccbf70eda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:09.681258 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b245362-c9e7-430d-9877-70dccbf70eda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:09.681702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b245362-c9e7-430d-9877-70dccbf70eda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:09.682398 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b245362-c9e7-430d-9877-70dccbf70eda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:09.682852 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b245362-c9e7-430d-9877-70dccbf70eda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:09.683306 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b245362-c9e7-430d-9877-70dccbf70eda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:09.712901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3b245362-c9e7-430d-9877-70dccbf70eda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044990 Aug 30 14:49:09.713447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 406/801] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:09 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:10.646056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d84ea3b0-cbb4-421f-a9fd-756119b191e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:10.648223 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d84ea3b0-cbb4-421f-a9fd-756119b191e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:10.655022 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d84ea3b0-cbb4-421f-a9fd-756119b191e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:10.655541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d84ea3b0-cbb4-421f-a9fd-756119b191e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:10.655975 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d84ea3b0-cbb4-421f-a9fd-756119b191e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:10.656658 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d84ea3b0-cbb4-421f-a9fd-756119b191e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:10.657104 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d84ea3b0-cbb4-421f-a9fd-756119b191e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:10.657520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d84ea3b0-cbb4-421f-a9fd-756119b191e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:10.685840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d84ea3b0-cbb4-421f-a9fd-756119b191e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043921 Aug 30 14:49:10.686390 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 396/802] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:10 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:10.725094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2524db6c-69a1-4a44-89a2-c260e9265f98 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:10.727541 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2524db6c-69a1-4a44-89a2-c260e9265f98 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:10.733845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2524db6c-69a1-4a44-89a2-c260e9265f98 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:10.734320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2524db6c-69a1-4a44-89a2-c260e9265f98 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:10.734745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2524db6c-69a1-4a44-89a2-c260e9265f98 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:10.735453 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2524db6c-69a1-4a44-89a2-c260e9265f98 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:10.735898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2524db6c-69a1-4a44-89a2-c260e9265f98 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:10.736311 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2524db6c-69a1-4a44-89a2-c260e9265f98 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:10.765715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2524db6c-69a1-4a44-89a2-c260e9265f98 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044540 Aug 30 14:49:10.766256 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 407/803] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:10 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:11.698786 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-590beeb4-8674-45c0-8980-617d4f24380d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:11.701005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-590beeb4-8674-45c0-8980-617d4f24380d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:11.707286 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-590beeb4-8674-45c0-8980-617d4f24380d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:11.707762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-590beeb4-8674-45c0-8980-617d4f24380d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:11.708190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-590beeb4-8674-45c0-8980-617d4f24380d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:11.708868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-590beeb4-8674-45c0-8980-617d4f24380d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:11.709311 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-590beeb4-8674-45c0-8980-617d4f24380d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:11.709725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-590beeb4-8674-45c0-8980-617d4f24380d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:11.740359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-590beeb4-8674-45c0-8980-617d4f24380d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046332 Aug 30 14:49:11.740914 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 397/804] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:11 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:11.778392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6807c76b-ca15-42c7-ba57-0d63695172d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:11.780548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6807c76b-ca15-42c7-ba57-0d63695172d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:11.786920 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6807c76b-ca15-42c7-ba57-0d63695172d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:11.787530 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6807c76b-ca15-42c7-ba57-0d63695172d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:11.787960 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6807c76b-ca15-42c7-ba57-0d63695172d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:11.788639 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6807c76b-ca15-42c7-ba57-0d63695172d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:11.789085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6807c76b-ca15-42c7-ba57-0d63695172d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:11.790216 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6807c76b-ca15-42c7-ba57-0d63695172d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:11.819464 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6807c76b-ca15-42c7-ba57-0d63695172d2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045782 Aug 30 14:49:11.820013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 408/805] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:11 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:12.752353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8c6ce85d-074a-4ce0-9346-a92d0e95ed65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:12.754461 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8c6ce85d-074a-4ce0-9346-a92d0e95ed65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:12.760813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c6ce85d-074a-4ce0-9346-a92d0e95ed65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:12.761294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c6ce85d-074a-4ce0-9346-a92d0e95ed65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:12.761730 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c6ce85d-074a-4ce0-9346-a92d0e95ed65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:12.762417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c6ce85d-074a-4ce0-9346-a92d0e95ed65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:12.762869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c6ce85d-074a-4ce0-9346-a92d0e95ed65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:12.763391 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c6ce85d-074a-4ce0-9346-a92d0e95ed65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:12.792771 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8c6ce85d-074a-4ce0-9346-a92d0e95ed65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044334 Aug 30 14:49:12.793328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 398/806] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:12 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:12.831854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8eb5eb45-c818-4b7c-a1de-12aba187b574 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:12.833988 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8eb5eb45-c818-4b7c-a1de-12aba187b574 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:12.840502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8eb5eb45-c818-4b7c-a1de-12aba187b574 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:12.840981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8eb5eb45-c818-4b7c-a1de-12aba187b574 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:12.841414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8eb5eb45-c818-4b7c-a1de-12aba187b574 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:12.842098 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8eb5eb45-c818-4b7c-a1de-12aba187b574 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:12.842546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8eb5eb45-c818-4b7c-a1de-12aba187b574 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:12.842965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8eb5eb45-c818-4b7c-a1de-12aba187b574 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:12.872895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8eb5eb45-c818-4b7c-a1de-12aba187b574 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044948 Aug 30 14:49:12.873653 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 409/807] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:12 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:13.805674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-985d9ed3-36b6-4014-94ea-f05ce5b2adee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:13.807861 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-985d9ed3-36b6-4014-94ea-f05ce5b2adee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:13.815059 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-985d9ed3-36b6-4014-94ea-f05ce5b2adee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:13.815571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-985d9ed3-36b6-4014-94ea-f05ce5b2adee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:13.816004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-985d9ed3-36b6-4014-94ea-f05ce5b2adee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:13.816950 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-985d9ed3-36b6-4014-94ea-f05ce5b2adee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:13.817428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-985d9ed3-36b6-4014-94ea-f05ce5b2adee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:13.817855 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-985d9ed3-36b6-4014-94ea-f05ce5b2adee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:13.857404 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-985d9ed3-36b6-4014-94ea-f05ce5b2adee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055949 Aug 30 14:49:13.857980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 399/808] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:13 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:13.886177 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fc3e76b4-c040-408d-80b3-46f76b818f3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:13.888365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fc3e76b4-c040-408d-80b3-46f76b818f3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:13.895783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc3e76b4-c040-408d-80b3-46f76b818f3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:13.896234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc3e76b4-c040-408d-80b3-46f76b818f3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:13.896688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc3e76b4-c040-408d-80b3-46f76b818f3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:13.897631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc3e76b4-c040-408d-80b3-46f76b818f3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:13.898082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc3e76b4-c040-408d-80b3-46f76b818f3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:13.898507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fc3e76b4-c040-408d-80b3-46f76b818f3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:13.916945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:13.932356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fc3e76b4-c040-408d-80b3-46f76b818f3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050874 Aug 30 14:49:13.933063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 410/809] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:13 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:14.869303 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5d0de372-fae3-4a74-95c2-d0c2448c8e9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:14.871495 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5d0de372-fae3-4a74-95c2-d0c2448c8e9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:14.877906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d0de372-fae3-4a74-95c2-d0c2448c8e9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:14.878405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d0de372-fae3-4a74-95c2-d0c2448c8e9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:14.878917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d0de372-fae3-4a74-95c2-d0c2448c8e9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:14.879529 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d0de372-fae3-4a74-95c2-d0c2448c8e9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:14.879972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d0de372-fae3-4a74-95c2-d0c2448c8e9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:14.880387 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d0de372-fae3-4a74-95c2-d0c2448c8e9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:14.909120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5d0de372-fae3-4a74-95c2-d0c2448c8e9c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 Aug 30 14:49:14.909668 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 400/810] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:14 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:14.946523 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-24bf4fa0-ad3a-4ce2-9f81-854f62873fbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:14.948707 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-24bf4fa0-ad3a-4ce2-9f81-854f62873fbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:14.954684 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24bf4fa0-ad3a-4ce2-9f81-854f62873fbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:14.955164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24bf4fa0-ad3a-4ce2-9f81-854f62873fbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:14.955621 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24bf4fa0-ad3a-4ce2-9f81-854f62873fbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:14.956302 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24bf4fa0-ad3a-4ce2-9f81-854f62873fbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:14.956745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24bf4fa0-ad3a-4ce2-9f81-854f62873fbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:14.957162 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24bf4fa0-ad3a-4ce2-9f81-854f62873fbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:14.985796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-24bf4fa0-ad3a-4ce2-9f81-854f62873fbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044456 Aug 30 14:49:14.986473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 411/811] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:14 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:15.921607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3d6f476b-98cc-416d-bb23-a935f78758f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:15.923766 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3d6f476b-98cc-416d-bb23-a935f78758f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:15.930095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d6f476b-98cc-416d-bb23-a935f78758f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:15.930574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d6f476b-98cc-416d-bb23-a935f78758f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:15.931009 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d6f476b-98cc-416d-bb23-a935f78758f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:15.931723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d6f476b-98cc-416d-bb23-a935f78758f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:15.932175 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d6f476b-98cc-416d-bb23-a935f78758f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:15.932596 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d6f476b-98cc-416d-bb23-a935f78758f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:15.963555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3d6f476b-98cc-416d-bb23-a935f78758f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045871 Aug 30 14:49:15.964114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 401/812] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:15 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:15.998544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f2b05100-fd9e-4923-b92b-418ce8922066 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:16.000748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f2b05100-fd9e-4923-b92b-418ce8922066 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:16.007071 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2b05100-fd9e-4923-b92b-418ce8922066 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:16.007584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2b05100-fd9e-4923-b92b-418ce8922066 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:16.008582 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2b05100-fd9e-4923-b92b-418ce8922066 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:16.009451 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2b05100-fd9e-4923-b92b-418ce8922066 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:16.009908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2b05100-fd9e-4923-b92b-418ce8922066 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:16.010332 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2b05100-fd9e-4923-b92b-418ce8922066 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:16.039321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f2b05100-fd9e-4923-b92b-418ce8922066 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044647 Aug 30 14:49:16.039870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 412/813] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:15 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:16.975875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e9f5e6d0-89ab-40ac-8eab-1621e6725914 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:16.978825 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e9f5e6d0-89ab-40ac-8eab-1621e6725914 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:16.985218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9f5e6d0-89ab-40ac-8eab-1621e6725914 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:16.985696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9f5e6d0-89ab-40ac-8eab-1621e6725914 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:16.986126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9f5e6d0-89ab-40ac-8eab-1621e6725914 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:16.986805 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9f5e6d0-89ab-40ac-8eab-1621e6725914 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:16.987285 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9f5e6d0-89ab-40ac-8eab-1621e6725914 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:16.987701 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9f5e6d0-89ab-40ac-8eab-1621e6725914 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:17.017184 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e9f5e6d0-89ab-40ac-8eab-1621e6725914 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Aug 30 14:49:17.017725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 402/814] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:16 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:17.051511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5ba6188c-1ae5-4b44-8d03-df07b8ceedc9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:17.053608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5ba6188c-1ae5-4b44-8d03-df07b8ceedc9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:17.060292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ba6188c-1ae5-4b44-8d03-df07b8ceedc9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:17.060768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ba6188c-1ae5-4b44-8d03-df07b8ceedc9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:17.061194 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ba6188c-1ae5-4b44-8d03-df07b8ceedc9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:17.061874 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ba6188c-1ae5-4b44-8d03-df07b8ceedc9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:17.062317 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ba6188c-1ae5-4b44-8d03-df07b8ceedc9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:17.062732 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ba6188c-1ae5-4b44-8d03-df07b8ceedc9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:17.093710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5ba6188c-1ae5-4b44-8d03-df07b8ceedc9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046114 Aug 30 14:49:17.094260 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 413/815] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:17 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:18.029451 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b2487db5-2e4e-46c0-995e-3a7aa9026ef2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:18.031586 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b2487db5-2e4e-46c0-995e-3a7aa9026ef2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:18.037784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2487db5-2e4e-46c0-995e-3a7aa9026ef2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:18.038254 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2487db5-2e4e-46c0-995e-3a7aa9026ef2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:18.038678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2487db5-2e4e-46c0-995e-3a7aa9026ef2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:18.040234 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2487db5-2e4e-46c0-995e-3a7aa9026ef2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:18.040821 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2487db5-2e4e-46c0-995e-3a7aa9026ef2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:18.041236 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2487db5-2e4e-46c0-995e-3a7aa9026ef2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:18.072544 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b2487db5-2e4e-46c0-995e-3a7aa9026ef2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046933 Aug 30 14:49:18.073106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 403/816] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:18 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:18.106507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e47960d2-bf28-4c7c-8e8a-c9dee5e21fce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:18.108640 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e47960d2-bf28-4c7c-8e8a-c9dee5e21fce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:18.114926 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e47960d2-bf28-4c7c-8e8a-c9dee5e21fce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:18.115445 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e47960d2-bf28-4c7c-8e8a-c9dee5e21fce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:18.115878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e47960d2-bf28-4c7c-8e8a-c9dee5e21fce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:18.116557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e47960d2-bf28-4c7c-8e8a-c9dee5e21fce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:18.117004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e47960d2-bf28-4c7c-8e8a-c9dee5e21fce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:18.117430 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e47960d2-bf28-4c7c-8e8a-c9dee5e21fce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:18.146442 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e47960d2-bf28-4c7c-8e8a-c9dee5e21fce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044108 Aug 30 14:49:18.146987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 414/817] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:18 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:19.084702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b87847fd-fdb9-43a9-a3d9-2dc80941813e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:19.086938 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b87847fd-fdb9-43a9-a3d9-2dc80941813e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:19.093495 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b87847fd-fdb9-43a9-a3d9-2dc80941813e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:19.093972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b87847fd-fdb9-43a9-a3d9-2dc80941813e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:19.094403 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b87847fd-fdb9-43a9-a3d9-2dc80941813e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:19.095082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b87847fd-fdb9-43a9-a3d9-2dc80941813e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:19.095563 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b87847fd-fdb9-43a9-a3d9-2dc80941813e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:19.095985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b87847fd-fdb9-43a9-a3d9-2dc80941813e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:19.126477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b87847fd-fdb9-43a9-a3d9-2dc80941813e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045650 Aug 30 14:49:19.127244 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 404/818] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:19 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:19.159546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c755eb3c-b8c3-4993-9b48-ff9211bd2bf7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:19.161605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c755eb3c-b8c3-4993-9b48-ff9211bd2bf7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:19.168002 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c755eb3c-b8c3-4993-9b48-ff9211bd2bf7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:19.168482 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c755eb3c-b8c3-4993-9b48-ff9211bd2bf7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:19.168911 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c755eb3c-b8c3-4993-9b48-ff9211bd2bf7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:19.169634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c755eb3c-b8c3-4993-9b48-ff9211bd2bf7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:19.170081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c755eb3c-b8c3-4993-9b48-ff9211bd2bf7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:19.170502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c755eb3c-b8c3-4993-9b48-ff9211bd2bf7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:19.203452 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c755eb3c-b8c3-4993-9b48-ff9211bd2bf7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048010 Aug 30 14:49:19.204001 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 415/819] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:19 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:20.138313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e2bfb7da-2061-467f-99dc-6dfb3e42adbd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:20.140460 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e2bfb7da-2061-467f-99dc-6dfb3e42adbd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:20.146279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2bfb7da-2061-467f-99dc-6dfb3e42adbd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:20.146763 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2bfb7da-2061-467f-99dc-6dfb3e42adbd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:20.147195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2bfb7da-2061-467f-99dc-6dfb3e42adbd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:20.147906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2bfb7da-2061-467f-99dc-6dfb3e42adbd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:20.148354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2bfb7da-2061-467f-99dc-6dfb3e42adbd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:20.149294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2bfb7da-2061-467f-99dc-6dfb3e42adbd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:20.178334 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e2bfb7da-2061-467f-99dc-6dfb3e42adbd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044203 Aug 30 14:49:20.178892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 405/820] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:20 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:20.215945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ba1843e6-acba-4231-b279-f08960271396 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:20.218067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ba1843e6-acba-4231-b279-f08960271396 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:20.224519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba1843e6-acba-4231-b279-f08960271396 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:20.224998 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba1843e6-acba-4231-b279-f08960271396 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:20.225427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba1843e6-acba-4231-b279-f08960271396 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:20.226136 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba1843e6-acba-4231-b279-f08960271396 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:20.227266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba1843e6-acba-4231-b279-f08960271396 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:20.227719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba1843e6-acba-4231-b279-f08960271396 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:20.256057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ba1843e6-acba-4231-b279-f08960271396 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044075 Aug 30 14:49:20.256608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 416/821] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:20 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:21.190539 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-eee5a855-ce92-4972-b341-d59df983bbfb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:21.192876 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-eee5a855-ce92-4972-b341-d59df983bbfb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:21.199974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eee5a855-ce92-4972-b341-d59df983bbfb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:21.200453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eee5a855-ce92-4972-b341-d59df983bbfb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:21.200883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eee5a855-ce92-4972-b341-d59df983bbfb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:21.201565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eee5a855-ce92-4972-b341-d59df983bbfb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:21.202012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eee5a855-ce92-4972-b341-d59df983bbfb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:21.202431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eee5a855-ce92-4972-b341-d59df983bbfb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:21.227703 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:21.232904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-eee5a855-ce92-4972-b341-d59df983bbfb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046255 Aug 30 14:49:21.233478 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 406/822] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:21 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:21.268056 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-dc55e124-b3ac-4937-9403-e5fed4769a4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:21.270184 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-dc55e124-b3ac-4937-9403-e5fed4769a4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:21.277146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc55e124-b3ac-4937-9403-e5fed4769a4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:21.277632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc55e124-b3ac-4937-9403-e5fed4769a4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:21.278066 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc55e124-b3ac-4937-9403-e5fed4769a4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:21.278756 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc55e124-b3ac-4937-9403-e5fed4769a4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:21.279232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc55e124-b3ac-4937-9403-e5fed4769a4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:21.279651 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc55e124-b3ac-4937-9403-e5fed4769a4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:21.308861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-dc55e124-b3ac-4937-9403-e5fed4769a4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044846 Aug 30 14:49:21.309415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 417/823] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:21 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:22.245672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a47594c9-f9a9-4640-9fab-bdc5ae2ce697 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:22.247822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a47594c9-f9a9-4640-9fab-bdc5ae2ce697 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:22.254118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a47594c9-f9a9-4640-9fab-bdc5ae2ce697 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:22.254593 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a47594c9-f9a9-4640-9fab-bdc5ae2ce697 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:22.255024 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a47594c9-f9a9-4640-9fab-bdc5ae2ce697 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:22.255745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a47594c9-f9a9-4640-9fab-bdc5ae2ce697 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:22.256193 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a47594c9-f9a9-4640-9fab-bdc5ae2ce697 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:22.256610 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a47594c9-f9a9-4640-9fab-bdc5ae2ce697 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:22.285881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a47594c9-f9a9-4640-9fab-bdc5ae2ce697 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044493 Aug 30 14:49:22.286432 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 407/824] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:22 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:22.321725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f10b388f-7967-44db-aba4-288da1a0c745 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:22.323941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f10b388f-7967-44db-aba4-288da1a0c745 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:22.330199 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f10b388f-7967-44db-aba4-288da1a0c745 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:22.330675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f10b388f-7967-44db-aba4-288da1a0c745 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:22.331107 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f10b388f-7967-44db-aba4-288da1a0c745 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:22.331969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f10b388f-7967-44db-aba4-288da1a0c745 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:22.332416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f10b388f-7967-44db-aba4-288da1a0c745 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:22.332837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f10b388f-7967-44db-aba4-288da1a0c745 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:22.362916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f10b388f-7967-44db-aba4-288da1a0c745 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045401 Aug 30 14:49:22.363506 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 418/825] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:22 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:49:23.298357 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6c9e501e-e8d2-421b-85cd-54118b610f33 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:23.300541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6c9e501e-e8d2-421b-85cd-54118b610f33 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:23.307357 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c9e501e-e8d2-421b-85cd-54118b610f33 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:23.307833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c9e501e-e8d2-421b-85cd-54118b610f33 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:23.308261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c9e501e-e8d2-421b-85cd-54118b610f33 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:23.308938 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c9e501e-e8d2-421b-85cd-54118b610f33 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:23.309382 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c9e501e-e8d2-421b-85cd-54118b610f33 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:23.309797 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c9e501e-e8d2-421b-85cd-54118b610f33 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:23.339003 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6c9e501e-e8d2-421b-85cd-54118b610f33 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044498 Aug 30 14:49:23.339572 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 408/826] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:23 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:23.374706 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5229ce36-1892-4c58-acd3-7d9d7418d14b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:23.376882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5229ce36-1892-4c58-acd3-7d9d7418d14b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:23.383437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5229ce36-1892-4c58-acd3-7d9d7418d14b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:23.383920 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5229ce36-1892-4c58-acd3-7d9d7418d14b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:23.384354 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5229ce36-1892-4c58-acd3-7d9d7418d14b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:23.385048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5229ce36-1892-4c58-acd3-7d9d7418d14b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:23.385496 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5229ce36-1892-4c58-acd3-7d9d7418d14b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:23.385917 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5229ce36-1892-4c58-acd3-7d9d7418d14b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:23.414778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5229ce36-1892-4c58-acd3-7d9d7418d14b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043688 Aug 30 14:49:23.415343 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 419/827] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:23 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:24.351029 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-25fde72b-bcba-45d1-b4c5-8436a83f54c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:24.354127 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-25fde72b-bcba-45d1-b4c5-8436a83f54c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:24.360487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25fde72b-bcba-45d1-b4c5-8436a83f54c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:24.360970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25fde72b-bcba-45d1-b4c5-8436a83f54c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:24.361400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25fde72b-bcba-45d1-b4c5-8436a83f54c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:24.362086 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25fde72b-bcba-45d1-b4c5-8436a83f54c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:24.362534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25fde72b-bcba-45d1-b4c5-8436a83f54c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:24.362955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25fde72b-bcba-45d1-b4c5-8436a83f54c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:24.392025 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-25fde72b-bcba-45d1-b4c5-8436a83f54c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044989 Aug 30 14:49:24.392577 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 409/828] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:24 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:24.426784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-19f5972f-9cca-44d9-bd0b-c697aff22881 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:24.428929 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-19f5972f-9cca-44d9-bd0b-c697aff22881 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:24.436165 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-19f5972f-9cca-44d9-bd0b-c697aff22881 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:24.436646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-19f5972f-9cca-44d9-bd0b-c697aff22881 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:24.437083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-19f5972f-9cca-44d9-bd0b-c697aff22881 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:24.437776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-19f5972f-9cca-44d9-bd0b-c697aff22881 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:24.438227 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-19f5972f-9cca-44d9-bd0b-c697aff22881 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:24.438648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-19f5972f-9cca-44d9-bd0b-c697aff22881 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:24.468000 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-19f5972f-9cca-44d9-bd0b-c697aff22881 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045035 Aug 30 14:49:24.468608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 420/829] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:24 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:25.403680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5ceebb8c-5df4-4a3f-9a93-5a88c3541f4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:25.405793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5ceebb8c-5df4-4a3f-9a93-5a88c3541f4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:25.412131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ceebb8c-5df4-4a3f-9a93-5a88c3541f4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:25.412613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ceebb8c-5df4-4a3f-9a93-5a88c3541f4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:25.413046 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ceebb8c-5df4-4a3f-9a93-5a88c3541f4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:25.413728 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ceebb8c-5df4-4a3f-9a93-5a88c3541f4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:25.414327 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ceebb8c-5df4-4a3f-9a93-5a88c3541f4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:25.414939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ceebb8c-5df4-4a3f-9a93-5a88c3541f4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:25.446902 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5ceebb8c-5df4-4a3f-9a93-5a88c3541f4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047185 Aug 30 14:49:25.447502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 410/830] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:25 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:25.480804 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a2e89a10-e56c-4f4d-b4b7-02159c23bb59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:25.482831 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a2e89a10-e56c-4f4d-b4b7-02159c23bb59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:25.489892 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2e89a10-e56c-4f4d-b4b7-02159c23bb59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:25.490379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2e89a10-e56c-4f4d-b4b7-02159c23bb59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:25.490804 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2e89a10-e56c-4f4d-b4b7-02159c23bb59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:25.491517 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2e89a10-e56c-4f4d-b4b7-02159c23bb59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:25.491978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2e89a10-e56c-4f4d-b4b7-02159c23bb59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:25.492634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2e89a10-e56c-4f4d-b4b7-02159c23bb59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:25.522206 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a2e89a10-e56c-4f4d-b4b7-02159c23bb59 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045503 Aug 30 14:49:25.522758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 421/831] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:25 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:26.459153 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-12864732-75b3-4ff4-82a7-b5b872ea0a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:26.461354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-12864732-75b3-4ff4-82a7-b5b872ea0a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:26.467715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12864732-75b3-4ff4-82a7-b5b872ea0a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:26.468131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12864732-75b3-4ff4-82a7-b5b872ea0a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:26.468564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12864732-75b3-4ff4-82a7-b5b872ea0a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:26.469246 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12864732-75b3-4ff4-82a7-b5b872ea0a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:26.469694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12864732-75b3-4ff4-82a7-b5b872ea0a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:26.470114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12864732-75b3-4ff4-82a7-b5b872ea0a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:26.499972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-12864732-75b3-4ff4-82a7-b5b872ea0a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044774 Aug 30 14:49:26.500517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 411/832] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:26 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:26.535166 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7ec4ccdb-eda0-4a4c-b2ad-06667c24c741 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:26.537360 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7ec4ccdb-eda0-4a4c-b2ad-06667c24c741 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:26.544266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ec4ccdb-eda0-4a4c-b2ad-06667c24c741 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:26.544752 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ec4ccdb-eda0-4a4c-b2ad-06667c24c741 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:26.545186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ec4ccdb-eda0-4a4c-b2ad-06667c24c741 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:26.545879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ec4ccdb-eda0-4a4c-b2ad-06667c24c741 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:26.546330 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ec4ccdb-eda0-4a4c-b2ad-06667c24c741 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:26.546752 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ec4ccdb-eda0-4a4c-b2ad-06667c24c741 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:26.576487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7ec4ccdb-eda0-4a4c-b2ad-06667c24c741 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045258 Aug 30 14:49:26.577044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 422/833] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:26 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:27.512881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-992413ac-458c-4c22-8e4d-818aaf55a41f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:27.514889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-992413ac-458c-4c22-8e4d-818aaf55a41f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:27.521250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-992413ac-458c-4c22-8e4d-818aaf55a41f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:27.521721 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-992413ac-458c-4c22-8e4d-818aaf55a41f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:27.522144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-992413ac-458c-4c22-8e4d-818aaf55a41f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:27.522826 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-992413ac-458c-4c22-8e4d-818aaf55a41f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:27.523417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-992413ac-458c-4c22-8e4d-818aaf55a41f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:27.523862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-992413ac-458c-4c22-8e4d-818aaf55a41f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:27.552660 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-992413ac-458c-4c22-8e4d-818aaf55a41f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043752 Aug 30 14:49:27.553278 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 412/834] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:27 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:27.589442 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d1d716d9-a88f-4700-8f4a-eae4b0616aa8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:27.591784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d1d716d9-a88f-4700-8f4a-eae4b0616aa8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:27.598068 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1d716d9-a88f-4700-8f4a-eae4b0616aa8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:27.598546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1d716d9-a88f-4700-8f4a-eae4b0616aa8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:27.598972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1d716d9-a88f-4700-8f4a-eae4b0616aa8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:27.599900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1d716d9-a88f-4700-8f4a-eae4b0616aa8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:27.600343 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1d716d9-a88f-4700-8f4a-eae4b0616aa8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:27.600759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1d716d9-a88f-4700-8f4a-eae4b0616aa8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:27.630789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d1d716d9-a88f-4700-8f4a-eae4b0616aa8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045747 Aug 30 14:49:27.631378 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 423/835] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:27 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:28.565311 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5537d3d4-3c0f-4667-a791-d6730285faee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:28.567718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5537d3d4-3c0f-4667-a791-d6730285faee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:28.574579 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5537d3d4-3c0f-4667-a791-d6730285faee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:28.575057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5537d3d4-3c0f-4667-a791-d6730285faee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:28.575534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5537d3d4-3c0f-4667-a791-d6730285faee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:28.576216 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5537d3d4-3c0f-4667-a791-d6730285faee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:28.576663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5537d3d4-3c0f-4667-a791-d6730285faee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:28.577081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5537d3d4-3c0f-4667-a791-d6730285faee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:28.607506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5537d3d4-3c0f-4667-a791-d6730285faee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046187 Aug 30 14:49:28.608072 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 413/836] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:28 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:28.643965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-327237f3-a515-407a-8d77-fb491076e44b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:28.646101 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-327237f3-a515-407a-8d77-fb491076e44b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:28.652996 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-327237f3-a515-407a-8d77-fb491076e44b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:28.653473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-327237f3-a515-407a-8d77-fb491076e44b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:28.653901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-327237f3-a515-407a-8d77-fb491076e44b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:28.654581 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-327237f3-a515-407a-8d77-fb491076e44b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:28.655047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-327237f3-a515-407a-8d77-fb491076e44b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:28.655493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-327237f3-a515-407a-8d77-fb491076e44b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:28.683261 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-327237f3-a515-407a-8d77-fb491076e44b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043264 Aug 30 14:49:28.683807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 424/837] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:28 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:29.620319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cccadf36-a306-4dae-b9dc-3178998eed5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:29.622446 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cccadf36-a306-4dae-b9dc-3178998eed5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:29.628820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cccadf36-a306-4dae-b9dc-3178998eed5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:29.629294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cccadf36-a306-4dae-b9dc-3178998eed5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:29.629724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cccadf36-a306-4dae-b9dc-3178998eed5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:29.630401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cccadf36-a306-4dae-b9dc-3178998eed5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:29.630845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cccadf36-a306-4dae-b9dc-3178998eed5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:29.631290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cccadf36-a306-4dae-b9dc-3178998eed5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:29.659648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cccadf36-a306-4dae-b9dc-3178998eed5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044077 Aug 30 14:49:29.660198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 414/838] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:29 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:29.695981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-62869d21-ea58-4a81-b4b7-16473b61c780 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:29.698100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-62869d21-ea58-4a81-b4b7-16473b61c780 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:29.704643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62869d21-ea58-4a81-b4b7-16473b61c780 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:29.705128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62869d21-ea58-4a81-b4b7-16473b61c780 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:29.705599 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62869d21-ea58-4a81-b4b7-16473b61c780 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:29.706291 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62869d21-ea58-4a81-b4b7-16473b61c780 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:29.706744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62869d21-ea58-4a81-b4b7-16473b61c780 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:29.707169 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62869d21-ea58-4a81-b4b7-16473b61c780 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:29.737297 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-62869d21-ea58-4a81-b4b7-16473b61c780 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045767 Aug 30 14:49:29.737779 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 425/839] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:29 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:30.671237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0515420b-3340-4f94-8c61-57c58dbfed3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:30.673360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0515420b-3340-4f94-8c61-57c58dbfed3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:30.680300 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0515420b-3340-4f94-8c61-57c58dbfed3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:30.680961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0515420b-3340-4f94-8c61-57c58dbfed3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:30.681388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0515420b-3340-4f94-8c61-57c58dbfed3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:30.682064 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0515420b-3340-4f94-8c61-57c58dbfed3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:30.682505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0515420b-3340-4f94-8c61-57c58dbfed3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:30.682918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0515420b-3340-4f94-8c61-57c58dbfed3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:30.713868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0515420b-3340-4f94-8c61-57c58dbfed3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046465 Aug 30 14:49:30.714590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 415/840] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:30 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:30.750333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0ce43175-3425-4f7c-aac6-4f48d1b2d9d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:30.752570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0ce43175-3425-4f7c-aac6-4f48d1b2d9d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:30.759753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ce43175-3425-4f7c-aac6-4f48d1b2d9d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:30.760235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ce43175-3425-4f7c-aac6-4f48d1b2d9d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:30.760666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ce43175-3425-4f7c-aac6-4f48d1b2d9d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:30.761356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ce43175-3425-4f7c-aac6-4f48d1b2d9d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:30.761807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ce43175-3425-4f7c-aac6-4f48d1b2d9d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:30.762226 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ce43175-3425-4f7c-aac6-4f48d1b2d9d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:30.791701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0ce43175-3425-4f7c-aac6-4f48d1b2d9d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045784 Aug 30 14:49:30.792200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 426/841] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:30 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:31.726007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7a7b4431-c020-4444-add2-bef7d02cfaa4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:31.728450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7a7b4431-c020-4444-add2-bef7d02cfaa4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:31.734710 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a7b4431-c020-4444-add2-bef7d02cfaa4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:31.735179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a7b4431-c020-4444-add2-bef7d02cfaa4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:31.735636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a7b4431-c020-4444-add2-bef7d02cfaa4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:31.736310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a7b4431-c020-4444-add2-bef7d02cfaa4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:31.736753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a7b4431-c020-4444-add2-bef7d02cfaa4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:31.737170 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a7b4431-c020-4444-add2-bef7d02cfaa4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:31.766633 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7a7b4431-c020-4444-add2-bef7d02cfaa4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044556 Aug 30 14:49:31.767173 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 416/842] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:31 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:31.803684 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c94b371c-ce90-4d4a-ad1e-545ff756a516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:31.806489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c94b371c-ce90-4d4a-ad1e-545ff756a516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:31.812781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c94b371c-ce90-4d4a-ad1e-545ff756a516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:31.813262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c94b371c-ce90-4d4a-ad1e-545ff756a516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:31.813695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c94b371c-ce90-4d4a-ad1e-545ff756a516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:31.814377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c94b371c-ce90-4d4a-ad1e-545ff756a516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:31.814823 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c94b371c-ce90-4d4a-ad1e-545ff756a516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:31.815268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c94b371c-ce90-4d4a-ad1e-545ff756a516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:31.819128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:31.844476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c94b371c-ce90-4d4a-ad1e-545ff756a516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044876 Aug 30 14:49:31.844964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 427/843] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:31 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:32.779778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7dc3a60a-cd6e-4448-945b-e16f9accb08c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:32.781874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7dc3a60a-cd6e-4448-945b-e16f9accb08c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:32.784151 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=58 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:32.789305 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dc3a60a-cd6e-4448-945b-e16f9accb08c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:32.789774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dc3a60a-cd6e-4448-945b-e16f9accb08c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:32.790205 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dc3a60a-cd6e-4448-945b-e16f9accb08c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:32.790883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dc3a60a-cd6e-4448-945b-e16f9accb08c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:32.791390 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dc3a60a-cd6e-4448-945b-e16f9accb08c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:32.791807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dc3a60a-cd6e-4448-945b-e16f9accb08c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:32.827368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7dc3a60a-cd6e-4448-945b-e16f9accb08c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051380 Aug 30 14:49:32.827932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 417/844] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:32 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:32.856786 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f570489c-f288-41e5-bdb6-85167d6f76be tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:32.858931 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f570489c-f288-41e5-bdb6-85167d6f76be tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:32.865267 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f570489c-f288-41e5-bdb6-85167d6f76be tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:32.865749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f570489c-f288-41e5-bdb6-85167d6f76be tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:32.866183 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f570489c-f288-41e5-bdb6-85167d6f76be tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:32.867529 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f570489c-f288-41e5-bdb6-85167d6f76be tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:32.867982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f570489c-f288-41e5-bdb6-85167d6f76be tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:32.868410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f570489c-f288-41e5-bdb6-85167d6f76be tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:32.897409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f570489c-f288-41e5-bdb6-85167d6f76be tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044517 Aug 30 14:49:32.898032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 428/845] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:32 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:33.839739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-81676ecc-9f1a-48fa-9655-66b31bc229ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:33.841854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-81676ecc-9f1a-48fa-9655-66b31bc229ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:33.848129 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81676ecc-9f1a-48fa-9655-66b31bc229ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:33.848600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81676ecc-9f1a-48fa-9655-66b31bc229ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:33.849023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81676ecc-9f1a-48fa-9655-66b31bc229ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:33.849703 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81676ecc-9f1a-48fa-9655-66b31bc229ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:33.850144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81676ecc-9f1a-48fa-9655-66b31bc229ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:33.850555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81676ecc-9f1a-48fa-9655-66b31bc229ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:33.880242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-81676ecc-9f1a-48fa-9655-66b31bc229ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Aug 30 14:49:33.880784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 418/846] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:33 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:33.909838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0d14fca6-84bc-472e-b362-47eaabbd0d07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:33.912021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0d14fca6-84bc-472e-b362-47eaabbd0d07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:33.914786 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=58 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:33.920003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0d14fca6-84bc-472e-b362-47eaabbd0d07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:33.920491 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0d14fca6-84bc-472e-b362-47eaabbd0d07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:33.920917 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0d14fca6-84bc-472e-b362-47eaabbd0d07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:33.921609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0d14fca6-84bc-472e-b362-47eaabbd0d07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:33.922060 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0d14fca6-84bc-472e-b362-47eaabbd0d07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:33.922482 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0d14fca6-84bc-472e-b362-47eaabbd0d07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:33.952892 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0d14fca6-84bc-472e-b362-47eaabbd0d07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046904 Aug 30 14:49:33.953384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 429/847] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:33 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:34.892012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ee7d1cf8-de47-4824-afd3-4ef9eb8ea759 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:34.894115 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ee7d1cf8-de47-4824-afd3-4ef9eb8ea759 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:34.901012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee7d1cf8-de47-4824-afd3-4ef9eb8ea759 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:34.901485 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee7d1cf8-de47-4824-afd3-4ef9eb8ea759 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:34.901914 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee7d1cf8-de47-4824-afd3-4ef9eb8ea759 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:34.902589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee7d1cf8-de47-4824-afd3-4ef9eb8ea759 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:34.903032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee7d1cf8-de47-4824-afd3-4ef9eb8ea759 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:34.903469 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee7d1cf8-de47-4824-afd3-4ef9eb8ea759 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:34.933456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ee7d1cf8-de47-4824-afd3-4ef9eb8ea759 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045360 Aug 30 14:49:34.934003 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 419/848] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:34 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:34.965718 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9b12d9bb-3664-4bbd-96e7-aea5cbf11cd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:34.967869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9b12d9bb-3664-4bbd-96e7-aea5cbf11cd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:34.974312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b12d9bb-3664-4bbd-96e7-aea5cbf11cd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:34.974796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b12d9bb-3664-4bbd-96e7-aea5cbf11cd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:34.975254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b12d9bb-3664-4bbd-96e7-aea5cbf11cd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:34.975950 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b12d9bb-3664-4bbd-96e7-aea5cbf11cd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:34.977023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b12d9bb-3664-4bbd-96e7-aea5cbf11cd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:34.977439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b12d9bb-3664-4bbd-96e7-aea5cbf11cd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:35.006030 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9b12d9bb-3664-4bbd-96e7-aea5cbf11cd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044230 Aug 30 14:49:35.006519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 430/849] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:34 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:35.945719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3fbe4f3b-506f-4505-9c3b-ffe00bf263df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:35.947851 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3fbe4f3b-506f-4505-9c3b-ffe00bf263df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:35.954326 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3fbe4f3b-506f-4505-9c3b-ffe00bf263df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:35.954802 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3fbe4f3b-506f-4505-9c3b-ffe00bf263df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:35.955236 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3fbe4f3b-506f-4505-9c3b-ffe00bf263df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:35.955919 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3fbe4f3b-506f-4505-9c3b-ffe00bf263df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:35.956362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3fbe4f3b-506f-4505-9c3b-ffe00bf263df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:35.956774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3fbe4f3b-506f-4505-9c3b-ffe00bf263df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:35.986591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3fbe4f3b-506f-4505-9c3b-ffe00bf263df tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Aug 30 14:49:35.987139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 420/850] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:35 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:36.017858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-092f322e-f869-4c39-9afb-2915253660a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:36.020014 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-092f322e-f869-4c39-9afb-2915253660a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:36.026867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-092f322e-f869-4c39-9afb-2915253660a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:36.027374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-092f322e-f869-4c39-9afb-2915253660a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:36.027833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-092f322e-f869-4c39-9afb-2915253660a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:36.028518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-092f322e-f869-4c39-9afb-2915253660a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:36.028961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-092f322e-f869-4c39-9afb-2915253660a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:36.029376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-092f322e-f869-4c39-9afb-2915253660a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:36.058745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-092f322e-f869-4c39-9afb-2915253660a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044816 Aug 30 14:49:36.059343 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 431/851] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:36 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:36.998660 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f78cddc2-6ce5-445a-89a6-8356df75c46d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:37.000819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f78cddc2-6ce5-445a-89a6-8356df75c46d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:37.007038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f78cddc2-6ce5-445a-89a6-8356df75c46d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:37.008198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f78cddc2-6ce5-445a-89a6-8356df75c46d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:37.008629 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f78cddc2-6ce5-445a-89a6-8356df75c46d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:37.009302 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f78cddc2-6ce5-445a-89a6-8356df75c46d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:37.009745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f78cddc2-6ce5-445a-89a6-8356df75c46d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:37.010157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f78cddc2-6ce5-445a-89a6-8356df75c46d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:37.038988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f78cddc2-6ce5-445a-89a6-8356df75c46d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044226 Aug 30 14:49:37.039555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 421/852] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:36 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:37.070663 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7f2d26de-0003-4fc8-b832-af176ecb375a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:37.072818 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7f2d26de-0003-4fc8-b832-af176ecb375a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:37.079139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f2d26de-0003-4fc8-b832-af176ecb375a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:37.079649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f2d26de-0003-4fc8-b832-af176ecb375a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:37.080081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f2d26de-0003-4fc8-b832-af176ecb375a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:37.080764 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f2d26de-0003-4fc8-b832-af176ecb375a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:37.081217 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f2d26de-0003-4fc8-b832-af176ecb375a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:37.081636 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f2d26de-0003-4fc8-b832-af176ecb375a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:37.110670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7f2d26de-0003-4fc8-b832-af176ecb375a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044612 Aug 30 14:49:37.111150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 432/853] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:37 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:38.051060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3e956ebb-dcdb-4197-8b3c-297e4fb56608 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:38.053219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3e956ebb-dcdb-4197-8b3c-297e4fb56608 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:38.060129 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e956ebb-dcdb-4197-8b3c-297e4fb56608 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:38.060602 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e956ebb-dcdb-4197-8b3c-297e4fb56608 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:38.061033 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e956ebb-dcdb-4197-8b3c-297e4fb56608 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:38.061717 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e956ebb-dcdb-4197-8b3c-297e4fb56608 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:38.062170 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e956ebb-dcdb-4197-8b3c-297e4fb56608 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:38.062590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e956ebb-dcdb-4197-8b3c-297e4fb56608 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:38.091519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3e956ebb-dcdb-4197-8b3c-297e4fb56608 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044335 Aug 30 14:49:38.092061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 422/854] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:38 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:38.123532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-eae590e5-eb14-48ad-b2bb-b565a5351911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:38.125750 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-eae590e5-eb14-48ad-b2bb-b565a5351911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:38.132075 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eae590e5-eb14-48ad-b2bb-b565a5351911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:38.133223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eae590e5-eb14-48ad-b2bb-b565a5351911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:38.133667 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eae590e5-eb14-48ad-b2bb-b565a5351911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:38.134362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eae590e5-eb14-48ad-b2bb-b565a5351911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:38.134819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eae590e5-eb14-48ad-b2bb-b565a5351911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:38.135271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eae590e5-eb14-48ad-b2bb-b565a5351911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:38.163484 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-eae590e5-eb14-48ad-b2bb-b565a5351911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043927 Aug 30 14:49:38.164034 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 433/855] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:38 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:39.103905 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-01e16524-8dee-421e-8b8a-9db1836bacd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:39.106021 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-01e16524-8dee-421e-8b8a-9db1836bacd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:39.112407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01e16524-8dee-421e-8b8a-9db1836bacd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:39.112880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01e16524-8dee-421e-8b8a-9db1836bacd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:39.113314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01e16524-8dee-421e-8b8a-9db1836bacd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:39.113992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01e16524-8dee-421e-8b8a-9db1836bacd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:39.114437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01e16524-8dee-421e-8b8a-9db1836bacd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:39.114852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01e16524-8dee-421e-8b8a-9db1836bacd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:39.131929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:39.145751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-01e16524-8dee-421e-8b8a-9db1836bacd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046297 Aug 30 14:49:39.146255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 423/856] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:39 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:39.175639 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-942668c2-e6b8-4c4e-a59a-0749d53331f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:39.177738 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-942668c2-e6b8-4c4e-a59a-0749d53331f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:39.184916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-942668c2-e6b8-4c4e-a59a-0749d53331f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:39.185402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-942668c2-e6b8-4c4e-a59a-0749d53331f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:39.185827 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-942668c2-e6b8-4c4e-a59a-0749d53331f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:39.186508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-942668c2-e6b8-4c4e-a59a-0749d53331f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:39.186951 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-942668c2-e6b8-4c4e-a59a-0749d53331f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:39.187392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-942668c2-e6b8-4c4e-a59a-0749d53331f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:39.216106 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-942668c2-e6b8-4c4e-a59a-0749d53331f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044423 Aug 30 14:49:39.216655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 434/857] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:39 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:49:40.156965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a9490194-b900-4b55-83ae-27e5262d2a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:40.159077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a9490194-b900-4b55-83ae-27e5262d2a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:40.165506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9490194-b900-4b55-83ae-27e5262d2a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:40.165982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9490194-b900-4b55-83ae-27e5262d2a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:40.166413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9490194-b900-4b55-83ae-27e5262d2a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:40.167092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9490194-b900-4b55-83ae-27e5262d2a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:40.167565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9490194-b900-4b55-83ae-27e5262d2a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:40.167984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9490194-b900-4b55-83ae-27e5262d2a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:40.197771 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a9490194-b900-4b55-83ae-27e5262d2a72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044740 Aug 30 14:49:40.198313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 424/858] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:40 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:40.228431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-dfd132c8-305a-4dcc-81ea-b63c7a6413ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:40.230564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-dfd132c8-305a-4dcc-81ea-b63c7a6413ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:40.245545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dfd132c8-305a-4dcc-81ea-b63c7a6413ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:40.246022 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dfd132c8-305a-4dcc-81ea-b63c7a6413ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:40.246451 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dfd132c8-305a-4dcc-81ea-b63c7a6413ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:40.247136 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dfd132c8-305a-4dcc-81ea-b63c7a6413ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:40.247608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dfd132c8-305a-4dcc-81ea-b63c7a6413ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:40.248051 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dfd132c8-305a-4dcc-81ea-b63c7a6413ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:40.277580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-dfd132c8-305a-4dcc-81ea-b63c7a6413ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053035 Aug 30 14:49:40.278076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 435/859] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:40 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:41.208907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5a02d913-9c8c-4813-a836-7351e19bcfc7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:41.211228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5a02d913-9c8c-4813-a836-7351e19bcfc7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:41.217501 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a02d913-9c8c-4813-a836-7351e19bcfc7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:41.217987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a02d913-9c8c-4813-a836-7351e19bcfc7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:41.218423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a02d913-9c8c-4813-a836-7351e19bcfc7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:41.219121 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a02d913-9c8c-4813-a836-7351e19bcfc7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:41.219611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a02d913-9c8c-4813-a836-7351e19bcfc7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:41.220041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a02d913-9c8c-4813-a836-7351e19bcfc7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:41.250979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5a02d913-9c8c-4813-a836-7351e19bcfc7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046065 Aug 30 14:49:41.251799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 425/860] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:41 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:41.290082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-809231ed-3118-4f4a-be21-ba1fa383723f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:41.292241 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-809231ed-3118-4f4a-be21-ba1fa383723f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:41.298472 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-809231ed-3118-4f4a-be21-ba1fa383723f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:41.298983 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-809231ed-3118-4f4a-be21-ba1fa383723f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:41.299451 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-809231ed-3118-4f4a-be21-ba1fa383723f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:41.300160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-809231ed-3118-4f4a-be21-ba1fa383723f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:41.300603 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-809231ed-3118-4f4a-be21-ba1fa383723f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:41.301013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-809231ed-3118-4f4a-be21-ba1fa383723f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:41.330830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-809231ed-3118-4f4a-be21-ba1fa383723f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045015 Aug 30 14:49:41.331415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 436/861] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:41 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:42.264258 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7847d772-a5c5-42af-9dcb-a8bf7ce56c28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:42.266376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7847d772-a5c5-42af-9dcb-a8bf7ce56c28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:42.273389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7847d772-a5c5-42af-9dcb-a8bf7ce56c28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:42.273921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7847d772-a5c5-42af-9dcb-a8bf7ce56c28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:42.274409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7847d772-a5c5-42af-9dcb-a8bf7ce56c28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:42.275097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7847d772-a5c5-42af-9dcb-a8bf7ce56c28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:42.275571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7847d772-a5c5-42af-9dcb-a8bf7ce56c28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:42.275993 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7847d772-a5c5-42af-9dcb-a8bf7ce56c28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:42.304197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7847d772-a5c5-42af-9dcb-a8bf7ce56c28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043876 Aug 30 14:49:42.304743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 426/862] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:42 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:42.343218 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-64a41996-5380-4223-b154-d9043973476e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:42.345381 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-64a41996-5380-4223-b154-d9043973476e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:42.352271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64a41996-5380-4223-b154-d9043973476e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:42.352749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64a41996-5380-4223-b154-d9043973476e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:42.353236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64a41996-5380-4223-b154-d9043973476e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:42.353871 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64a41996-5380-4223-b154-d9043973476e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:42.354321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64a41996-5380-4223-b154-d9043973476e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:42.354745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64a41996-5380-4223-b154-d9043973476e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:42.384296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-64a41996-5380-4223-b154-d9043973476e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045060 Aug 30 14:49:42.384855 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 437/863] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:42 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:43.316362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-80d6b36c-f603-4cff-a14f-27b3735eef9e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:43.318501 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-80d6b36c-f603-4cff-a14f-27b3735eef9e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:43.325588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-80d6b36c-f603-4cff-a14f-27b3735eef9e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:43.326073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-80d6b36c-f603-4cff-a14f-27b3735eef9e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:43.326511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-80d6b36c-f603-4cff-a14f-27b3735eef9e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:43.327197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-80d6b36c-f603-4cff-a14f-27b3735eef9e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:43.327675 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-80d6b36c-f603-4cff-a14f-27b3735eef9e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:43.328096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-80d6b36c-f603-4cff-a14f-27b3735eef9e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:43.356931 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-80d6b36c-f603-4cff-a14f-27b3735eef9e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044755 Aug 30 14:49:43.357482 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 427/864] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:43 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:43.396497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4f09e146-8995-4abf-8cd9-98fecbc4a7d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:43.398671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4f09e146-8995-4abf-8cd9-98fecbc4a7d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:43.405068 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4f09e146-8995-4abf-8cd9-98fecbc4a7d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:43.405493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4f09e146-8995-4abf-8cd9-98fecbc4a7d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:43.405925 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4f09e146-8995-4abf-8cd9-98fecbc4a7d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:43.406612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4f09e146-8995-4abf-8cd9-98fecbc4a7d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:43.407064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4f09e146-8995-4abf-8cd9-98fecbc4a7d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:43.407509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4f09e146-8995-4abf-8cd9-98fecbc4a7d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:43.436183 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4f09e146-8995-4abf-8cd9-98fecbc4a7d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043702 Aug 30 14:49:43.436721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 438/865] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:43 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:44.368801 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3f706b4b-cc1e-4242-b570-d533b23c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:44.370900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3f706b4b-cc1e-4242-b570-d533b23c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:44.377196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f706b4b-cc1e-4242-b570-d533b23c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:44.377674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f706b4b-cc1e-4242-b570-d533b23c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:44.378107 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f706b4b-cc1e-4242-b570-d533b23c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:44.378788 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f706b4b-cc1e-4242-b570-d533b23c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:44.379257 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f706b4b-cc1e-4242-b570-d533b23c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:44.379676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f706b4b-cc1e-4242-b570-d533b23c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:44.408626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3f706b4b-cc1e-4242-b570-d533b23c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044510 Aug 30 14:49:44.409181 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 428/866] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:44 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:44.448426 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-47347403-cf86-487f-b70b-7502825d5087 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:44.450574 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-47347403-cf86-487f-b70b-7502825d5087 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:44.456939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-47347403-cf86-487f-b70b-7502825d5087 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:44.457465 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-47347403-cf86-487f-b70b-7502825d5087 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:44.457853 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-47347403-cf86-487f-b70b-7502825d5087 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:44.458533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-47347403-cf86-487f-b70b-7502825d5087 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:44.458976 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-47347403-cf86-487f-b70b-7502825d5087 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:44.459434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-47347403-cf86-487f-b70b-7502825d5087 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:44.488607 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-47347403-cf86-487f-b70b-7502825d5087 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044309 Aug 30 14:49:44.489156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 439/867] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:44 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:45.421481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ec285dd5-bf12-4ce1-ad87-85d8e72a1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:45.423631 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ec285dd5-bf12-4ce1-ad87-85d8e72a1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:45.430444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec285dd5-bf12-4ce1-ad87-85d8e72a1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:45.430918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec285dd5-bf12-4ce1-ad87-85d8e72a1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:45.431378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec285dd5-bf12-4ce1-ad87-85d8e72a1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:45.432057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec285dd5-bf12-4ce1-ad87-85d8e72a1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:45.432503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec285dd5-bf12-4ce1-ad87-85d8e72a1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:45.432950 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec285dd5-bf12-4ce1-ad87-85d8e72a1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:45.462105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ec285dd5-bf12-4ce1-ad87-85d8e72a1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044516 Aug 30 14:49:45.462582 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 429/868] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:45 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:45.502051 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-041a4473-dae8-4cb6-bcea-0ff6a9110dba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:45.504192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-041a4473-dae8-4cb6-bcea-0ff6a9110dba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:45.510429 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-041a4473-dae8-4cb6-bcea-0ff6a9110dba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:45.510901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-041a4473-dae8-4cb6-bcea-0ff6a9110dba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:45.511368 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-041a4473-dae8-4cb6-bcea-0ff6a9110dba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:45.512045 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-041a4473-dae8-4cb6-bcea-0ff6a9110dba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:45.512487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-041a4473-dae8-4cb6-bcea-0ff6a9110dba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:45.512902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-041a4473-dae8-4cb6-bcea-0ff6a9110dba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:45.542200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-041a4473-dae8-4cb6-bcea-0ff6a9110dba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044197 Aug 30 14:49:45.542739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 440/869] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:45 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:46.474080 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-636a7277-0501-4f8a-8c01-bcdacbc6ec5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:46.476187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-636a7277-0501-4f8a-8c01-bcdacbc6ec5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:46.482480 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636a7277-0501-4f8a-8c01-bcdacbc6ec5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:46.482962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636a7277-0501-4f8a-8c01-bcdacbc6ec5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:46.483427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636a7277-0501-4f8a-8c01-bcdacbc6ec5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:46.484110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636a7277-0501-4f8a-8c01-bcdacbc6ec5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:46.484559 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636a7277-0501-4f8a-8c01-bcdacbc6ec5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:46.484979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636a7277-0501-4f8a-8c01-bcdacbc6ec5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:46.514780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-636a7277-0501-4f8a-8c01-bcdacbc6ec5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044785 Aug 30 14:49:46.515358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 430/870] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:46 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:46.555011 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d3df3843-772f-4b95-ae6b-efd7c849d653 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:46.557171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d3df3843-772f-4b95-ae6b-efd7c849d653 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:46.563460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d3df3843-772f-4b95-ae6b-efd7c849d653 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:46.563942 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d3df3843-772f-4b95-ae6b-efd7c849d653 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:46.564377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d3df3843-772f-4b95-ae6b-efd7c849d653 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:46.565065 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d3df3843-772f-4b95-ae6b-efd7c849d653 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:46.565514 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d3df3843-772f-4b95-ae6b-efd7c849d653 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:46.565933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d3df3843-772f-4b95-ae6b-efd7c849d653 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:46.595602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d3df3843-772f-4b95-ae6b-efd7c849d653 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045230 Aug 30 14:49:46.596155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 441/871] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:46 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:47.527514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d1e58e7b-72e3-443d-b724-24a189f5475a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:47.529586 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d1e58e7b-72e3-443d-b724-24a189f5475a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:47.535931 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1e58e7b-72e3-443d-b724-24a189f5475a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:47.536415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1e58e7b-72e3-443d-b724-24a189f5475a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:47.536846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1e58e7b-72e3-443d-b724-24a189f5475a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:47.537528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1e58e7b-72e3-443d-b724-24a189f5475a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:47.538104 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1e58e7b-72e3-443d-b724-24a189f5475a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:47.538598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1e58e7b-72e3-443d-b724-24a189f5475a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:47.567534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d1e58e7b-72e3-443d-b724-24a189f5475a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043979 Aug 30 14:49:47.568083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 431/872] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:47 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:47.607608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8ecb3055-034b-4d22-a25e-d72f839f6c9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:47.609773 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8ecb3055-034b-4d22-a25e-d72f839f6c9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:47.616296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ecb3055-034b-4d22-a25e-d72f839f6c9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:47.616787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ecb3055-034b-4d22-a25e-d72f839f6c9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:47.617227 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ecb3055-034b-4d22-a25e-d72f839f6c9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:47.617923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ecb3055-034b-4d22-a25e-d72f839f6c9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:47.618378 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ecb3055-034b-4d22-a25e-d72f839f6c9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:47.618806 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ecb3055-034b-4d22-a25e-d72f839f6c9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:47.648411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8ecb3055-034b-4d22-a25e-d72f839f6c9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044059 Aug 30 14:49:47.648969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 442/873] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:47 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:48.580123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-77f38656-f772-436d-b0ab-9ba505dc1d3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:48.582269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-77f38656-f772-436d-b0ab-9ba505dc1d3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:48.589483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77f38656-f772-436d-b0ab-9ba505dc1d3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:48.589962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77f38656-f772-436d-b0ab-9ba505dc1d3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:48.590399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77f38656-f772-436d-b0ab-9ba505dc1d3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:48.591084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77f38656-f772-436d-b0ab-9ba505dc1d3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:48.591568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77f38656-f772-436d-b0ab-9ba505dc1d3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:48.591991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77f38656-f772-436d-b0ab-9ba505dc1d3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:48.621360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-77f38656-f772-436d-b0ab-9ba505dc1d3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045200 Aug 30 14:49:48.621902 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 432/874] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:48 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:48.660620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-01533219-d03b-41be-92fb-32397687d04d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:48.662729 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-01533219-d03b-41be-92fb-32397687d04d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:48.669605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-01533219-d03b-41be-92fb-32397687d04d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:48.670087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-01533219-d03b-41be-92fb-32397687d04d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:48.670511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-01533219-d03b-41be-92fb-32397687d04d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:48.671192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-01533219-d03b-41be-92fb-32397687d04d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:48.671658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-01533219-d03b-41be-92fb-32397687d04d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:48.672073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-01533219-d03b-41be-92fb-32397687d04d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:48.698127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:48.703316 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-01533219-d03b-41be-92fb-32397687d04d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046617 Aug 30 14:49:48.703874 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 443/875] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:48 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:49.633858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-094dbce6-d0c4-4b71-aceb-3368dd88dcd0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:49.636038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-094dbce6-d0c4-4b71-aceb-3368dd88dcd0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:49.642386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-094dbce6-d0c4-4b71-aceb-3368dd88dcd0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:49.642873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-094dbce6-d0c4-4b71-aceb-3368dd88dcd0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:49.643344 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-094dbce6-d0c4-4b71-aceb-3368dd88dcd0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:49.644035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-094dbce6-d0c4-4b71-aceb-3368dd88dcd0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:49.644486 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-094dbce6-d0c4-4b71-aceb-3368dd88dcd0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:49.644909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-094dbce6-d0c4-4b71-aceb-3368dd88dcd0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:49.674181 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-094dbce6-d0c4-4b71-aceb-3368dd88dcd0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044726 Aug 30 14:49:49.674726 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 433/876] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:49 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:49.716567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-85bba108-a4c5-4796-836c-40c85ebc24c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:49.718745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-85bba108-a4c5-4796-836c-40c85ebc24c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:49.725308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-85bba108-a4c5-4796-836c-40c85ebc24c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:49.725782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-85bba108-a4c5-4796-836c-40c85ebc24c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:49.726219 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-85bba108-a4c5-4796-836c-40c85ebc24c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:49.726906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-85bba108-a4c5-4796-836c-40c85ebc24c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:49.727395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-85bba108-a4c5-4796-836c-40c85ebc24c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:49.727820 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-85bba108-a4c5-4796-836c-40c85ebc24c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:49.758357 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-85bba108-a4c5-4796-836c-40c85ebc24c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045487 Aug 30 14:49:49.759009 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 444/877] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:49 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:50.686826 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-01fc55d7-12be-4007-a0db-9cf80e50bf21 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:50.688937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-01fc55d7-12be-4007-a0db-9cf80e50bf21 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:50.696068 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01fc55d7-12be-4007-a0db-9cf80e50bf21 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:50.696541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01fc55d7-12be-4007-a0db-9cf80e50bf21 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:50.696969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01fc55d7-12be-4007-a0db-9cf80e50bf21 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:50.697645 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01fc55d7-12be-4007-a0db-9cf80e50bf21 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:50.698084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01fc55d7-12be-4007-a0db-9cf80e50bf21 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:50.698497 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01fc55d7-12be-4007-a0db-9cf80e50bf21 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:50.728347 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-01fc55d7-12be-4007-a0db-9cf80e50bf21 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045542 Aug 30 14:49:50.728894 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 434/878] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:50 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:50.770856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f4a5cbd7-3661-472a-8128-b84b0c07cbcd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:50.773496 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f4a5cbd7-3661-472a-8128-b84b0c07cbcd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:50.780443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4a5cbd7-3661-472a-8128-b84b0c07cbcd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:50.780924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4a5cbd7-3661-472a-8128-b84b0c07cbcd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:50.781358 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4a5cbd7-3661-472a-8128-b84b0c07cbcd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:50.782044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4a5cbd7-3661-472a-8128-b84b0c07cbcd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:50.782488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4a5cbd7-3661-472a-8128-b84b0c07cbcd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:50.782909 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4a5cbd7-3661-472a-8128-b84b0c07cbcd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:50.811654 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f4a5cbd7-3661-472a-8128-b84b0c07cbcd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044749 Aug 30 14:49:50.812203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 445/879] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:50 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:51.740619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2af10202-5884-4963-8b07-1f4223a2ba0a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:51.743306 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2af10202-5884-4963-8b07-1f4223a2ba0a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:51.749599 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2af10202-5884-4963-8b07-1f4223a2ba0a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:51.750075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2af10202-5884-4963-8b07-1f4223a2ba0a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:51.750498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2af10202-5884-4963-8b07-1f4223a2ba0a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:51.751169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2af10202-5884-4963-8b07-1f4223a2ba0a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:51.751669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2af10202-5884-4963-8b07-1f4223a2ba0a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:51.752081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2af10202-5884-4963-8b07-1f4223a2ba0a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:51.780987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2af10202-5884-4963-8b07-1f4223a2ba0a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044395 Aug 30 14:49:51.781531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 435/880] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:51 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:51.824249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-31960bd0-a439-41eb-b317-4ba439f3f89b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:51.826442 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-31960bd0-a439-41eb-b317-4ba439f3f89b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:51.833345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-31960bd0-a439-41eb-b317-4ba439f3f89b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:51.833821 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-31960bd0-a439-41eb-b317-4ba439f3f89b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:51.834249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-31960bd0-a439-41eb-b317-4ba439f3f89b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:51.834930 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-31960bd0-a439-41eb-b317-4ba439f3f89b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:51.835416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-31960bd0-a439-41eb-b317-4ba439f3f89b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:51.835841 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-31960bd0-a439-41eb-b317-4ba439f3f89b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:51.864420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-31960bd0-a439-41eb-b317-4ba439f3f89b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044219 Aug 30 14:49:51.864959 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 446/881] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:51 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:52.793310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-eea5f0c1-6737-4c26-921c-6b3197464c45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:52.795455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-eea5f0c1-6737-4c26-921c-6b3197464c45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:52.801798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eea5f0c1-6737-4c26-921c-6b3197464c45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:52.802274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eea5f0c1-6737-4c26-921c-6b3197464c45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:52.802706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eea5f0c1-6737-4c26-921c-6b3197464c45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:52.803418 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eea5f0c1-6737-4c26-921c-6b3197464c45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:52.803986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eea5f0c1-6737-4c26-921c-6b3197464c45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:52.804495 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eea5f0c1-6737-4c26-921c-6b3197464c45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:52.836698 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-eea5f0c1-6737-4c26-921c-6b3197464c45 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047341 Aug 30 14:49:52.837272 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 436/882] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:52 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:49:52.877448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-aaec8d73-7619-47cd-b761-a01517e615c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:52.879613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-aaec8d73-7619-47cd-b761-a01517e615c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:52.886572 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aaec8d73-7619-47cd-b761-a01517e615c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:52.887052 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aaec8d73-7619-47cd-b761-a01517e615c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:52.887525 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aaec8d73-7619-47cd-b761-a01517e615c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:52.888215 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aaec8d73-7619-47cd-b761-a01517e615c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:52.888665 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aaec8d73-7619-47cd-b761-a01517e615c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:52.889086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aaec8d73-7619-47cd-b761-a01517e615c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:52.918310 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-aaec8d73-7619-47cd-b761-a01517e615c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044971 Aug 30 14:49:52.918867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 447/883] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:52 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:53.848911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8fa3a631-c863-4fb7-9bd8-5fd84bb02aee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:53.851806 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8fa3a631-c863-4fb7-9bd8-5fd84bb02aee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:53.858120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8fa3a631-c863-4fb7-9bd8-5fd84bb02aee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:53.858598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8fa3a631-c863-4fb7-9bd8-5fd84bb02aee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:53.859033 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8fa3a631-c863-4fb7-9bd8-5fd84bb02aee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:53.859774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8fa3a631-c863-4fb7-9bd8-5fd84bb02aee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:53.860221 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8fa3a631-c863-4fb7-9bd8-5fd84bb02aee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:53.860644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8fa3a631-c863-4fb7-9bd8-5fd84bb02aee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:53.890470 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8fa3a631-c863-4fb7-9bd8-5fd84bb02aee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045432 Aug 30 14:49:53.891047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 437/884] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:53 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:53.930278 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fb1b6324-6302-4fb6-903a-5875286a6b21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:53.932414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fb1b6324-6302-4fb6-903a-5875286a6b21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:53.938869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb1b6324-6302-4fb6-903a-5875286a6b21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:53.939402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb1b6324-6302-4fb6-903a-5875286a6b21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:53.939843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb1b6324-6302-4fb6-903a-5875286a6b21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:53.940536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb1b6324-6302-4fb6-903a-5875286a6b21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:53.940988 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb1b6324-6302-4fb6-903a-5875286a6b21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:53.941675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb1b6324-6302-4fb6-903a-5875286a6b21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:53.970556 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fb1b6324-6302-4fb6-903a-5875286a6b21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044558 Aug 30 14:49:53.971107 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 448/885] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:53 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:54.902939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fb3cbba8-3dfc-4ecc-9e05-01248e106f50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:54.905146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fb3cbba8-3dfc-4ecc-9e05-01248e106f50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:54.911501 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fb3cbba8-3dfc-4ecc-9e05-01248e106f50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:54.911979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fb3cbba8-3dfc-4ecc-9e05-01248e106f50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:54.912409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fb3cbba8-3dfc-4ecc-9e05-01248e106f50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:54.913692 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fb3cbba8-3dfc-4ecc-9e05-01248e106f50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:54.914242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fb3cbba8-3dfc-4ecc-9e05-01248e106f50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:54.914669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fb3cbba8-3dfc-4ecc-9e05-01248e106f50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:54.943979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fb3cbba8-3dfc-4ecc-9e05-01248e106f50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045013 Aug 30 14:49:54.944530 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 438/886] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:54 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:54.982740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c0c00329-db92-4b77-ad9d-047a7cecd174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:54.984939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c0c00329-db92-4b77-ad9d-047a7cecd174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:54.991800 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0c00329-db92-4b77-ad9d-047a7cecd174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:54.992274 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0c00329-db92-4b77-ad9d-047a7cecd174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:54.992700 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0c00329-db92-4b77-ad9d-047a7cecd174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:54.993375 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0c00329-db92-4b77-ad9d-047a7cecd174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:54.993817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0c00329-db92-4b77-ad9d-047a7cecd174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:54.994231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0c00329-db92-4b77-ad9d-047a7cecd174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:55.023504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c0c00329-db92-4b77-ad9d-047a7cecd174 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044683 Aug 30 14:49:55.024060 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 449/887] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:54 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:55.955917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fdd284f9-ef22-4c57-ad10-0a8cbf2fac23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:55.958034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fdd284f9-ef22-4c57-ad10-0a8cbf2fac23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:55.964406 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdd284f9-ef22-4c57-ad10-0a8cbf2fac23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:55.964879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdd284f9-ef22-4c57-ad10-0a8cbf2fac23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:55.965305 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdd284f9-ef22-4c57-ad10-0a8cbf2fac23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:55.965988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdd284f9-ef22-4c57-ad10-0a8cbf2fac23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:55.966436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdd284f9-ef22-4c57-ad10-0a8cbf2fac23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:55.966851 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdd284f9-ef22-4c57-ad10-0a8cbf2fac23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:55.996293 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fdd284f9-ef22-4c57-ad10-0a8cbf2fac23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044315 Aug 30 14:49:55.996836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 439/888] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:55 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:56.035737 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bb0dc42d-b777-4abe-9d6d-c46755fcb31a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:56.038018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bb0dc42d-b777-4abe-9d6d-c46755fcb31a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:56.044423 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb0dc42d-b777-4abe-9d6d-c46755fcb31a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:56.044908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb0dc42d-b777-4abe-9d6d-c46755fcb31a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:56.045343 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb0dc42d-b777-4abe-9d6d-c46755fcb31a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:56.046038 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb0dc42d-b777-4abe-9d6d-c46755fcb31a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:56.046492 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb0dc42d-b777-4abe-9d6d-c46755fcb31a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:56.046916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb0dc42d-b777-4abe-9d6d-c46755fcb31a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:56.076586 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bb0dc42d-b777-4abe-9d6d-c46755fcb31a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044913 Aug 30 14:49:56.077136 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 450/889] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:56 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:57.008806 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8b445d25-3570-4c0c-bd0f-4a498afacddd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:57.010968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8b445d25-3570-4c0c-bd0f-4a498afacddd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:57.017350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b445d25-3570-4c0c-bd0f-4a498afacddd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:57.017823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b445d25-3570-4c0c-bd0f-4a498afacddd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:57.018249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b445d25-3570-4c0c-bd0f-4a498afacddd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:57.018922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b445d25-3570-4c0c-bd0f-4a498afacddd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:57.019414 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b445d25-3570-4c0c-bd0f-4a498afacddd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:57.019830 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b445d25-3570-4c0c-bd0f-4a498afacddd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:57.023908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:49:57.049959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8b445d25-3570-4c0c-bd0f-4a498afacddd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045262 Aug 30 14:49:57.050506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 440/890] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:57 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:57.089528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1a6e6a2c-d7e2-4c4a-8f25-e4195c019997 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:57.091916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1a6e6a2c-d7e2-4c4a-8f25-e4195c019997 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:57.098233 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1a6e6a2c-d7e2-4c4a-8f25-e4195c019997 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:57.098710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1a6e6a2c-d7e2-4c4a-8f25-e4195c019997 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:57.099139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1a6e6a2c-d7e2-4c4a-8f25-e4195c019997 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:57.099856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1a6e6a2c-d7e2-4c4a-8f25-e4195c019997 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:57.100514 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1a6e6a2c-d7e2-4c4a-8f25-e4195c019997 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:57.100903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1a6e6a2c-d7e2-4c4a-8f25-e4195c019997 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:57.129462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1a6e6a2c-d7e2-4c4a-8f25-e4195c019997 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044677 Aug 30 14:49:57.130012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 451/891] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:57 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:58.062030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0b4686a0-b2cb-4523-8ea2-6ee394d780e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:58.064199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0b4686a0-b2cb-4523-8ea2-6ee394d780e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:58.070850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0b4686a0-b2cb-4523-8ea2-6ee394d780e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:58.071350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0b4686a0-b2cb-4523-8ea2-6ee394d780e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:58.071778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0b4686a0-b2cb-4523-8ea2-6ee394d780e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:58.072457 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0b4686a0-b2cb-4523-8ea2-6ee394d780e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:58.072899 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0b4686a0-b2cb-4523-8ea2-6ee394d780e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:58.073315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0b4686a0-b2cb-4523-8ea2-6ee394d780e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:58.101624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0b4686a0-b2cb-4523-8ea2-6ee394d780e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043550 Aug 30 14:49:58.102163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 441/892] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:58 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:58.142497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3ac89014-e50b-4777-b254-d2e261e7c9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:58.144590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3ac89014-e50b-4777-b254-d2e261e7c9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:58.151027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ac89014-e50b-4777-b254-d2e261e7c9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:58.151543 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ac89014-e50b-4777-b254-d2e261e7c9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:58.151981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ac89014-e50b-4777-b254-d2e261e7c9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:58.152671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ac89014-e50b-4777-b254-d2e261e7c9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:58.153123 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ac89014-e50b-4777-b254-d2e261e7c9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:58.153549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ac89014-e50b-4777-b254-d2e261e7c9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:58.183082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3ac89014-e50b-4777-b254-d2e261e7c9d0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044717 Aug 30 14:49:58.183655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 452/893] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:58 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:49:59.113491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3ba6d45a-db7b-447b-85cf-c7f67ae05138 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:59.115646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3ba6d45a-db7b-447b-85cf-c7f67ae05138 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:59.122424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ba6d45a-db7b-447b-85cf-c7f67ae05138 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:59.122906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ba6d45a-db7b-447b-85cf-c7f67ae05138 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:59.123377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ba6d45a-db7b-447b-85cf-c7f67ae05138 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:59.124065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ba6d45a-db7b-447b-85cf-c7f67ae05138 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:59.124516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ba6d45a-db7b-447b-85cf-c7f67ae05138 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:59.124940 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ba6d45a-db7b-447b-85cf-c7f67ae05138 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:59.154161 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3ba6d45a-db7b-447b-85cf-c7f67ae05138 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Aug 30 14:49:59.154644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 442/894] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:49:59 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:49:59.196400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fca5ad92-5deb-418e-95c1-40abe6686092 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:49:59.198588 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fca5ad92-5deb-418e-95c1-40abe6686092 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:49:59.204918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fca5ad92-5deb-418e-95c1-40abe6686092 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:59.205405 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fca5ad92-5deb-418e-95c1-40abe6686092 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:59.205843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fca5ad92-5deb-418e-95c1-40abe6686092 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:59.206529 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fca5ad92-5deb-418e-95c1-40abe6686092 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:49:59.206981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fca5ad92-5deb-418e-95c1-40abe6686092 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:49:59.207439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fca5ad92-5deb-418e-95c1-40abe6686092 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:49:59.237495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fca5ad92-5deb-418e-95c1-40abe6686092 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046166 Aug 30 14:49:59.238063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 453/895] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:49:59 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:00.166195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4db18842-7d8a-40b5-9b8d-37df83d2cded tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:00.168375 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4db18842-7d8a-40b5-9b8d-37df83d2cded tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:00.174685 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4db18842-7d8a-40b5-9b8d-37df83d2cded tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:00.175169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4db18842-7d8a-40b5-9b8d-37df83d2cded tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:00.175636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4db18842-7d8a-40b5-9b8d-37df83d2cded tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:00.176319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4db18842-7d8a-40b5-9b8d-37df83d2cded tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:00.176772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4db18842-7d8a-40b5-9b8d-37df83d2cded tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:00.177193 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4db18842-7d8a-40b5-9b8d-37df83d2cded tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:00.206274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4db18842-7d8a-40b5-9b8d-37df83d2cded tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044123 Aug 30 14:50:00.206824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 443/896] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:00 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:00.250084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-03481dde-b8b9-49f9-a06b-febab0fbd15c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:00.252155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-03481dde-b8b9-49f9-a06b-febab0fbd15c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:00.259231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-03481dde-b8b9-49f9-a06b-febab0fbd15c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:00.259728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-03481dde-b8b9-49f9-a06b-febab0fbd15c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:00.260154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-03481dde-b8b9-49f9-a06b-febab0fbd15c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:00.260836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-03481dde-b8b9-49f9-a06b-febab0fbd15c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:00.261281 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-03481dde-b8b9-49f9-a06b-febab0fbd15c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:00.261699 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-03481dde-b8b9-49f9-a06b-febab0fbd15c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:00.292061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-03481dde-b8b9-49f9-a06b-febab0fbd15c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045967 Aug 30 14:50:00.292605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 454/897] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:00 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:01.218148 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-426f71c8-0d6c-4e43-b4f8-5df9aaeda506 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:01.220363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-426f71c8-0d6c-4e43-b4f8-5df9aaeda506 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:01.227894 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-426f71c8-0d6c-4e43-b4f8-5df9aaeda506 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:01.228376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-426f71c8-0d6c-4e43-b4f8-5df9aaeda506 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:01.228815 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-426f71c8-0d6c-4e43-b4f8-5df9aaeda506 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:01.229506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-426f71c8-0d6c-4e43-b4f8-5df9aaeda506 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:01.229953 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-426f71c8-0d6c-4e43-b4f8-5df9aaeda506 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:01.230379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-426f71c8-0d6c-4e43-b4f8-5df9aaeda506 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:01.260101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-426f71c8-0d6c-4e43-b4f8-5df9aaeda506 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045685 Aug 30 14:50:01.260603 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 444/898] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:01 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:01.305000 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5a54784b-01b2-4fce-abf4-5bb1ec81de5c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:01.307110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5a54784b-01b2-4fce-abf4-5bb1ec81de5c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:01.313529 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a54784b-01b2-4fce-abf4-5bb1ec81de5c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:01.314002 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a54784b-01b2-4fce-abf4-5bb1ec81de5c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:01.314432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a54784b-01b2-4fce-abf4-5bb1ec81de5c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:01.315113 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a54784b-01b2-4fce-abf4-5bb1ec81de5c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:01.315584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a54784b-01b2-4fce-abf4-5bb1ec81de5c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:01.316000 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a54784b-01b2-4fce-abf4-5bb1ec81de5c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:01.345511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5a54784b-01b2-4fce-abf4-5bb1ec81de5c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045041 Aug 30 14:50:01.346056 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 455/899] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:01 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:02.272627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-86ac2b8a-73ca-44ef-b8c0-e3eb3fcede6e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:02.274782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-86ac2b8a-73ca-44ef-b8c0-e3eb3fcede6e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:02.281877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86ac2b8a-73ca-44ef-b8c0-e3eb3fcede6e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:02.282362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86ac2b8a-73ca-44ef-b8c0-e3eb3fcede6e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:02.282796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86ac2b8a-73ca-44ef-b8c0-e3eb3fcede6e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:02.283508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86ac2b8a-73ca-44ef-b8c0-e3eb3fcede6e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:02.283963 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86ac2b8a-73ca-44ef-b8c0-e3eb3fcede6e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:02.284386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86ac2b8a-73ca-44ef-b8c0-e3eb3fcede6e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:02.313884 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-86ac2b8a-73ca-44ef-b8c0-e3eb3fcede6e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045679 Aug 30 14:50:02.314440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 445/900] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:02 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:02.358590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3c6fe63e-3755-4632-bee9-d9542a7d562e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:02.360751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3c6fe63e-3755-4632-bee9-d9542a7d562e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:02.367092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c6fe63e-3755-4632-bee9-d9542a7d562e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:02.367608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c6fe63e-3755-4632-bee9-d9542a7d562e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:02.368040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c6fe63e-3755-4632-bee9-d9542a7d562e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:02.368724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c6fe63e-3755-4632-bee9-d9542a7d562e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:02.369173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c6fe63e-3755-4632-bee9-d9542a7d562e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:02.369596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c6fe63e-3755-4632-bee9-d9542a7d562e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:02.399029 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3c6fe63e-3755-4632-bee9-d9542a7d562e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044455 Aug 30 14:50:02.399606 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 456/901] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:02 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:03.326254 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cd459e03-ae12-426c-a279-05baf5d7229f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:03.328404 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cd459e03-ae12-426c-a279-05baf5d7229f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:03.330694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=58 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:03.335919 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd459e03-ae12-426c-a279-05baf5d7229f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:03.336397 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd459e03-ae12-426c-a279-05baf5d7229f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:03.336831 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd459e03-ae12-426c-a279-05baf5d7229f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:03.337512 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd459e03-ae12-426c-a279-05baf5d7229f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:03.337960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd459e03-ae12-426c-a279-05baf5d7229f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:03.338378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd459e03-ae12-426c-a279-05baf5d7229f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:03.368076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cd459e03-ae12-426c-a279-05baf5d7229f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Aug 30 14:50:03.368632 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 446/902] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:03 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:03.411312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7f1ebc6f-1b62-4ffe-8f09-1d7d130c6808 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:03.414105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7f1ebc6f-1b62-4ffe-8f09-1d7d130c6808 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:03.420427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f1ebc6f-1b62-4ffe-8f09-1d7d130c6808 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:03.420915 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f1ebc6f-1b62-4ffe-8f09-1d7d130c6808 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:03.421352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f1ebc6f-1b62-4ffe-8f09-1d7d130c6808 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:03.422044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f1ebc6f-1b62-4ffe-8f09-1d7d130c6808 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:03.422495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f1ebc6f-1b62-4ffe-8f09-1d7d130c6808 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:03.422919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f1ebc6f-1b62-4ffe-8f09-1d7d130c6808 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:03.452789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7f1ebc6f-1b62-4ffe-8f09-1d7d130c6808 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045527 Aug 30 14:50:03.453348 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 457/903] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:03 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:04.380112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-df496a25-45fa-476f-a128-31e494a2c00e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:04.383464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-df496a25-45fa-476f-a128-31e494a2c00e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:04.389738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df496a25-45fa-476f-a128-31e494a2c00e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:04.390212 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df496a25-45fa-476f-a128-31e494a2c00e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:04.390639 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df496a25-45fa-476f-a128-31e494a2c00e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:04.391343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df496a25-45fa-476f-a128-31e494a2c00e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:04.391788 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df496a25-45fa-476f-a128-31e494a2c00e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:04.392202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df496a25-45fa-476f-a128-31e494a2c00e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:04.421773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-df496a25-45fa-476f-a128-31e494a2c00e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045548 Aug 30 14:50:04.422555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 447/904] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:04 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:04.465198 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-38e529b3-2bc7-4641-8c49-6257f88e472d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:04.467254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-38e529b3-2bc7-4641-8c49-6257f88e472d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:04.469536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=58 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:04.474567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-38e529b3-2bc7-4641-8c49-6257f88e472d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:04.475169 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-38e529b3-2bc7-4641-8c49-6257f88e472d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:04.475702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-38e529b3-2bc7-4641-8c49-6257f88e472d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:04.476416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-38e529b3-2bc7-4641-8c49-6257f88e472d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:04.476849 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-38e529b3-2bc7-4641-8c49-6257f88e472d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:04.477266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-38e529b3-2bc7-4641-8c49-6257f88e472d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:04.507420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-38e529b3-2bc7-4641-8c49-6257f88e472d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045377 Aug 30 14:50:04.507969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 458/905] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:04 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:05.433314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-77d68b7c-dfd5-4d28-84e7-763963b06f5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:05.435547 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-77d68b7c-dfd5-4d28-84e7-763963b06f5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:05.442426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77d68b7c-dfd5-4d28-84e7-763963b06f5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:05.442900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77d68b7c-dfd5-4d28-84e7-763963b06f5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:05.443363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77d68b7c-dfd5-4d28-84e7-763963b06f5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:05.444594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77d68b7c-dfd5-4d28-84e7-763963b06f5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:05.445184 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77d68b7c-dfd5-4d28-84e7-763963b06f5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:05.445553 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77d68b7c-dfd5-4d28-84e7-763963b06f5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:05.475695 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-77d68b7c-dfd5-4d28-84e7-763963b06f5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046011 Aug 30 14:50:05.476221 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 448/906] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:05 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:05.519759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fec82ddf-1266-473c-acf0-7207ec426bb3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:05.521929 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fec82ddf-1266-473c-acf0-7207ec426bb3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:05.529029 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fec82ddf-1266-473c-acf0-7207ec426bb3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:05.529542 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fec82ddf-1266-473c-acf0-7207ec426bb3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:05.529983 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fec82ddf-1266-473c-acf0-7207ec426bb3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:05.530676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fec82ddf-1266-473c-acf0-7207ec426bb3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:05.531129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fec82ddf-1266-473c-acf0-7207ec426bb3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:05.531583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fec82ddf-1266-473c-acf0-7207ec426bb3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:05.560893 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fec82ddf-1266-473c-acf0-7207ec426bb3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045178 Aug 30 14:50:05.561446 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 459/907] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:05 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:06.487996 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5a985c0f-5049-4bd7-bb73-8960e0e44f85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:06.490058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5a985c0f-5049-4bd7-bb73-8960e0e44f85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:06.496450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a985c0f-5049-4bd7-bb73-8960e0e44f85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:06.496933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a985c0f-5049-4bd7-bb73-8960e0e44f85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:06.497377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a985c0f-5049-4bd7-bb73-8960e0e44f85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:06.498063 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a985c0f-5049-4bd7-bb73-8960e0e44f85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:06.498516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a985c0f-5049-4bd7-bb73-8960e0e44f85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:06.498940 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a985c0f-5049-4bd7-bb73-8960e0e44f85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:06.528525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5a985c0f-5049-4bd7-bb73-8960e0e44f85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044532 Aug 30 14:50:06.529104 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 449/908] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:06 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:06.573354 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-30e95565-1fd0-4162-8df7-3ca6d4186edd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:06.575498 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-30e95565-1fd0-4162-8df7-3ca6d4186edd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:06.581764 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-30e95565-1fd0-4162-8df7-3ca6d4186edd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:06.582244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-30e95565-1fd0-4162-8df7-3ca6d4186edd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:06.582671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-30e95565-1fd0-4162-8df7-3ca6d4186edd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:06.583377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-30e95565-1fd0-4162-8df7-3ca6d4186edd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:06.583823 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-30e95565-1fd0-4162-8df7-3ca6d4186edd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:06.584239 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-30e95565-1fd0-4162-8df7-3ca6d4186edd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:06.601688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:06.615409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-30e95565-1fd0-4162-8df7-3ca6d4186edd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046071 Aug 30 14:50:06.616048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 460/909] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:06 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:07.541816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7068a181-f95a-4413-8533-1477ad75f100 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:07.543969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7068a181-f95a-4413-8533-1477ad75f100 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:07.550364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7068a181-f95a-4413-8533-1477ad75f100 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:07.550876 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7068a181-f95a-4413-8533-1477ad75f100 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:07.551346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7068a181-f95a-4413-8533-1477ad75f100 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:07.552069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7068a181-f95a-4413-8533-1477ad75f100 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:07.552520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7068a181-f95a-4413-8533-1477ad75f100 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:07.552945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7068a181-f95a-4413-8533-1477ad75f100 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:07.582181 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7068a181-f95a-4413-8533-1477ad75f100 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044988 Aug 30 14:50:07.582731 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 450/910] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:07 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:07.627121 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0e78517b-add4-49fe-9573-83a181e8ddb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:07.629275 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0e78517b-add4-49fe-9573-83a181e8ddb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:07.636467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e78517b-add4-49fe-9573-83a181e8ddb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:07.636943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e78517b-add4-49fe-9573-83a181e8ddb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:07.637367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e78517b-add4-49fe-9573-83a181e8ddb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:07.638047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e78517b-add4-49fe-9573-83a181e8ddb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:07.638486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e78517b-add4-49fe-9573-83a181e8ddb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:07.638902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e78517b-add4-49fe-9573-83a181e8ddb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:07.668396 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0e78517b-add4-49fe-9573-83a181e8ddb0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045295 Aug 30 14:50:07.668941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 461/911] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:07 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:08.594953 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-39317d51-02ac-43c9-917f-7b3b64d0ccd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:08.597156 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-39317d51-02ac-43c9-917f-7b3b64d0ccd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:08.603474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39317d51-02ac-43c9-917f-7b3b64d0ccd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:08.603956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39317d51-02ac-43c9-917f-7b3b64d0ccd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:08.604387 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39317d51-02ac-43c9-917f-7b3b64d0ccd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:08.605093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39317d51-02ac-43c9-917f-7b3b64d0ccd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:08.605566 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39317d51-02ac-43c9-917f-7b3b64d0ccd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:08.605971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-39317d51-02ac-43c9-917f-7b3b64d0ccd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:08.634929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-39317d51-02ac-43c9-917f-7b3b64d0ccd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043918 Aug 30 14:50:08.635513 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 451/912] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:08 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:08.681356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-21ac2fae-0a23-4c54-9fe3-ab861a03534c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:08.683479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-21ac2fae-0a23-4c54-9fe3-ab861a03534c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:08.689806 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-21ac2fae-0a23-4c54-9fe3-ab861a03534c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:08.690284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-21ac2fae-0a23-4c54-9fe3-ab861a03534c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:08.690712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-21ac2fae-0a23-4c54-9fe3-ab861a03534c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:08.691714 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-21ac2fae-0a23-4c54-9fe3-ab861a03534c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:08.692155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-21ac2fae-0a23-4c54-9fe3-ab861a03534c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:08.692571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-21ac2fae-0a23-4c54-9fe3-ab861a03534c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:08.722318 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-21ac2fae-0a23-4c54-9fe3-ab861a03534c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045620 Aug 30 14:50:08.722796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 462/913] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:08 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:09.646409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2f25a8c5-2c91-491e-bb47-7a5e74594fba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:09.649227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2f25a8c5-2c91-491e-bb47-7a5e74594fba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:09.661498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f25a8c5-2c91-491e-bb47-7a5e74594fba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:09.661961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f25a8c5-2c91-491e-bb47-7a5e74594fba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:09.662387 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f25a8c5-2c91-491e-bb47-7a5e74594fba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:09.663108 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f25a8c5-2c91-491e-bb47-7a5e74594fba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:09.663575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f25a8c5-2c91-491e-bb47-7a5e74594fba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:09.663996 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f25a8c5-2c91-491e-bb47-7a5e74594fba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:09.693944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2f25a8c5-2c91-491e-bb47-7a5e74594fba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051338 Aug 30 14:50:09.694500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 452/914] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:09 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:09.733974 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0a20a899-ed57-4138-9020-c86b487c69fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:09.736283 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0a20a899-ed57-4138-9020-c86b487c69fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:09.742789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a20a899-ed57-4138-9020-c86b487c69fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:09.743304 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a20a899-ed57-4138-9020-c86b487c69fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:09.743739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a20a899-ed57-4138-9020-c86b487c69fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:09.744434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a20a899-ed57-4138-9020-c86b487c69fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:09.744891 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a20a899-ed57-4138-9020-c86b487c69fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:09.745314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a20a899-ed57-4138-9020-c86b487c69fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:09.776394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0a20a899-ed57-4138-9020-c86b487c69fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046250 Aug 30 14:50:09.776871 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 463/915] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:09 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:10.705829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-36e6771e-aea4-451f-965d-75f9a6c953be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:10.707984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-36e6771e-aea4-451f-965d-75f9a6c953be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:10.714926 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36e6771e-aea4-451f-965d-75f9a6c953be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:10.715451 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36e6771e-aea4-451f-965d-75f9a6c953be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:10.715884 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36e6771e-aea4-451f-965d-75f9a6c953be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:10.716569 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36e6771e-aea4-451f-965d-75f9a6c953be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:10.717015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36e6771e-aea4-451f-965d-75f9a6c953be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:10.717435 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36e6771e-aea4-451f-965d-75f9a6c953be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:10.746939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-36e6771e-aea4-451f-965d-75f9a6c953be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044975 Aug 30 14:50:10.747531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 453/916] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:10 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:10.788875 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-02ae310d-93f0-429e-be7d-354bc13588bb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:10.791184 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-02ae310d-93f0-429e-be7d-354bc13588bb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:10.797528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-02ae310d-93f0-429e-be7d-354bc13588bb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:10.798007 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-02ae310d-93f0-429e-be7d-354bc13588bb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:10.798439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-02ae310d-93f0-429e-be7d-354bc13588bb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:10.799127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-02ae310d-93f0-429e-be7d-354bc13588bb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:10.799606 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-02ae310d-93f0-429e-be7d-354bc13588bb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:10.800080 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-02ae310d-93f0-429e-be7d-354bc13588bb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:10.829263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-02ae310d-93f0-429e-be7d-354bc13588bb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044492 Aug 30 14:50:10.829812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 464/917] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:10 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:11.759141 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2b24b933-3dae-407d-afa5-474c1ae290b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:11.761228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2b24b933-3dae-407d-afa5-474c1ae290b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:11.767710 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2b24b933-3dae-407d-afa5-474c1ae290b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:11.768211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2b24b933-3dae-407d-afa5-474c1ae290b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:11.768611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2b24b933-3dae-407d-afa5-474c1ae290b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:11.769291 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2b24b933-3dae-407d-afa5-474c1ae290b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:11.769737 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2b24b933-3dae-407d-afa5-474c1ae290b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:11.770155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2b24b933-3dae-407d-afa5-474c1ae290b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:11.799694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2b24b933-3dae-407d-afa5-474c1ae290b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044517 Aug 30 14:50:11.800245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 454/918] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:11 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:11.841653 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-75379a3b-bfae-461d-a7ff-29aca6c1d24f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:11.843786 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-75379a3b-bfae-461d-a7ff-29aca6c1d24f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:11.850131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75379a3b-bfae-461d-a7ff-29aca6c1d24f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:11.851186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75379a3b-bfae-461d-a7ff-29aca6c1d24f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:11.851710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75379a3b-bfae-461d-a7ff-29aca6c1d24f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:11.852395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75379a3b-bfae-461d-a7ff-29aca6c1d24f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:11.852844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75379a3b-bfae-461d-a7ff-29aca6c1d24f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:11.853266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75379a3b-bfae-461d-a7ff-29aca6c1d24f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:11.882155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-75379a3b-bfae-461d-a7ff-29aca6c1d24f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044460 Aug 30 14:50:11.882709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 465/919] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:11 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:12.811902 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9c5a26fb-d776-4a62-9a26-b47bfcfd8a49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:12.814065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9c5a26fb-d776-4a62-9a26-b47bfcfd8a49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:12.820765 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c5a26fb-d776-4a62-9a26-b47bfcfd8a49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:12.821240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c5a26fb-d776-4a62-9a26-b47bfcfd8a49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:12.821672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c5a26fb-d776-4a62-9a26-b47bfcfd8a49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:12.822354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c5a26fb-d776-4a62-9a26-b47bfcfd8a49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:12.822805 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c5a26fb-d776-4a62-9a26-b47bfcfd8a49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:12.823250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c5a26fb-d776-4a62-9a26-b47bfcfd8a49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:12.851911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9c5a26fb-d776-4a62-9a26-b47bfcfd8a49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043927 Aug 30 14:50:12.852475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 455/920] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:12 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:12.893875 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5fe75132-9c0b-47ca-beb8-983098b52c23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:12.896021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5fe75132-9c0b-47ca-beb8-983098b52c23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:12.902876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fe75132-9c0b-47ca-beb8-983098b52c23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:12.903342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fe75132-9c0b-47ca-beb8-983098b52c23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:12.903783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fe75132-9c0b-47ca-beb8-983098b52c23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:12.904504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fe75132-9c0b-47ca-beb8-983098b52c23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:12.904956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fe75132-9c0b-47ca-beb8-983098b52c23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:12.905410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fe75132-9c0b-47ca-beb8-983098b52c23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:12.935709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5fe75132-9c0b-47ca-beb8-983098b52c23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045709 Aug 30 14:50:12.936279 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 466/921] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:12 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:13.863912 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2247fe7b-79ab-49e8-bacb-3484345eb359 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:13.866715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2247fe7b-79ab-49e8-bacb-3484345eb359 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:13.872974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2247fe7b-79ab-49e8-bacb-3484345eb359 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:13.873455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2247fe7b-79ab-49e8-bacb-3484345eb359 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:13.873884 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2247fe7b-79ab-49e8-bacb-3484345eb359 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:13.874565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2247fe7b-79ab-49e8-bacb-3484345eb359 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:13.875011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2247fe7b-79ab-49e8-bacb-3484345eb359 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:13.875453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2247fe7b-79ab-49e8-bacb-3484345eb359 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:13.900401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:13.905698 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2247fe7b-79ab-49e8-bacb-3484345eb359 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045695 Aug 30 14:50:13.906290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 456/922] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:13 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:13.948714 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-75c98e0e-923d-42fe-8805-8694427a8ca1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:13.950818 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-75c98e0e-923d-42fe-8805-8694427a8ca1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:13.956703 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75c98e0e-923d-42fe-8805-8694427a8ca1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:13.957124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75c98e0e-923d-42fe-8805-8694427a8ca1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:13.957559 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75c98e0e-923d-42fe-8805-8694427a8ca1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:13.958246 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75c98e0e-923d-42fe-8805-8694427a8ca1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:13.958694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75c98e0e-923d-42fe-8805-8694427a8ca1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:13.959115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-75c98e0e-923d-42fe-8805-8694427a8ca1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:13.988754 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-75c98e0e-923d-42fe-8805-8694427a8ca1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044582 Aug 30 14:50:13.989308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 467/923] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:13 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:14.918271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ac0f285d-d937-4459-ae12-b47dc3a15ef3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:14.920460 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ac0f285d-d937-4459-ae12-b47dc3a15ef3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:14.931514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac0f285d-d937-4459-ae12-b47dc3a15ef3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:14.932005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac0f285d-d937-4459-ae12-b47dc3a15ef3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:14.932443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac0f285d-d937-4459-ae12-b47dc3a15ef3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:14.933823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac0f285d-d937-4459-ae12-b47dc3a15ef3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:14.934292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac0f285d-d937-4459-ae12-b47dc3a15ef3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:14.934718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac0f285d-d937-4459-ae12-b47dc3a15ef3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:14.966658 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ac0f285d-d937-4459-ae12-b47dc3a15ef3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052291 Aug 30 14:50:14.967261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 457/924] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:14 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:15.002057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ad46bbbe-f1ee-443d-90e2-f6bd6a6fad5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:15.004337 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ad46bbbe-f1ee-443d-90e2-f6bd6a6fad5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:15.011200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ad46bbbe-f1ee-443d-90e2-f6bd6a6fad5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:15.011638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ad46bbbe-f1ee-443d-90e2-f6bd6a6fad5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:15.012069 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ad46bbbe-f1ee-443d-90e2-f6bd6a6fad5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:15.012801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ad46bbbe-f1ee-443d-90e2-f6bd6a6fad5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:15.013533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ad46bbbe-f1ee-443d-90e2-f6bd6a6fad5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:15.014294 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ad46bbbe-f1ee-443d-90e2-f6bd6a6fad5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:15.045051 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ad46bbbe-f1ee-443d-90e2-f6bd6a6fad5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047649 Aug 30 14:50:15.045609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 468/925] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:14 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:15.978708 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-deeb5084-dc1f-4f31-8249-9681b909a87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:15.980821 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-deeb5084-dc1f-4f31-8249-9681b909a87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:15.987157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-deeb5084-dc1f-4f31-8249-9681b909a87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:15.987661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-deeb5084-dc1f-4f31-8249-9681b909a87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:15.988085 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-deeb5084-dc1f-4f31-8249-9681b909a87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:15.988785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-deeb5084-dc1f-4f31-8249-9681b909a87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:15.989228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-deeb5084-dc1f-4f31-8249-9681b909a87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:15.989642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-deeb5084-dc1f-4f31-8249-9681b909a87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:16.018281 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-deeb5084-dc1f-4f31-8249-9681b909a87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043462 Aug 30 14:50:16.018826 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 458/926] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:15 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:16.056602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-81732764-ebee-485c-83a1-ac9df6dce334 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:16.058726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-81732764-ebee-485c-83a1-ac9df6dce334 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:16.065044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81732764-ebee-485c-83a1-ac9df6dce334 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:16.065531 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81732764-ebee-485c-83a1-ac9df6dce334 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:16.065965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81732764-ebee-485c-83a1-ac9df6dce334 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:16.066918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81732764-ebee-485c-83a1-ac9df6dce334 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:16.067404 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81732764-ebee-485c-83a1-ac9df6dce334 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:16.067833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81732764-ebee-485c-83a1-ac9df6dce334 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:16.097270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-81732764-ebee-485c-83a1-ac9df6dce334 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044582 Aug 30 14:50:16.097764 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 469/927] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:16 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:17.030897 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bcca6392-1e0b-423d-994f-4d714fc5417b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:17.033076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bcca6392-1e0b-423d-994f-4d714fc5417b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:17.040153 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bcca6392-1e0b-423d-994f-4d714fc5417b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:17.040627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bcca6392-1e0b-423d-994f-4d714fc5417b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:17.041052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bcca6392-1e0b-423d-994f-4d714fc5417b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:17.041727 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bcca6392-1e0b-423d-994f-4d714fc5417b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:17.042172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bcca6392-1e0b-423d-994f-4d714fc5417b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:17.042595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bcca6392-1e0b-423d-994f-4d714fc5417b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:17.071330 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bcca6392-1e0b-423d-994f-4d714fc5417b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Aug 30 14:50:17.071892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 459/928] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:17 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:17.108886 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2bd5ba8d-fa11-4ddb-974c-f0ab9b03565b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:17.110977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2bd5ba8d-fa11-4ddb-974c-f0ab9b03565b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:17.117375 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bd5ba8d-fa11-4ddb-974c-f0ab9b03565b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:17.117846 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bd5ba8d-fa11-4ddb-974c-f0ab9b03565b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:17.118268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bd5ba8d-fa11-4ddb-974c-f0ab9b03565b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:17.118944 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bd5ba8d-fa11-4ddb-974c-f0ab9b03565b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:17.119416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bd5ba8d-fa11-4ddb-974c-f0ab9b03565b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:17.119832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bd5ba8d-fa11-4ddb-974c-f0ab9b03565b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:17.148553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2bd5ba8d-fa11-4ddb-974c-f0ab9b03565b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043489 Aug 30 14:50:17.149030 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 470/929] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:17 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:18.083340 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-53c9125e-12d4-4830-8dbd-2d23ccc39692 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:18.085476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-53c9125e-12d4-4830-8dbd-2d23ccc39692 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:18.091764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53c9125e-12d4-4830-8dbd-2d23ccc39692 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:18.092240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53c9125e-12d4-4830-8dbd-2d23ccc39692 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:18.092670 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53c9125e-12d4-4830-8dbd-2d23ccc39692 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:18.093347 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53c9125e-12d4-4830-8dbd-2d23ccc39692 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:18.093796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53c9125e-12d4-4830-8dbd-2d23ccc39692 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:18.094217 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53c9125e-12d4-4830-8dbd-2d23ccc39692 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:18.123678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-53c9125e-12d4-4830-8dbd-2d23ccc39692 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044342 Aug 30 14:50:18.124222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 460/930] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:18 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:18.160781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-adb723d9-7165-4a5f-b214-917cfa97ef87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:18.163578 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-adb723d9-7165-4a5f-b214-917cfa97ef87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:18.169954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-adb723d9-7165-4a5f-b214-917cfa97ef87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:18.170439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-adb723d9-7165-4a5f-b214-917cfa97ef87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:18.170872 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-adb723d9-7165-4a5f-b214-917cfa97ef87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:18.171672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-adb723d9-7165-4a5f-b214-917cfa97ef87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:18.172128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-adb723d9-7165-4a5f-b214-917cfa97ef87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:18.172604 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-adb723d9-7165-4a5f-b214-917cfa97ef87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:18.201675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-adb723d9-7165-4a5f-b214-917cfa97ef87 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044887 Aug 30 14:50:18.202229 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 471/931] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:18 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:19.136164 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a8c1d95e-7ec8-4105-8861-46a4cd343152 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:19.138276 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a8c1d95e-7ec8-4105-8861-46a4cd343152 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:19.144683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c1d95e-7ec8-4105-8861-46a4cd343152 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:19.145165 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c1d95e-7ec8-4105-8861-46a4cd343152 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:19.145597 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c1d95e-7ec8-4105-8861-46a4cd343152 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:19.146274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c1d95e-7ec8-4105-8861-46a4cd343152 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:19.146723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c1d95e-7ec8-4105-8861-46a4cd343152 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:19.147920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c1d95e-7ec8-4105-8861-46a4cd343152 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:19.177019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a8c1d95e-7ec8-4105-8861-46a4cd343152 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045294 Aug 30 14:50:19.177516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 461/932] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:19 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:19.214410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b1603351-e34c-4931-a7bc-054efce2a3f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:19.216562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b1603351-e34c-4931-a7bc-054efce2a3f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:19.222964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b1603351-e34c-4931-a7bc-054efce2a3f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:19.223468 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b1603351-e34c-4931-a7bc-054efce2a3f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:19.223903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b1603351-e34c-4931-a7bc-054efce2a3f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:19.224593 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b1603351-e34c-4931-a7bc-054efce2a3f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:19.225044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b1603351-e34c-4931-a7bc-054efce2a3f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:19.225529 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b1603351-e34c-4931-a7bc-054efce2a3f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:19.254695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b1603351-e34c-4931-a7bc-054efce2a3f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044214 Aug 30 14:50:19.255259 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 472/933] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:19 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:20.189796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5baee50d-17cd-406e-afd4-9ffe8d3131b6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:20.192191 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5baee50d-17cd-406e-afd4-9ffe8d3131b6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:20.198061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5baee50d-17cd-406e-afd4-9ffe8d3131b6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:20.198539 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5baee50d-17cd-406e-afd4-9ffe8d3131b6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:20.198969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5baee50d-17cd-406e-afd4-9ffe8d3131b6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:20.199682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5baee50d-17cd-406e-afd4-9ffe8d3131b6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:20.200134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5baee50d-17cd-406e-afd4-9ffe8d3131b6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:20.200558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5baee50d-17cd-406e-afd4-9ffe8d3131b6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:20.230746 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5baee50d-17cd-406e-afd4-9ffe8d3131b6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045030 Aug 30 14:50:20.231335 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 462/934] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:20 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:20.267005 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e6c77e8e-ebe0-4874-8338-13857506aef7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:20.269189 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e6c77e8e-ebe0-4874-8338-13857506aef7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:20.275986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e6c77e8e-ebe0-4874-8338-13857506aef7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:20.276463 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e6c77e8e-ebe0-4874-8338-13857506aef7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:20.276892 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e6c77e8e-ebe0-4874-8338-13857506aef7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:20.277577 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e6c77e8e-ebe0-4874-8338-13857506aef7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:20.278027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e6c77e8e-ebe0-4874-8338-13857506aef7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:20.278444 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e6c77e8e-ebe0-4874-8338-13857506aef7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:20.307616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e6c77e8e-ebe0-4874-8338-13857506aef7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044492 Aug 30 14:50:20.308161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 473/935] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:20 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:21.243802 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-40080ac1-9b96-482f-a115-78407cf15ab9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:21.245960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-40080ac1-9b96-482f-a115-78407cf15ab9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:21.252318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40080ac1-9b96-482f-a115-78407cf15ab9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:21.252804 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40080ac1-9b96-482f-a115-78407cf15ab9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:21.253243 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40080ac1-9b96-482f-a115-78407cf15ab9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:21.253929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40080ac1-9b96-482f-a115-78407cf15ab9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:21.254384 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40080ac1-9b96-482f-a115-78407cf15ab9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:21.254802 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40080ac1-9b96-482f-a115-78407cf15ab9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:21.285450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-40080ac1-9b96-482f-a115-78407cf15ab9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046359 Aug 30 14:50:21.286008 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 463/936] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:21 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:21.320294 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6b63070b-6ad0-4525-8b22-9b1c5a2a7abd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:21.322401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6b63070b-6ad0-4525-8b22-9b1c5a2a7abd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:21.328695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6b63070b-6ad0-4525-8b22-9b1c5a2a7abd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:21.329178 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6b63070b-6ad0-4525-8b22-9b1c5a2a7abd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:21.329612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6b63070b-6ad0-4525-8b22-9b1c5a2a7abd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:21.330300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6b63070b-6ad0-4525-8b22-9b1c5a2a7abd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:21.330746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6b63070b-6ad0-4525-8b22-9b1c5a2a7abd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:21.331163 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6b63070b-6ad0-4525-8b22-9b1c5a2a7abd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:21.359732 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6b63070b-6ad0-4525-8b22-9b1c5a2a7abd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043854 Aug 30 14:50:21.360275 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 474/937] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:21 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:22.298047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-204534db-854c-4f1d-9355-deb09a82b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:22.300326 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-204534db-854c-4f1d-9355-deb09a82b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:22.307337 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-204534db-854c-4f1d-9355-deb09a82b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:22.307817 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-204534db-854c-4f1d-9355-deb09a82b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:22.308249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-204534db-854c-4f1d-9355-deb09a82b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:22.308929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-204534db-854c-4f1d-9355-deb09a82b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:22.309379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-204534db-854c-4f1d-9355-deb09a82b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:22.309794 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-204534db-854c-4f1d-9355-deb09a82b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:22.339059 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-204534db-854c-4f1d-9355-deb09a82b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044884 Aug 30 14:50:22.339638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 464/938] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:22 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:22.372547 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e877e684-74e3-4215-87c3-52141b3882f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:22.374657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e877e684-74e3-4215-87c3-52141b3882f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:22.381067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e877e684-74e3-4215-87c3-52141b3882f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:22.382210 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e877e684-74e3-4215-87c3-52141b3882f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:22.382836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e877e684-74e3-4215-87c3-52141b3882f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:22.383567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e877e684-74e3-4215-87c3-52141b3882f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:22.384019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e877e684-74e3-4215-87c3-52141b3882f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:22.384441 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e877e684-74e3-4215-87c3-52141b3882f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:22.413202 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e877e684-74e3-4215-87c3-52141b3882f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044579 Aug 30 14:50:22.413682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 475/939] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:22 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:23.352170 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-66bc5ed9-b4e6-445d-b6e2-902fe9a0f102 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:23.354381 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-66bc5ed9-b4e6-445d-b6e2-902fe9a0f102 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:23.360698 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66bc5ed9-b4e6-445d-b6e2-902fe9a0f102 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:23.361180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66bc5ed9-b4e6-445d-b6e2-902fe9a0f102 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:23.361614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66bc5ed9-b4e6-445d-b6e2-902fe9a0f102 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:23.362332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66bc5ed9-b4e6-445d-b6e2-902fe9a0f102 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:23.362780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66bc5ed9-b4e6-445d-b6e2-902fe9a0f102 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:23.363198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66bc5ed9-b4e6-445d-b6e2-902fe9a0f102 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:23.392246 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-66bc5ed9-b4e6-445d-b6e2-902fe9a0f102 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044231 Aug 30 14:50:23.392800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 465/940] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:23 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:23.425276 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d8c427d2-1acd-4f5f-9d5a-8d5335e5d293 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:23.427405 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d8c427d2-1acd-4f5f-9d5a-8d5335e5d293 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:23.433697 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8c427d2-1acd-4f5f-9d5a-8d5335e5d293 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:23.434169 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8c427d2-1acd-4f5f-9d5a-8d5335e5d293 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:23.434593 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8c427d2-1acd-4f5f-9d5a-8d5335e5d293 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:23.435298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8c427d2-1acd-4f5f-9d5a-8d5335e5d293 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:23.435744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8c427d2-1acd-4f5f-9d5a-8d5335e5d293 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:23.436160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8c427d2-1acd-4f5f-9d5a-8d5335e5d293 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:23.465626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d8c427d2-1acd-4f5f-9d5a-8d5335e5d293 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044244 Aug 30 14:50:23.466095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 476/941] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:23 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:24.405436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1d4ff0ee-19a2-44d6-8165-82768cb8bd8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:24.407623 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1d4ff0ee-19a2-44d6-8165-82768cb8bd8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:24.414731 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d4ff0ee-19a2-44d6-8165-82768cb8bd8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:24.415236 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d4ff0ee-19a2-44d6-8165-82768cb8bd8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:24.415665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d4ff0ee-19a2-44d6-8165-82768cb8bd8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:24.416349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d4ff0ee-19a2-44d6-8165-82768cb8bd8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:24.416798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d4ff0ee-19a2-44d6-8165-82768cb8bd8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:24.417219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d4ff0ee-19a2-44d6-8165-82768cb8bd8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:24.447023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1d4ff0ee-19a2-44d6-8165-82768cb8bd8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045509 Aug 30 14:50:24.447612 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 466/942] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:24 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:50:24.478430 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e4b41aad-7e92-4ae3-a4db-979e3a622fb6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:24.480496 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e4b41aad-7e92-4ae3-a4db-979e3a622fb6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:24.486819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e4b41aad-7e92-4ae3-a4db-979e3a622fb6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:24.487415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e4b41aad-7e92-4ae3-a4db-979e3a622fb6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:24.487759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e4b41aad-7e92-4ae3-a4db-979e3a622fb6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:24.488437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e4b41aad-7e92-4ae3-a4db-979e3a622fb6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:24.488880 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e4b41aad-7e92-4ae3-a4db-979e3a622fb6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:24.489294 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e4b41aad-7e92-4ae3-a4db-979e3a622fb6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:24.493538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:24.518823 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e4b41aad-7e92-4ae3-a4db-979e3a622fb6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045049 Aug 30 14:50:24.519429 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 477/943] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:24 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:25.458814 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a4ecdc4e-4ac3-4066-889a-381fa69be7d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:25.461220 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a4ecdc4e-4ac3-4066-889a-381fa69be7d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:25.467540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4ecdc4e-4ac3-4066-889a-381fa69be7d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:25.467952 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4ecdc4e-4ac3-4066-889a-381fa69be7d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:25.468427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4ecdc4e-4ac3-4066-889a-381fa69be7d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:25.469065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4ecdc4e-4ac3-4066-889a-381fa69be7d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:25.469712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4ecdc4e-4ac3-4066-889a-381fa69be7d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:25.470130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4ecdc4e-4ac3-4066-889a-381fa69be7d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:25.503312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a4ecdc4e-4ac3-4066-889a-381fa69be7d4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048372 Aug 30 14:50:25.504004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 467/944] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:25 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:25.532000 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6e44f732-11a9-4644-8465-2b20134e3bce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:25.534147 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6e44f732-11a9-4644-8465-2b20134e3bce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:25.541024 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e44f732-11a9-4644-8465-2b20134e3bce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:25.541508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e44f732-11a9-4644-8465-2b20134e3bce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:25.541942 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e44f732-11a9-4644-8465-2b20134e3bce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:25.542629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e44f732-11a9-4644-8465-2b20134e3bce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:25.543080 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e44f732-11a9-4644-8465-2b20134e3bce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:25.543547 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e44f732-11a9-4644-8465-2b20134e3bce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:25.573266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6e44f732-11a9-4644-8465-2b20134e3bce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045284 Aug 30 14:50:25.573820 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 478/945] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:25 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:26.515891 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ca08bad6-5d0e-4d53-bf82-0dab2d25f93f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:26.517958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ca08bad6-5d0e-4d53-bf82-0dab2d25f93f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:26.525265 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca08bad6-5d0e-4d53-bf82-0dab2d25f93f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:26.525735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca08bad6-5d0e-4d53-bf82-0dab2d25f93f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:26.526165 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca08bad6-5d0e-4d53-bf82-0dab2d25f93f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:26.526842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca08bad6-5d0e-4d53-bf82-0dab2d25f93f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:26.527314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca08bad6-5d0e-4d53-bf82-0dab2d25f93f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:26.527730 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca08bad6-5d0e-4d53-bf82-0dab2d25f93f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:26.556708 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ca08bad6-5d0e-4d53-bf82-0dab2d25f93f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Aug 30 14:50:26.557259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 468/946] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:26 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:26.585409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d84c5ce1-979c-420e-8b5f-068e61628ce8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:26.588163 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d84c5ce1-979c-420e-8b5f-068e61628ce8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:26.594584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d84c5ce1-979c-420e-8b5f-068e61628ce8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:26.595058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d84c5ce1-979c-420e-8b5f-068e61628ce8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:26.595536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d84c5ce1-979c-420e-8b5f-068e61628ce8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:26.596214 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d84c5ce1-979c-420e-8b5f-068e61628ce8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:26.596658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d84c5ce1-979c-420e-8b5f-068e61628ce8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:26.597072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d84c5ce1-979c-420e-8b5f-068e61628ce8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:26.626088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d84c5ce1-979c-420e-8b5f-068e61628ce8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044600 Aug 30 14:50:26.626638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 479/947] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:26 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:27.569151 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e7446334-1978-4b92-a6bc-fc01a5755c83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:27.571475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e7446334-1978-4b92-a6bc-fc01a5755c83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:27.577785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7446334-1978-4b92-a6bc-fc01a5755c83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:27.578259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7446334-1978-4b92-a6bc-fc01a5755c83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:27.578688 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7446334-1978-4b92-a6bc-fc01a5755c83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:27.579437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7446334-1978-4b92-a6bc-fc01a5755c83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:27.579890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7446334-1978-4b92-a6bc-fc01a5755c83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:27.580311 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7446334-1978-4b92-a6bc-fc01a5755c83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:27.610925 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e7446334-1978-4b92-a6bc-fc01a5755c83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045937 Aug 30 14:50:27.611538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 469/948] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:27 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:27.638072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5b9a2278-a744-4173-b80d-05fbd6ef4503 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:27.640881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5b9a2278-a744-4173-b80d-05fbd6ef4503 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:27.647143 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b9a2278-a744-4173-b80d-05fbd6ef4503 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:27.650095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b9a2278-a744-4173-b80d-05fbd6ef4503 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:27.650531 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b9a2278-a744-4173-b80d-05fbd6ef4503 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:27.651255 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b9a2278-a744-4173-b80d-05fbd6ef4503 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:27.651711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b9a2278-a744-4173-b80d-05fbd6ef4503 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:27.652135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b9a2278-a744-4173-b80d-05fbd6ef4503 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:27.682127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5b9a2278-a744-4173-b80d-05fbd6ef4503 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048030 Aug 30 14:50:27.682687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 480/949] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:27 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:50:28.623904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-83fc051c-e548-4ecc-9876-850ef8bf2c27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:28.626032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-83fc051c-e548-4ecc-9876-850ef8bf2c27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:28.632315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83fc051c-e548-4ecc-9876-850ef8bf2c27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:28.632802 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83fc051c-e548-4ecc-9876-850ef8bf2c27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:28.633410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83fc051c-e548-4ecc-9876-850ef8bf2c27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:28.634100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83fc051c-e548-4ecc-9876-850ef8bf2c27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:28.634545 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83fc051c-e548-4ecc-9876-850ef8bf2c27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:28.634961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83fc051c-e548-4ecc-9876-850ef8bf2c27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:28.663311 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-83fc051c-e548-4ecc-9876-850ef8bf2c27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043459 Aug 30 14:50:28.664386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 470/950] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:28 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:50:28.694232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7685ef47-2d4e-4aae-979e-e37d68359231 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:28.696455 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7685ef47-2d4e-4aae-979e-e37d68359231 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:28.702763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7685ef47-2d4e-4aae-979e-e37d68359231 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:28.703279 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7685ef47-2d4e-4aae-979e-e37d68359231 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:28.703738 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7685ef47-2d4e-4aae-979e-e37d68359231 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:28.704434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7685ef47-2d4e-4aae-979e-e37d68359231 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:28.704876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7685ef47-2d4e-4aae-979e-e37d68359231 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:28.705297 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7685ef47-2d4e-4aae-979e-e37d68359231 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:28.734259 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7685ef47-2d4e-4aae-979e-e37d68359231 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044225 Aug 30 14:50:28.734741 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 481/951] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:28 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:29.675922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e80feabd-679c-458d-9eb4-098f38fa5ec1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:29.678075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e80feabd-679c-458d-9eb4-098f38fa5ec1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:29.685228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e80feabd-679c-458d-9eb4-098f38fa5ec1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:29.685700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e80feabd-679c-458d-9eb4-098f38fa5ec1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:29.686124 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e80feabd-679c-458d-9eb4-098f38fa5ec1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:29.686800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e80feabd-679c-458d-9eb4-098f38fa5ec1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:29.687268 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e80feabd-679c-458d-9eb4-098f38fa5ec1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:29.687691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e80feabd-679c-458d-9eb4-098f38fa5ec1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:29.717710 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e80feabd-679c-458d-9eb4-098f38fa5ec1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045782 Aug 30 14:50:29.718253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 471/952] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:29 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:29.746219 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cc00ba64-8c41-436a-91a7-64a9548667ec tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:29.748438 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cc00ba64-8c41-436a-91a7-64a9548667ec tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:29.755798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc00ba64-8c41-436a-91a7-64a9548667ec tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:29.756264 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc00ba64-8c41-436a-91a7-64a9548667ec tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:29.756977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc00ba64-8c41-436a-91a7-64a9548667ec tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:29.758616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc00ba64-8c41-436a-91a7-64a9548667ec tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:29.759292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc00ba64-8c41-436a-91a7-64a9548667ec tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:29.759834 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc00ba64-8c41-436a-91a7-64a9548667ec tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:29.789373 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cc00ba64-8c41-436a-91a7-64a9548667ec tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047410 Aug 30 14:50:29.789923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 482/953] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:29 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:30.730362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b430521f-688d-4c71-a1a1-b8047389043e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:30.732504 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b430521f-688d-4c71-a1a1-b8047389043e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:30.738759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b430521f-688d-4c71-a1a1-b8047389043e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:30.739273 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b430521f-688d-4c71-a1a1-b8047389043e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:30.739709 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b430521f-688d-4c71-a1a1-b8047389043e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:30.740393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b430521f-688d-4c71-a1a1-b8047389043e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:30.740838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b430521f-688d-4c71-a1a1-b8047389043e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:30.741257 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b430521f-688d-4c71-a1a1-b8047389043e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:30.770252 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b430521f-688d-4c71-a1a1-b8047389043e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Aug 30 14:50:30.770799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 472/954] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:30 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:30.800943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a19f9336-0490-444d-88a7-1a655e7bc544 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:30.803122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a19f9336-0490-444d-88a7-1a655e7bc544 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:30.809571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a19f9336-0490-444d-88a7-1a655e7bc544 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:30.810040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a19f9336-0490-444d-88a7-1a655e7bc544 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:30.810465 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a19f9336-0490-444d-88a7-1a655e7bc544 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:30.811144 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a19f9336-0490-444d-88a7-1a655e7bc544 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:30.811613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a19f9336-0490-444d-88a7-1a655e7bc544 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:30.812030 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a19f9336-0490-444d-88a7-1a655e7bc544 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:30.841819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a19f9336-0490-444d-88a7-1a655e7bc544 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044822 Aug 30 14:50:30.842360 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 483/955] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:30 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:31.783160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6b90df90-997b-4d46-aaab-5c382ba357a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:31.785218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6b90df90-997b-4d46-aaab-5c382ba357a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:31.792141 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b90df90-997b-4d46-aaab-5c382ba357a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:31.792616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b90df90-997b-4d46-aaab-5c382ba357a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:31.793047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b90df90-997b-4d46-aaab-5c382ba357a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:31.793726 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b90df90-997b-4d46-aaab-5c382ba357a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:31.794173 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b90df90-997b-4d46-aaab-5c382ba357a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:31.794594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b90df90-997b-4d46-aaab-5c382ba357a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:31.812496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:31.826246 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6b90df90-997b-4d46-aaab-5c382ba357a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047145 Aug 30 14:50:31.826814 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 473/956] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:31 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:31.854912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8195745b-3240-4f6c-81db-07207c682d79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:31.857055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8195745b-3240-4f6c-81db-07207c682d79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:31.863305 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8195745b-3240-4f6c-81db-07207c682d79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:31.863784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8195745b-3240-4f6c-81db-07207c682d79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:31.864213 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8195745b-3240-4f6c-81db-07207c682d79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:31.864887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8195745b-3240-4f6c-81db-07207c682d79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:31.865328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8195745b-3240-4f6c-81db-07207c682d79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:31.865741 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8195745b-3240-4f6c-81db-07207c682d79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:31.895434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8195745b-3240-4f6c-81db-07207c682d79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045399 Aug 30 14:50:31.895983 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 484/957] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:31 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:32.838299 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c3b35058-fb04-46bc-abcc-ed3fb0a7e5ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:32.840651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c3b35058-fb04-46bc-abcc-ed3fb0a7e5ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:32.847165 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3b35058-fb04-46bc-abcc-ed3fb0a7e5ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:32.847686 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3b35058-fb04-46bc-abcc-ed3fb0a7e5ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:32.848124 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3b35058-fb04-46bc-abcc-ed3fb0a7e5ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:32.848816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3b35058-fb04-46bc-abcc-ed3fb0a7e5ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:32.849265 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3b35058-fb04-46bc-abcc-ed3fb0a7e5ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:32.849687 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c3b35058-fb04-46bc-abcc-ed3fb0a7e5ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:32.879670 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c3b35058-fb04-46bc-abcc-ed3fb0a7e5ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045411 Aug 30 14:50:32.880341 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 474/958] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:32 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:32.908400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1cc5a0a2-e510-45a4-95c8-d2780f8c30e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:32.910570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1cc5a0a2-e510-45a4-95c8-d2780f8c30e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:32.916916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cc5a0a2-e510-45a4-95c8-d2780f8c30e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:32.917422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cc5a0a2-e510-45a4-95c8-d2780f8c30e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:32.918191 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cc5a0a2-e510-45a4-95c8-d2780f8c30e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:32.918520 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cc5a0a2-e510-45a4-95c8-d2780f8c30e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:32.919143 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cc5a0a2-e510-45a4-95c8-d2780f8c30e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:32.919589 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cc5a0a2-e510-45a4-95c8-d2780f8c30e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:32.950539 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1cc5a0a2-e510-45a4-95c8-d2780f8c30e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046285 Aug 30 14:50:32.951112 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 485/959] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:32 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:33.892621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e087126d-2da3-462f-99ef-bb0e95c6127e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:33.894818 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e087126d-2da3-462f-99ef-bb0e95c6127e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:33.897076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=58 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:33.903335 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e087126d-2da3-462f-99ef-bb0e95c6127e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:33.903813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e087126d-2da3-462f-99ef-bb0e95c6127e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:33.904240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e087126d-2da3-462f-99ef-bb0e95c6127e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:33.904918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e087126d-2da3-462f-99ef-bb0e95c6127e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:33.905370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e087126d-2da3-462f-99ef-bb0e95c6127e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:33.905786 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e087126d-2da3-462f-99ef-bb0e95c6127e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:33.934791 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e087126d-2da3-462f-99ef-bb0e95c6127e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046151 Aug 30 14:50:33.935354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 475/960] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:33 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:33.962954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8f80ab80-906b-47ce-ab69-014587b98c0f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:33.965028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8f80ab80-906b-47ce-ab69-014587b98c0f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:33.971376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f80ab80-906b-47ce-ab69-014587b98c0f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:33.971854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f80ab80-906b-47ce-ab69-014587b98c0f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:33.972284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f80ab80-906b-47ce-ab69-014587b98c0f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:33.972968 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f80ab80-906b-47ce-ab69-014587b98c0f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:33.973415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f80ab80-906b-47ce-ab69-014587b98c0f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:33.973838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f80ab80-906b-47ce-ab69-014587b98c0f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:34.002301 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8f80ab80-906b-47ce-ab69-014587b98c0f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044276 Aug 30 14:50:34.002846 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 486/961] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:33 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:34.947846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a9846ce5-e72d-4bad-8e35-4bbc935b8e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:34.949979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a9846ce5-e72d-4bad-8e35-4bbc935b8e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:34.956533 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9846ce5-e72d-4bad-8e35-4bbc935b8e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:34.957033 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9846ce5-e72d-4bad-8e35-4bbc935b8e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:34.957457 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9846ce5-e72d-4bad-8e35-4bbc935b8e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:34.958140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9846ce5-e72d-4bad-8e35-4bbc935b8e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:34.958580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9846ce5-e72d-4bad-8e35-4bbc935b8e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:34.958991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9846ce5-e72d-4bad-8e35-4bbc935b8e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:34.988125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a9846ce5-e72d-4bad-8e35-4bbc935b8e94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045444 Aug 30 14:50:34.988685 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 476/962] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:34 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:35.014754 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d9aba918-e2a2-4ce8-a23e-6d353b286aa5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:35.016841 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d9aba918-e2a2-4ce8-a23e-6d353b286aa5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:35.019166 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=58 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:35.024450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d9aba918-e2a2-4ce8-a23e-6d353b286aa5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:35.024930 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d9aba918-e2a2-4ce8-a23e-6d353b286aa5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:35.025366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d9aba918-e2a2-4ce8-a23e-6d353b286aa5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:35.026060 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d9aba918-e2a2-4ce8-a23e-6d353b286aa5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:35.026509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d9aba918-e2a2-4ce8-a23e-6d353b286aa5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:35.026931 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d9aba918-e2a2-4ce8-a23e-6d353b286aa5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:35.056585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d9aba918-e2a2-4ce8-a23e-6d353b286aa5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045594 Aug 30 14:50:35.057135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 487/963] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:35 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:50:35.999202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f9eb931d-6dba-4ecc-982c-f94828221c0e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:36.001330 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f9eb931d-6dba-4ecc-982c-f94828221c0e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:36.007709 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9eb931d-6dba-4ecc-982c-f94828221c0e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:36.008181 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9eb931d-6dba-4ecc-982c-f94828221c0e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:36.009196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9eb931d-6dba-4ecc-982c-f94828221c0e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:36.009913 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9eb931d-6dba-4ecc-982c-f94828221c0e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:36.010357 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9eb931d-6dba-4ecc-982c-f94828221c0e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:36.010769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9eb931d-6dba-4ecc-982c-f94828221c0e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:36.039721 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f9eb931d-6dba-4ecc-982c-f94828221c0e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Aug 30 14:50:36.040372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 477/964] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:35 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:36.069537 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-db9e875e-5260-4da8-b814-1963cb8bf0b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:36.072367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-db9e875e-5260-4da8-b814-1963cb8bf0b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:36.078589 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db9e875e-5260-4da8-b814-1963cb8bf0b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:36.079066 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db9e875e-5260-4da8-b814-1963cb8bf0b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:36.079532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db9e875e-5260-4da8-b814-1963cb8bf0b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:36.080212 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db9e875e-5260-4da8-b814-1963cb8bf0b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:36.080680 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db9e875e-5260-4da8-b814-1963cb8bf0b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:36.081093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db9e875e-5260-4da8-b814-1963cb8bf0b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:36.110643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-db9e875e-5260-4da8-b814-1963cb8bf0b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045425 Aug 30 14:50:36.111188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 488/965] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:36 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:37.051985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-968f5ba5-5989-49b3-b239-99af9942c746 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:37.054115 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-968f5ba5-5989-49b3-b239-99af9942c746 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:37.061128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-968f5ba5-5989-49b3-b239-99af9942c746 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:37.061607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-968f5ba5-5989-49b3-b239-99af9942c746 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:37.062042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-968f5ba5-5989-49b3-b239-99af9942c746 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:37.062727 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-968f5ba5-5989-49b3-b239-99af9942c746 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:37.063181 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-968f5ba5-5989-49b3-b239-99af9942c746 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:37.063630 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-968f5ba5-5989-49b3-b239-99af9942c746 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:37.092866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-968f5ba5-5989-49b3-b239-99af9942c746 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044899 Aug 30 14:50:37.093424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 478/966] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:37 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:37.123409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-de1587b9-5101-4cf6-85e2-c5b7c28ed9e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:37.125447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-de1587b9-5101-4cf6-85e2-c5b7c28ed9e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:37.131826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-de1587b9-5101-4cf6-85e2-c5b7c28ed9e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:37.132300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-de1587b9-5101-4cf6-85e2-c5b7c28ed9e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:37.132726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-de1587b9-5101-4cf6-85e2-c5b7c28ed9e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:37.133439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-de1587b9-5101-4cf6-85e2-c5b7c28ed9e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:37.134196 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-de1587b9-5101-4cf6-85e2-c5b7c28ed9e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:37.134619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-de1587b9-5101-4cf6-85e2-c5b7c28ed9e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:37.166207 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-de1587b9-5101-4cf6-85e2-c5b7c28ed9e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046613 Aug 30 14:50:37.166768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 489/967] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:37 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:38.105190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bd51311d-f095-4e63-9c49-b4303c141c8c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:38.107343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bd51311d-f095-4e63-9c49-b4303c141c8c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:38.113689 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd51311d-f095-4e63-9c49-b4303c141c8c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:38.114172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd51311d-f095-4e63-9c49-b4303c141c8c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:38.114608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd51311d-f095-4e63-9c49-b4303c141c8c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:38.115325 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd51311d-f095-4e63-9c49-b4303c141c8c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:38.115792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd51311d-f095-4e63-9c49-b4303c141c8c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:38.116247 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd51311d-f095-4e63-9c49-b4303c141c8c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:38.146177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bd51311d-f095-4e63-9c49-b4303c141c8c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045200 Aug 30 14:50:38.146664 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 479/968] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:38 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:38.177945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bbf8256f-9aa5-4423-8ffb-6689563153b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:38.180083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bbf8256f-9aa5-4423-8ffb-6689563153b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:38.186919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bbf8256f-9aa5-4423-8ffb-6689563153b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:38.187428 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bbf8256f-9aa5-4423-8ffb-6689563153b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:38.187855 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bbf8256f-9aa5-4423-8ffb-6689563153b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:38.188530 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bbf8256f-9aa5-4423-8ffb-6689563153b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:38.188971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bbf8256f-9aa5-4423-8ffb-6689563153b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:38.189385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bbf8256f-9aa5-4423-8ffb-6689563153b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:38.219454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bbf8256f-9aa5-4423-8ffb-6689563153b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045402 Aug 30 14:50:38.220030 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 490/969] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:38 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:39.158124 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3f3f8526-0455-40f0-af4f-d51c2087c1ea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:39.160416 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3f3f8526-0455-40f0-af4f-d51c2087c1ea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:39.166873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f3f8526-0455-40f0-af4f-d51c2087c1ea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:39.167383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f3f8526-0455-40f0-af4f-d51c2087c1ea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:39.167820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f3f8526-0455-40f0-af4f-d51c2087c1ea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:39.168500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f3f8526-0455-40f0-af4f-d51c2087c1ea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:39.168976 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f3f8526-0455-40f0-af4f-d51c2087c1ea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:39.169394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f3f8526-0455-40f0-af4f-d51c2087c1ea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:39.198495 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3f3f8526-0455-40f0-af4f-d51c2087c1ea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044225 Aug 30 14:50:39.198976 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 480/970] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:39 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:39.232057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-efb1534d-9a9c-48e1-94f2-267afc29ae12 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:39.234157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-efb1534d-9a9c-48e1-94f2-267afc29ae12 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:39.240497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efb1534d-9a9c-48e1-94f2-267afc29ae12 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:39.240979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efb1534d-9a9c-48e1-94f2-267afc29ae12 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:39.241407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efb1534d-9a9c-48e1-94f2-267afc29ae12 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:39.242089 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efb1534d-9a9c-48e1-94f2-267afc29ae12 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:39.242542 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efb1534d-9a9c-48e1-94f2-267afc29ae12 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:39.243063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efb1534d-9a9c-48e1-94f2-267afc29ae12 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:39.272037 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-efb1534d-9a9c-48e1-94f2-267afc29ae12 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044037 Aug 30 14:50:39.272582 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 491/971] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:39 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:40.210505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-61353619-1d5a-416e-913d-ab2d9300ef83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:40.213862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-61353619-1d5a-416e-913d-ab2d9300ef83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:40.220170 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61353619-1d5a-416e-913d-ab2d9300ef83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:40.220645 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61353619-1d5a-416e-913d-ab2d9300ef83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:40.221070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61353619-1d5a-416e-913d-ab2d9300ef83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:40.221748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61353619-1d5a-416e-913d-ab2d9300ef83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:40.222190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61353619-1d5a-416e-913d-ab2d9300ef83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:40.222606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61353619-1d5a-416e-913d-ab2d9300ef83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:40.252634 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-61353619-1d5a-416e-913d-ab2d9300ef83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046162 Aug 30 14:50:40.253186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 481/972] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:40 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:40.284930 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1e5c03d9-31a6-4ca1-b351-ea8215b1bd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:40.287048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1e5c03d9-31a6-4ca1-b351-ea8215b1bd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:40.294003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1e5c03d9-31a6-4ca1-b351-ea8215b1bd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:40.294487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1e5c03d9-31a6-4ca1-b351-ea8215b1bd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:40.294918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1e5c03d9-31a6-4ca1-b351-ea8215b1bd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:40.295641 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1e5c03d9-31a6-4ca1-b351-ea8215b1bd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:40.296098 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1e5c03d9-31a6-4ca1-b351-ea8215b1bd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:40.296523 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1e5c03d9-31a6-4ca1-b351-ea8215b1bd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:40.325286 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1e5c03d9-31a6-4ca1-b351-ea8215b1bd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044331 Aug 30 14:50:40.325837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 492/973] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:40 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:50:41.265389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9faa4343-ffd6-424c-9823-1e88fe856ac5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:41.268156 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9faa4343-ffd6-424c-9823-1e88fe856ac5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:41.275592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9faa4343-ffd6-424c-9823-1e88fe856ac5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:41.276160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9faa4343-ffd6-424c-9823-1e88fe856ac5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:41.276667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9faa4343-ffd6-424c-9823-1e88fe856ac5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:41.277369 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9faa4343-ffd6-424c-9823-1e88fe856ac5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:41.277818 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9faa4343-ffd6-424c-9823-1e88fe856ac5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:41.278237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9faa4343-ffd6-424c-9823-1e88fe856ac5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:41.308218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9faa4343-ffd6-424c-9823-1e88fe856ac5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046812 Aug 30 14:50:41.308778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 482/974] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:41 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:41.338377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-208c9699-9a0a-4761-89d5-e5b7c5ed6400 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:41.340673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-208c9699-9a0a-4761-89d5-e5b7c5ed6400 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:41.342977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 14:50:41.343128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 14:50:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments (ip 10.222.0.30) !!! Aug 30 14:50:41.355772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-208c9699-9a0a-4761-89d5-e5b7c5ed6400 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:41.356254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-208c9699-9a0a-4761-89d5-e5b7c5ed6400 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:41.356684 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-208c9699-9a0a-4761-89d5-e5b7c5ed6400 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:41.357437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-208c9699-9a0a-4761-89d5-e5b7c5ed6400 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:41.357881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-208c9699-9a0a-4761-89d5-e5b7c5ed6400 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:41.358295 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-208c9699-9a0a-4761-89d5-e5b7c5ed6400 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:41.382819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:41.388727 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-208c9699-9a0a-4761-89d5-e5b7c5ed6400 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054777 Aug 30 14:50:41.389283 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 493/975] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:41 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:42.320590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-19579fb2-716e-42b0-b4e4-eed5bfa6fba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:42.322852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-19579fb2-716e-42b0-b4e4-eed5bfa6fba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:42.329159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19579fb2-716e-42b0-b4e4-eed5bfa6fba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:42.329642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19579fb2-716e-42b0-b4e4-eed5bfa6fba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:42.330073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19579fb2-716e-42b0-b4e4-eed5bfa6fba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:42.330750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19579fb2-716e-42b0-b4e4-eed5bfa6fba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:42.331196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19579fb2-716e-42b0-b4e4-eed5bfa6fba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:42.331643 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19579fb2-716e-42b0-b4e4-eed5bfa6fba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:42.361189 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-19579fb2-716e-42b0-b4e4-eed5bfa6fba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044747 Aug 30 14:50:42.361742 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 483/976] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:42 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:42.401794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c78b7f41-159f-44f9-828b-1a250deea9ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:42.403966 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c78b7f41-159f-44f9-828b-1a250deea9ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:42.410384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c78b7f41-159f-44f9-828b-1a250deea9ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:42.410868 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c78b7f41-159f-44f9-828b-1a250deea9ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:42.411338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c78b7f41-159f-44f9-828b-1a250deea9ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:42.412038 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c78b7f41-159f-44f9-828b-1a250deea9ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:42.412491 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c78b7f41-159f-44f9-828b-1a250deea9ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:42.412916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c78b7f41-159f-44f9-828b-1a250deea9ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:42.441806 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c78b7f41-159f-44f9-828b-1a250deea9ce tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044821 Aug 30 14:50:42.442345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 494/977] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:42 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:43.373877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dbe314c8-3923-4ef4-96cc-9f526941974f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:43.376021 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dbe314c8-3923-4ef4-96cc-9f526941974f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:43.382386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbe314c8-3923-4ef4-96cc-9f526941974f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:43.382890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbe314c8-3923-4ef4-96cc-9f526941974f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:43.383461 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbe314c8-3923-4ef4-96cc-9f526941974f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:43.384224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbe314c8-3923-4ef4-96cc-9f526941974f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:43.384672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbe314c8-3923-4ef4-96cc-9f526941974f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:43.385093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbe314c8-3923-4ef4-96cc-9f526941974f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:43.413654 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dbe314c8-3923-4ef4-96cc-9f526941974f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043690 Aug 30 14:50:43.414200 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 484/978] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:43 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:43.454684 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5a49a0b4-60be-44ec-9c6d-4497db3c49cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:43.456865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5a49a0b4-60be-44ec-9c6d-4497db3c49cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:43.463371 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a49a0b4-60be-44ec-9c6d-4497db3c49cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:43.463863 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a49a0b4-60be-44ec-9c6d-4497db3c49cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:43.464963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a49a0b4-60be-44ec-9c6d-4497db3c49cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:43.465112 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a49a0b4-60be-44ec-9c6d-4497db3c49cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:43.465448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a49a0b4-60be-44ec-9c6d-4497db3c49cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:43.465877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a49a0b4-60be-44ec-9c6d-4497db3c49cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:43.496324 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5a49a0b4-60be-44ec-9c6d-4497db3c49cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045650 Aug 30 14:50:43.496889 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 495/979] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:43 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:44.426161 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9bb2dcf8-3ffe-414c-bb3e-e6544406ca38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:44.428279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9bb2dcf8-3ffe-414c-bb3e-e6544406ca38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:44.435163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bb2dcf8-3ffe-414c-bb3e-e6544406ca38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:44.435668 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bb2dcf8-3ffe-414c-bb3e-e6544406ca38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:44.436089 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bb2dcf8-3ffe-414c-bb3e-e6544406ca38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:44.436761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bb2dcf8-3ffe-414c-bb3e-e6544406ca38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:44.437201 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bb2dcf8-3ffe-414c-bb3e-e6544406ca38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:44.437613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9bb2dcf8-3ffe-414c-bb3e-e6544406ca38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:44.469399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9bb2dcf8-3ffe-414c-bb3e-e6544406ca38 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047087 Aug 30 14:50:44.470037 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 485/980] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:44 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:44.509484 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e3535758-d7ba-4484-b878-56c39b8983dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:44.511688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e3535758-d7ba-4484-b878-56c39b8983dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:44.517776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3535758-d7ba-4484-b878-56c39b8983dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:44.518255 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3535758-d7ba-4484-b878-56c39b8983dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:44.518685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3535758-d7ba-4484-b878-56c39b8983dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:44.519409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3535758-d7ba-4484-b878-56c39b8983dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:44.519893 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3535758-d7ba-4484-b878-56c39b8983dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:44.520314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3535758-d7ba-4484-b878-56c39b8983dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:44.549218 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e3535758-d7ba-4484-b878-56c39b8983dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044444 Aug 30 14:50:44.549772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 496/981] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:44 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:45.483012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-30d1c5c9-6c6c-40e4-a3ec-f769bb5e2ea8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:45.485252 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-30d1c5c9-6c6c-40e4-a3ec-f769bb5e2ea8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:45.491692 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30d1c5c9-6c6c-40e4-a3ec-f769bb5e2ea8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:45.492178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30d1c5c9-6c6c-40e4-a3ec-f769bb5e2ea8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:45.492610 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30d1c5c9-6c6c-40e4-a3ec-f769bb5e2ea8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:45.493295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30d1c5c9-6c6c-40e4-a3ec-f769bb5e2ea8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:45.493744 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30d1c5c9-6c6c-40e4-a3ec-f769bb5e2ea8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:45.494166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30d1c5c9-6c6c-40e4-a3ec-f769bb5e2ea8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:45.524644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-30d1c5c9-6c6c-40e4-a3ec-f769bb5e2ea8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045389 Aug 30 14:50:45.525348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 486/982] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:45 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:45.561892 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2c64298e-a10b-444e-be88-e53772cdc785 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:45.564043 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2c64298e-a10b-444e-be88-e53772cdc785 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:45.571175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c64298e-a10b-444e-be88-e53772cdc785 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:45.571780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c64298e-a10b-444e-be88-e53772cdc785 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:45.572225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c64298e-a10b-444e-be88-e53772cdc785 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:45.572919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c64298e-a10b-444e-be88-e53772cdc785 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:45.573377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c64298e-a10b-444e-be88-e53772cdc785 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:45.573802 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c64298e-a10b-444e-be88-e53772cdc785 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:45.602969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2c64298e-a10b-444e-be88-e53772cdc785 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045153 Aug 30 14:50:45.603559 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 497/983] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:45 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:46.537031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3258dda9-d1e2-452c-a3f8-b09d7651607d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:46.539164 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3258dda9-d1e2-452c-a3f8-b09d7651607d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:46.546091 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3258dda9-d1e2-452c-a3f8-b09d7651607d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:46.546571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3258dda9-d1e2-452c-a3f8-b09d7651607d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:46.547006 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3258dda9-d1e2-452c-a3f8-b09d7651607d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:46.547716 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3258dda9-d1e2-452c-a3f8-b09d7651607d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:46.548165 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3258dda9-d1e2-452c-a3f8-b09d7651607d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:46.548585 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3258dda9-d1e2-452c-a3f8-b09d7651607d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:46.577979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3258dda9-d1e2-452c-a3f8-b09d7651607d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044972 Aug 30 14:50:46.578535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 487/984] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:46 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:46.615161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0544d031-134a-425b-8cbf-74bda284987f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:46.617328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0544d031-134a-425b-8cbf-74bda284987f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:46.623739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0544d031-134a-425b-8cbf-74bda284987f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:46.624219 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0544d031-134a-425b-8cbf-74bda284987f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:46.624653 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0544d031-134a-425b-8cbf-74bda284987f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:46.625368 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0544d031-134a-425b-8cbf-74bda284987f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:46.625817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0544d031-134a-425b-8cbf-74bda284987f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:46.626240 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0544d031-134a-425b-8cbf-74bda284987f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:46.655174 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0544d031-134a-425b-8cbf-74bda284987f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044007 Aug 30 14:50:46.655739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 498/985] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:46 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:47.590006 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-76a6fa5c-3384-478c-9383-f9677e09e19d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:47.592177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-76a6fa5c-3384-478c-9383-f9677e09e19d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:47.598437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76a6fa5c-3384-478c-9383-f9677e09e19d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:47.598920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76a6fa5c-3384-478c-9383-f9677e09e19d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:47.599384 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76a6fa5c-3384-478c-9383-f9677e09e19d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:47.600065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76a6fa5c-3384-478c-9383-f9677e09e19d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:47.600511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76a6fa5c-3384-478c-9383-f9677e09e19d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:47.600928 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76a6fa5c-3384-478c-9383-f9677e09e19d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:47.630098 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-76a6fa5c-3384-478c-9383-f9677e09e19d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044058 Aug 30 14:50:47.630640 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 488/986] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:47 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:47.667936 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-be416012-e137-4edb-b92e-2e44d09f19bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:47.670035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-be416012-e137-4edb-b92e-2e44d09f19bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:47.676320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be416012-e137-4edb-b92e-2e44d09f19bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:47.676798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be416012-e137-4edb-b92e-2e44d09f19bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:47.677232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be416012-e137-4edb-b92e-2e44d09f19bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:47.677916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be416012-e137-4edb-b92e-2e44d09f19bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:47.678369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be416012-e137-4edb-b92e-2e44d09f19bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:47.678787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be416012-e137-4edb-b92e-2e44d09f19bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:47.708248 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-be416012-e137-4edb-b92e-2e44d09f19bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044928 Aug 30 14:50:47.708790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 499/987] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:47 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:48.643966 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d3f191b6-a0f4-4a89-9274-6906d7dcb28e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:48.646087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d3f191b6-a0f4-4a89-9274-6906d7dcb28e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:48.652989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3f191b6-a0f4-4a89-9274-6906d7dcb28e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:48.653464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3f191b6-a0f4-4a89-9274-6906d7dcb28e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:48.653889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3f191b6-a0f4-4a89-9274-6906d7dcb28e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:48.654574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3f191b6-a0f4-4a89-9274-6906d7dcb28e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:48.655019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3f191b6-a0f4-4a89-9274-6906d7dcb28e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:48.655467 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3f191b6-a0f4-4a89-9274-6906d7dcb28e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:48.685621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d3f191b6-a0f4-4a89-9274-6906d7dcb28e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045992 Aug 30 14:50:48.686198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 489/988] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:48 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:48.720659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b57073db-94e4-435b-b0f3-e0077eec4e7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:48.722755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b57073db-94e4-435b-b0f3-e0077eec4e7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:48.729561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b57073db-94e4-435b-b0f3-e0077eec4e7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:48.730088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b57073db-94e4-435b-b0f3-e0077eec4e7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:48.730566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b57073db-94e4-435b-b0f3-e0077eec4e7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:48.731334 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b57073db-94e4-435b-b0f3-e0077eec4e7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:48.731793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b57073db-94e4-435b-b0f3-e0077eec4e7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:48.732219 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b57073db-94e4-435b-b0f3-e0077eec4e7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:48.763814 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b57073db-94e4-435b-b0f3-e0077eec4e7d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047190 Aug 30 14:50:48.764387 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 500/989] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:48 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:49.698085 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fcedfa50-b236-431d-9190-ef7716ea582c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:49.700247 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fcedfa50-b236-431d-9190-ef7716ea582c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:49.706560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcedfa50-b236-431d-9190-ef7716ea582c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:49.707037 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcedfa50-b236-431d-9190-ef7716ea582c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:49.707506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcedfa50-b236-431d-9190-ef7716ea582c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:49.708198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcedfa50-b236-431d-9190-ef7716ea582c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:49.708633 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcedfa50-b236-431d-9190-ef7716ea582c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:49.709052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fcedfa50-b236-431d-9190-ef7716ea582c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:49.713170 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:49.739141 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fcedfa50-b236-431d-9190-ef7716ea582c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045053 Aug 30 14:50:49.739655 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 490/990] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:49 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:49.777039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8c830569-b485-4cbc-a1d7-234e4f1cbd3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:49.779152 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8c830569-b485-4cbc-a1d7-234e4f1cbd3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:49.785445 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c830569-b485-4cbc-a1d7-234e4f1cbd3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:49.785924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c830569-b485-4cbc-a1d7-234e4f1cbd3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:49.786353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c830569-b485-4cbc-a1d7-234e4f1cbd3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:49.787039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c830569-b485-4cbc-a1d7-234e4f1cbd3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:49.787520 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c830569-b485-4cbc-a1d7-234e4f1cbd3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:49.787941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c830569-b485-4cbc-a1d7-234e4f1cbd3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:49.817787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8c830569-b485-4cbc-a1d7-234e4f1cbd3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045311 Aug 30 14:50:49.818331 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 501/991] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:49 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:50.751455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-63974ecd-d296-4542-8dea-9e799c8797fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:50.753566 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-63974ecd-d296-4542-8dea-9e799c8797fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:50.759502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63974ecd-d296-4542-8dea-9e799c8797fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:50.759982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63974ecd-d296-4542-8dea-9e799c8797fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:50.760413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63974ecd-d296-4542-8dea-9e799c8797fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:50.761091 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63974ecd-d296-4542-8dea-9e799c8797fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:50.761541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63974ecd-d296-4542-8dea-9e799c8797fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:50.761958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63974ecd-d296-4542-8dea-9e799c8797fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:50.790600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-63974ecd-d296-4542-8dea-9e799c8797fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043296 Aug 30 14:50:50.791154 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 491/992] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:50 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:50.830328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-68ba7583-f438-4203-a91d-0ad84ff6464f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:50.832475 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-68ba7583-f438-4203-a91d-0ad84ff6464f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:50.839391 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-68ba7583-f438-4203-a91d-0ad84ff6464f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:50.839866 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-68ba7583-f438-4203-a91d-0ad84ff6464f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:50.840294 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-68ba7583-f438-4203-a91d-0ad84ff6464f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:50.840972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-68ba7583-f438-4203-a91d-0ad84ff6464f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:50.841416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-68ba7583-f438-4203-a91d-0ad84ff6464f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:50.841826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-68ba7583-f438-4203-a91d-0ad84ff6464f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:50.872138 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-68ba7583-f438-4203-a91d-0ad84ff6464f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045738 Aug 30 14:50:50.872708 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 502/993] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:50 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:51.802001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e259a58f-c443-420d-a4df-b4fea7684615 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:51.804067 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e259a58f-c443-420d-a4df-b4fea7684615 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:51.811098 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e259a58f-c443-420d-a4df-b4fea7684615 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:51.811605 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e259a58f-c443-420d-a4df-b4fea7684615 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:51.812031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e259a58f-c443-420d-a4df-b4fea7684615 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:51.812712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e259a58f-c443-420d-a4df-b4fea7684615 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:51.813155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e259a58f-c443-420d-a4df-b4fea7684615 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:51.813578 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e259a58f-c443-420d-a4df-b4fea7684615 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:51.844954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e259a58f-c443-420d-a4df-b4fea7684615 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046980 Aug 30 14:50:51.845498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 492/994] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:51 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:51.885109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fb30b320-21ff-4ecf-8fc0-6beb30407c63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:51.887380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fb30b320-21ff-4ecf-8fc0-6beb30407c63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:51.893725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb30b320-21ff-4ecf-8fc0-6beb30407c63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:51.894269 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb30b320-21ff-4ecf-8fc0-6beb30407c63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:51.894701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb30b320-21ff-4ecf-8fc0-6beb30407c63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:51.895418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb30b320-21ff-4ecf-8fc0-6beb30407c63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:51.895864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb30b320-21ff-4ecf-8fc0-6beb30407c63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:51.896280 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb30b320-21ff-4ecf-8fc0-6beb30407c63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:51.924743 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fb30b320-21ff-4ecf-8fc0-6beb30407c63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044272 Aug 30 14:50:51.925296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 503/995] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:51 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:52.856963 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-150dd895-d8cd-425e-a508-77f7a2e0b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:52.859084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-150dd895-d8cd-425e-a508-77f7a2e0b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:52.865469 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-150dd895-d8cd-425e-a508-77f7a2e0b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:52.865947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-150dd895-d8cd-425e-a508-77f7a2e0b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:52.866382 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-150dd895-d8cd-425e-a508-77f7a2e0b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:52.867067 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-150dd895-d8cd-425e-a508-77f7a2e0b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:52.867566 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-150dd895-d8cd-425e-a508-77f7a2e0b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:52.867975 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-150dd895-d8cd-425e-a508-77f7a2e0b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:52.897220 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-150dd895-d8cd-425e-a508-77f7a2e0b935 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044185 Aug 30 14:50:52.897922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 493/996] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:52 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:52.939187 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-374567c1-6739-4f17-95ce-068df48b2d3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:52.941642 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-374567c1-6739-4f17-95ce-068df48b2d3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:52.948588 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-374567c1-6739-4f17-95ce-068df48b2d3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:52.949071 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-374567c1-6739-4f17-95ce-068df48b2d3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:52.949503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-374567c1-6739-4f17-95ce-068df48b2d3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:52.950189 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-374567c1-6739-4f17-95ce-068df48b2d3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:52.950666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-374567c1-6739-4f17-95ce-068df48b2d3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:52.951088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-374567c1-6739-4f17-95ce-068df48b2d3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:52.980204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-374567c1-6739-4f17-95ce-068df48b2d3a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045013 Aug 30 14:50:52.980762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 504/997] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:52 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:53.910695 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f7a20766-ae5f-4382-85d3-215da3ef1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:53.912879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f7a20766-ae5f-4382-85d3-215da3ef1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:53.916183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 14:50:53.916357 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 14:50:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments (ip 10.222.0.30) !!! Aug 30 14:50:53.924564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7a20766-ae5f-4382-85d3-215da3ef1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:53.925043 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7a20766-ae5f-4382-85d3-215da3ef1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:53.925472 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7a20766-ae5f-4382-85d3-215da3ef1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:53.926171 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7a20766-ae5f-4382-85d3-215da3ef1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:53.926614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7a20766-ae5f-4382-85d3-215da3ef1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:53.927027 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7a20766-ae5f-4382-85d3-215da3ef1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:53.958999 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f7a20766-ae5f-4382-85d3-215da3ef1cab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052811 Aug 30 14:50:53.959580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 494/998] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:53 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:50:53.992798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-df392b65-a9f9-46d4-859c-880dec338b23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:53.994840 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-df392b65-a9f9-46d4-859c-880dec338b23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:54.001182 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-df392b65-a9f9-46d4-859c-880dec338b23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:54.001685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-df392b65-a9f9-46d4-859c-880dec338b23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:54.002121 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-df392b65-a9f9-46d4-859c-880dec338b23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:54.002803 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-df392b65-a9f9-46d4-859c-880dec338b23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:54.003291 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-df392b65-a9f9-46d4-859c-880dec338b23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:54.003711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-df392b65-a9f9-46d4-859c-880dec338b23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:54.033146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-df392b65-a9f9-46d4-859c-880dec338b23 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044969 Aug 30 14:50:54.033694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 505/999] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:53 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:54.971519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-87602cf4-e15b-4a6c-9af2-6906510e345e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:54.975078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-87602cf4-e15b-4a6c-9af2-6906510e345e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:54.984862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-87602cf4-e15b-4a6c-9af2-6906510e345e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:54.985339 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-87602cf4-e15b-4a6c-9af2-6906510e345e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:54.985765 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-87602cf4-e15b-4a6c-9af2-6906510e345e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:54.986452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-87602cf4-e15b-4a6c-9af2-6906510e345e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:54.986898 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-87602cf4-e15b-4a6c-9af2-6906510e345e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:54.987345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-87602cf4-e15b-4a6c-9af2-6906510e345e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:55.021449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-87602cf4-e15b-4a6c-9af2-6906510e345e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053915 Aug 30 14:50:55.021903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 495/1000] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:54 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:55.045648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-673013d6-4eb9-4b55-a496-28f32694328f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:55.047875 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-673013d6-4eb9-4b55-a496-28f32694328f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:55.054173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-673013d6-4eb9-4b55-a496-28f32694328f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:55.055228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-673013d6-4eb9-4b55-a496-28f32694328f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:55.055952 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-673013d6-4eb9-4b55-a496-28f32694328f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:55.056640 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-673013d6-4eb9-4b55-a496-28f32694328f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:55.057088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-673013d6-4eb9-4b55-a496-28f32694328f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:55.057543 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-673013d6-4eb9-4b55-a496-28f32694328f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:55.087195 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-673013d6-4eb9-4b55-a496-28f32694328f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045444 Aug 30 14:50:55.087751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 506/1001] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:55 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:56.033618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7d15635d-bbaf-49a1-9ae4-3b577c871263 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:56.035779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7d15635d-bbaf-49a1-9ae4-3b577c871263 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:56.042133 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d15635d-bbaf-49a1-9ae4-3b577c871263 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:56.042610 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d15635d-bbaf-49a1-9ae4-3b577c871263 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:56.043087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d15635d-bbaf-49a1-9ae4-3b577c871263 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:56.043747 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d15635d-bbaf-49a1-9ae4-3b577c871263 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:56.044191 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d15635d-bbaf-49a1-9ae4-3b577c871263 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:56.044609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d15635d-bbaf-49a1-9ae4-3b577c871263 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:56.074987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7d15635d-bbaf-49a1-9ae4-3b577c871263 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045332 Aug 30 14:50:56.075560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 496/1002] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:56 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:56.099484 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1ea1031c-3fa4-4527-8856-bb24d0f669fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:56.101616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1ea1031c-3fa4-4527-8856-bb24d0f669fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:56.107955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ea1031c-3fa4-4527-8856-bb24d0f669fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:56.108442 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ea1031c-3fa4-4527-8856-bb24d0f669fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:56.108879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ea1031c-3fa4-4527-8856-bb24d0f669fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:56.109575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ea1031c-3fa4-4527-8856-bb24d0f669fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:56.110030 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ea1031c-3fa4-4527-8856-bb24d0f669fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:56.110457 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ea1031c-3fa4-4527-8856-bb24d0f669fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:56.139725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1ea1031c-3fa4-4527-8856-bb24d0f669fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044220 Aug 30 14:50:56.140283 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 507/1003] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:56 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:57.087683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7f48467d-a6cc-4b46-ab2f-1e41e143e223 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:57.089807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7f48467d-a6cc-4b46-ab2f-1e41e143e223 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:57.096335 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f48467d-a6cc-4b46-ab2f-1e41e143e223 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:57.096764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f48467d-a6cc-4b46-ab2f-1e41e143e223 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:57.097198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f48467d-a6cc-4b46-ab2f-1e41e143e223 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:57.097887 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f48467d-a6cc-4b46-ab2f-1e41e143e223 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:57.098340 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f48467d-a6cc-4b46-ab2f-1e41e143e223 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:57.098761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f48467d-a6cc-4b46-ab2f-1e41e143e223 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:57.127729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7f48467d-a6cc-4b46-ab2f-1e41e143e223 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044671 Aug 30 14:50:57.128281 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 497/1004] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:57 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:57.152429 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-555cf6f5-5d34-42e2-86f1-aa905cf1bfdd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:57.154636 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-555cf6f5-5d34-42e2-86f1-aa905cf1bfdd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:57.156671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 14:50:57.156819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 14:50:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments (ip 10.222.0.30) !!! Aug 30 14:50:57.163282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-555cf6f5-5d34-42e2-86f1-aa905cf1bfdd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:57.163771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-555cf6f5-5d34-42e2-86f1-aa905cf1bfdd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:57.165175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-555cf6f5-5d34-42e2-86f1-aa905cf1bfdd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:57.165879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-555cf6f5-5d34-42e2-86f1-aa905cf1bfdd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:57.166337 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-555cf6f5-5d34-42e2-86f1-aa905cf1bfdd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:57.166764 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-555cf6f5-5d34-42e2-86f1-aa905cf1bfdd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:57.197129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-555cf6f5-5d34-42e2-86f1-aa905cf1bfdd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049219 Aug 30 14:50:57.197679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 508/1005] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:57 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:58.140245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8ccf3d9d-5142-4628-a5b5-38cb6c77236d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:58.142362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8ccf3d9d-5142-4628-a5b5-38cb6c77236d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:58.148853 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ccf3d9d-5142-4628-a5b5-38cb6c77236d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:58.149261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ccf3d9d-5142-4628-a5b5-38cb6c77236d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:58.149690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ccf3d9d-5142-4628-a5b5-38cb6c77236d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:58.150375 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ccf3d9d-5142-4628-a5b5-38cb6c77236d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:58.150824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ccf3d9d-5142-4628-a5b5-38cb6c77236d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:58.151264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ccf3d9d-5142-4628-a5b5-38cb6c77236d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:58.181307 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8ccf3d9d-5142-4628-a5b5-38cb6c77236d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045025 Aug 30 14:50:58.181864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 498/1006] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:58 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:58.209409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-82ba84f5-19cb-46b2-90a9-e41435888f94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:58.211682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-82ba84f5-19cb-46b2-90a9-e41435888f94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:58.218093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82ba84f5-19cb-46b2-90a9-e41435888f94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:58.218591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82ba84f5-19cb-46b2-90a9-e41435888f94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:58.219024 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82ba84f5-19cb-46b2-90a9-e41435888f94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:58.219755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82ba84f5-19cb-46b2-90a9-e41435888f94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:58.220209 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82ba84f5-19cb-46b2-90a9-e41435888f94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:58.220632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82ba84f5-19cb-46b2-90a9-e41435888f94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:58.250367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-82ba84f5-19cb-46b2-90a9-e41435888f94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044895 Aug 30 14:50:58.250924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 509/1007] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:58 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:50:59.193641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-996cd36a-ab48-46c2-8c7c-2e1bfad0db83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:59.196410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-996cd36a-ab48-46c2-8c7c-2e1bfad0db83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:59.202646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-996cd36a-ab48-46c2-8c7c-2e1bfad0db83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:59.203114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-996cd36a-ab48-46c2-8c7c-2e1bfad0db83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:59.203572 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-996cd36a-ab48-46c2-8c7c-2e1bfad0db83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:59.204242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-996cd36a-ab48-46c2-8c7c-2e1bfad0db83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:59.204768 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-996cd36a-ab48-46c2-8c7c-2e1bfad0db83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:59.205184 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-996cd36a-ab48-46c2-8c7c-2e1bfad0db83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:59.236472 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-996cd36a-ab48-46c2-8c7c-2e1bfad0db83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047025 Aug 30 14:50:59.237166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 499/1008] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:50:59 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:50:59.262898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-95a1643d-d2ff-4a89-83ab-107cbb06b589 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:50:59.265053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-95a1643d-d2ff-4a89-83ab-107cbb06b589 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:50:59.271399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95a1643d-d2ff-4a89-83ab-107cbb06b589 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:59.271884 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95a1643d-d2ff-4a89-83ab-107cbb06b589 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:59.272320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95a1643d-d2ff-4a89-83ab-107cbb06b589 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:59.273007 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95a1643d-d2ff-4a89-83ab-107cbb06b589 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:50:59.273459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95a1643d-d2ff-4a89-83ab-107cbb06b589 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:50:59.273882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-95a1643d-d2ff-4a89-83ab-107cbb06b589 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:50:59.289932 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:50:59.303271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-95a1643d-d2ff-4a89-83ab-107cbb06b589 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044340 Aug 30 14:50:59.303853 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 510/1009] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:50:59 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:00.249312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-48ef2a34-355e-4cbc-98a3-ee5d16e8723a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:00.251520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-48ef2a34-355e-4cbc-98a3-ee5d16e8723a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:00.257863 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48ef2a34-355e-4cbc-98a3-ee5d16e8723a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:00.258383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48ef2a34-355e-4cbc-98a3-ee5d16e8723a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:00.258813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48ef2a34-355e-4cbc-98a3-ee5d16e8723a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:00.259515 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48ef2a34-355e-4cbc-98a3-ee5d16e8723a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:00.259958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48ef2a34-355e-4cbc-98a3-ee5d16e8723a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:00.260371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48ef2a34-355e-4cbc-98a3-ee5d16e8723a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:00.289624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-48ef2a34-355e-4cbc-98a3-ee5d16e8723a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043671 Aug 30 14:51:00.290206 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 500/1010] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:00 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:00.316525 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-eec4eb7d-c193-4bd7-8dfc-178916e04168 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:00.318658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-eec4eb7d-c193-4bd7-8dfc-178916e04168 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:00.325597 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eec4eb7d-c193-4bd7-8dfc-178916e04168 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:00.326053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eec4eb7d-c193-4bd7-8dfc-178916e04168 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:00.326478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eec4eb7d-c193-4bd7-8dfc-178916e04168 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:00.327157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eec4eb7d-c193-4bd7-8dfc-178916e04168 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:00.327650 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eec4eb7d-c193-4bd7-8dfc-178916e04168 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:00.328066 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eec4eb7d-c193-4bd7-8dfc-178916e04168 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:00.363622 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-eec4eb7d-c193-4bd7-8dfc-178916e04168 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051373 Aug 30 14:51:00.364190 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 511/1011] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:00 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:01.301951 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8733b458-c5e2-4aa0-8e04-2f8201cc8c50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:01.304147 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8733b458-c5e2-4aa0-8e04-2f8201cc8c50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:01.311415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8733b458-c5e2-4aa0-8e04-2f8201cc8c50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:01.311903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8733b458-c5e2-4aa0-8e04-2f8201cc8c50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:01.312336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8733b458-c5e2-4aa0-8e04-2f8201cc8c50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:01.313025 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8733b458-c5e2-4aa0-8e04-2f8201cc8c50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:01.313474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8733b458-c5e2-4aa0-8e04-2f8201cc8c50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:01.313900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8733b458-c5e2-4aa0-8e04-2f8201cc8c50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:01.343094 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8733b458-c5e2-4aa0-8e04-2f8201cc8c50 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045115 Aug 30 14:51:01.344187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 501/1012] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:01 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:01.376072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-da2266f1-7992-4cf7-9998-9698927dd4fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:01.378208 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-da2266f1-7992-4cf7-9998-9698927dd4fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:01.384580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da2266f1-7992-4cf7-9998-9698927dd4fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:01.385064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da2266f1-7992-4cf7-9998-9698927dd4fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:01.385503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da2266f1-7992-4cf7-9998-9698927dd4fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:01.386198 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da2266f1-7992-4cf7-9998-9698927dd4fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:01.386652 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da2266f1-7992-4cf7-9998-9698927dd4fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:01.387077 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da2266f1-7992-4cf7-9998-9698927dd4fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:01.415785 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-da2266f1-7992-4cf7-9998-9698927dd4fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043628 Aug 30 14:51:01.416333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 512/1013] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:01 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:02.355970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b15f3556-e78d-4b42-92e4-60f0f0cf154b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:02.358381 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b15f3556-e78d-4b42-92e4-60f0f0cf154b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:02.364614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b15f3556-e78d-4b42-92e4-60f0f0cf154b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:02.365085 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b15f3556-e78d-4b42-92e4-60f0f0cf154b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:02.365513 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b15f3556-e78d-4b42-92e4-60f0f0cf154b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:02.366187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b15f3556-e78d-4b42-92e4-60f0f0cf154b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:02.366631 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b15f3556-e78d-4b42-92e4-60f0f0cf154b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:02.367808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b15f3556-e78d-4b42-92e4-60f0f0cf154b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:02.396580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b15f3556-e78d-4b42-92e4-60f0f0cf154b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044615 Aug 30 14:51:02.397120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 502/1014] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:02 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:02.427906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0adc9429-886a-4e5f-8d33-0a4637ba30aa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:02.430513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0adc9429-886a-4e5f-8d33-0a4637ba30aa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:02.436816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0adc9429-886a-4e5f-8d33-0a4637ba30aa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:02.437323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0adc9429-886a-4e5f-8d33-0a4637ba30aa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:02.437754 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0adc9429-886a-4e5f-8d33-0a4637ba30aa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:02.438436 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0adc9429-886a-4e5f-8d33-0a4637ba30aa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:02.438887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0adc9429-886a-4e5f-8d33-0a4637ba30aa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:02.439334 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0adc9429-886a-4e5f-8d33-0a4637ba30aa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:02.468346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0adc9429-886a-4e5f-8d33-0a4637ba30aa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044341 Aug 30 14:51:02.468895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 513/1015] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:02 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:03.408706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-59a8a44c-19df-4d6f-b2e0-df95de0ba431 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:03.410813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-59a8a44c-19df-4d6f-b2e0-df95de0ba431 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:03.417318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59a8a44c-19df-4d6f-b2e0-df95de0ba431 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:03.417792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59a8a44c-19df-4d6f-b2e0-df95de0ba431 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:03.418222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59a8a44c-19df-4d6f-b2e0-df95de0ba431 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:03.418903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59a8a44c-19df-4d6f-b2e0-df95de0ba431 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:03.419413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59a8a44c-19df-4d6f-b2e0-df95de0ba431 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:03.419836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59a8a44c-19df-4d6f-b2e0-df95de0ba431 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:03.449043 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-59a8a44c-19df-4d6f-b2e0-df95de0ba431 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044174 Aug 30 14:51:03.449518 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 503/1016] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:03 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:03.480658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2c847f4e-bd68-4330-a276-48c750ad0803 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:03.482769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2c847f4e-bd68-4330-a276-48c750ad0803 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:03.489105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c847f4e-bd68-4330-a276-48c750ad0803 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:03.489588 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c847f4e-bd68-4330-a276-48c750ad0803 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:03.490023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c847f4e-bd68-4330-a276-48c750ad0803 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:03.490712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c847f4e-bd68-4330-a276-48c750ad0803 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:03.491160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c847f4e-bd68-4330-a276-48c750ad0803 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:03.491621 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c847f4e-bd68-4330-a276-48c750ad0803 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:03.520532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2c847f4e-bd68-4330-a276-48c750ad0803 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043981 Aug 30 14:51:03.521104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 514/1017] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:03 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:04.460877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a9bb25e1-48a8-4688-a2c7-82ea6da4aaf8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:04.463449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a9bb25e1-48a8-4688-a2c7-82ea6da4aaf8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:04.465795 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=58 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:04.471113 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9bb25e1-48a8-4688-a2c7-82ea6da4aaf8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:04.471620 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9bb25e1-48a8-4688-a2c7-82ea6da4aaf8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:04.472045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9bb25e1-48a8-4688-a2c7-82ea6da4aaf8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:04.472724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9bb25e1-48a8-4688-a2c7-82ea6da4aaf8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:04.473169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9bb25e1-48a8-4688-a2c7-82ea6da4aaf8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:04.473584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9bb25e1-48a8-4688-a2c7-82ea6da4aaf8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:04.502713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a9bb25e1-48a8-4688-a2c7-82ea6da4aaf8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045829 Aug 30 14:51:04.503272 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 504/1018] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:04 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:04.533064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-50975b77-48bd-47b5-8019-acb136fa8933 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:04.535252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-50975b77-48bd-47b5-8019-acb136fa8933 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:04.542620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-50975b77-48bd-47b5-8019-acb136fa8933 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:04.543097 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-50975b77-48bd-47b5-8019-acb136fa8933 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:04.543553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-50975b77-48bd-47b5-8019-acb136fa8933 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:04.544238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-50975b77-48bd-47b5-8019-acb136fa8933 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:04.544682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-50975b77-48bd-47b5-8019-acb136fa8933 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:04.545100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-50975b77-48bd-47b5-8019-acb136fa8933 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:04.574855 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-50975b77-48bd-47b5-8019-acb136fa8933 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045691 Aug 30 14:51:04.575450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 515/1019] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:04 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:05.514664 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fe297fac-2aa8-4602-b09b-777f7c24810f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:05.516843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fe297fac-2aa8-4602-b09b-777f7c24810f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:05.523118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe297fac-2aa8-4602-b09b-777f7c24810f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:05.523661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe297fac-2aa8-4602-b09b-777f7c24810f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:05.524094 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe297fac-2aa8-4602-b09b-777f7c24810f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:05.524779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe297fac-2aa8-4602-b09b-777f7c24810f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:05.525424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe297fac-2aa8-4602-b09b-777f7c24810f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:05.525844 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe297fac-2aa8-4602-b09b-777f7c24810f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:05.556521 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fe297fac-2aa8-4602-b09b-777f7c24810f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045184 Aug 30 14:51:05.557309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 505/1020] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:05 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:51:05.587285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9c2aa3e5-04be-40ff-a1f4-09120ad89683 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:05.589434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9c2aa3e5-04be-40ff-a1f4-09120ad89683 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:05.591784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=58 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:05.597013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c2aa3e5-04be-40ff-a1f4-09120ad89683 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:05.597495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c2aa3e5-04be-40ff-a1f4-09120ad89683 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:05.597932 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c2aa3e5-04be-40ff-a1f4-09120ad89683 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:05.598636 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c2aa3e5-04be-40ff-a1f4-09120ad89683 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:05.599084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c2aa3e5-04be-40ff-a1f4-09120ad89683 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:05.599533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c2aa3e5-04be-40ff-a1f4-09120ad89683 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:05.629502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9c2aa3e5-04be-40ff-a1f4-09120ad89683 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046329 Aug 30 14:51:05.630054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 516/1021] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:05 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:06.569065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-868206a3-167d-4ae4-b707-3c59e715f2c6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:06.571230 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-868206a3-167d-4ae4-b707-3c59e715f2c6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:06.578469 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-868206a3-167d-4ae4-b707-3c59e715f2c6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:06.578949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-868206a3-167d-4ae4-b707-3c59e715f2c6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:06.579422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-868206a3-167d-4ae4-b707-3c59e715f2c6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:06.580106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-868206a3-167d-4ae4-b707-3c59e715f2c6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:06.580550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-868206a3-167d-4ae4-b707-3c59e715f2c6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:06.580971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-868206a3-167d-4ae4-b707-3c59e715f2c6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:06.606639 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:06.612170 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-868206a3-167d-4ae4-b707-3c59e715f2c6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047439 Aug 30 14:51:06.612735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 506/1022] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:06 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:06.641934 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f726f131-7b5b-4aff-af70-954ac03e8562 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:06.644122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f726f131-7b5b-4aff-af70-954ac03e8562 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:06.651275 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f726f131-7b5b-4aff-af70-954ac03e8562 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:06.651766 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f726f131-7b5b-4aff-af70-954ac03e8562 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:06.652203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f726f131-7b5b-4aff-af70-954ac03e8562 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:06.652895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f726f131-7b5b-4aff-af70-954ac03e8562 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:06.653349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f726f131-7b5b-4aff-af70-954ac03e8562 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:06.653770 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f726f131-7b5b-4aff-af70-954ac03e8562 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:06.682245 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f726f131-7b5b-4aff-af70-954ac03e8562 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044307 Aug 30 14:51:06.682796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 517/1023] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:06 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:07.624456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-16e3e030-a435-474a-b85f-60008b01d066 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:07.626596 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-16e3e030-a435-474a-b85f-60008b01d066 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:07.633276 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16e3e030-a435-474a-b85f-60008b01d066 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:07.633845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16e3e030-a435-474a-b85f-60008b01d066 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:07.634281 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16e3e030-a435-474a-b85f-60008b01d066 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:07.634955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16e3e030-a435-474a-b85f-60008b01d066 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:07.635511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16e3e030-a435-474a-b85f-60008b01d066 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:07.635982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16e3e030-a435-474a-b85f-60008b01d066 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:07.666476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-16e3e030-a435-474a-b85f-60008b01d066 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045703 Aug 30 14:51:07.667026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 507/1024] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:07 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:07.694139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4010d2cc-f08d-4fc3-a7f0-bdedd3098c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:07.696475 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4010d2cc-f08d-4fc3-a7f0-bdedd3098c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:07.702845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4010d2cc-f08d-4fc3-a7f0-bdedd3098c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:07.703375 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4010d2cc-f08d-4fc3-a7f0-bdedd3098c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:07.703812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4010d2cc-f08d-4fc3-a7f0-bdedd3098c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:07.704504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4010d2cc-f08d-4fc3-a7f0-bdedd3098c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:07.704956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4010d2cc-f08d-4fc3-a7f0-bdedd3098c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:07.705382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4010d2cc-f08d-4fc3-a7f0-bdedd3098c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:07.734958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4010d2cc-f08d-4fc3-a7f0-bdedd3098c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044996 Aug 30 14:51:07.735543 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 518/1025] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:07 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:08.678502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b085226c-1f8e-4dcc-96bb-281daf460c8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:08.681250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b085226c-1f8e-4dcc-96bb-281daf460c8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:08.687465 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b085226c-1f8e-4dcc-96bb-281daf460c8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:08.687936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b085226c-1f8e-4dcc-96bb-281daf460c8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:08.688361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b085226c-1f8e-4dcc-96bb-281daf460c8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:08.689035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b085226c-1f8e-4dcc-96bb-281daf460c8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:08.689479 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b085226c-1f8e-4dcc-96bb-281daf460c8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:08.689891 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b085226c-1f8e-4dcc-96bb-281daf460c8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:08.719166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b085226c-1f8e-4dcc-96bb-281daf460c8f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044502 Aug 30 14:51:08.719678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 508/1026] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:08 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:08.747748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4b195d8c-a34a-4f28-9fe1-b659ecd92870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:08.749924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4b195d8c-a34a-4f28-9fe1-b659ecd92870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:08.756367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b195d8c-a34a-4f28-9fe1-b659ecd92870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:08.756859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b195d8c-a34a-4f28-9fe1-b659ecd92870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:08.757293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b195d8c-a34a-4f28-9fe1-b659ecd92870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:08.757983 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b195d8c-a34a-4f28-9fe1-b659ecd92870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:08.758439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b195d8c-a34a-4f28-9fe1-b659ecd92870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:08.758978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b195d8c-a34a-4f28-9fe1-b659ecd92870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:08.787267 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4b195d8c-a34a-4f28-9fe1-b659ecd92870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044226 Aug 30 14:51:08.787813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 519/1027] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:08 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:09.731481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-89901c3a-ff14-40b2-8491-2f51bb9faa08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:09.733541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-89901c3a-ff14-40b2-8491-2f51bb9faa08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:09.739875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89901c3a-ff14-40b2-8491-2f51bb9faa08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:09.740363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89901c3a-ff14-40b2-8491-2f51bb9faa08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:09.740799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89901c3a-ff14-40b2-8491-2f51bb9faa08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:09.741481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89901c3a-ff14-40b2-8491-2f51bb9faa08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:09.741932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89901c3a-ff14-40b2-8491-2f51bb9faa08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:09.742353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89901c3a-ff14-40b2-8491-2f51bb9faa08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:09.773003 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-89901c3a-ff14-40b2-8491-2f51bb9faa08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Aug 30 14:51:09.773564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 509/1028] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:09 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:09.800208 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bc0aae10-6444-4fd8-a2d7-2651e760296a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:09.802365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bc0aae10-6444-4fd8-a2d7-2651e760296a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:09.809336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc0aae10-6444-4fd8-a2d7-2651e760296a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:09.809816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc0aae10-6444-4fd8-a2d7-2651e760296a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:09.810251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc0aae10-6444-4fd8-a2d7-2651e760296a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:09.810934 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc0aae10-6444-4fd8-a2d7-2651e760296a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:09.811412 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc0aae10-6444-4fd8-a2d7-2651e760296a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:09.811835 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc0aae10-6444-4fd8-a2d7-2651e760296a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:09.841477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bc0aae10-6444-4fd8-a2d7-2651e760296a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045213 Aug 30 14:51:09.842024 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 520/1029] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:09 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:10.785214 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bc79efbe-bd67-4820-8cc8-d9654fe107e5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:10.787269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bc79efbe-bd67-4820-8cc8-d9654fe107e5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:10.794302 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc79efbe-bd67-4820-8cc8-d9654fe107e5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:10.794779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc79efbe-bd67-4820-8cc8-d9654fe107e5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:10.795217 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc79efbe-bd67-4820-8cc8-d9654fe107e5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:10.795907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc79efbe-bd67-4820-8cc8-d9654fe107e5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:10.796352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc79efbe-bd67-4820-8cc8-d9654fe107e5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:10.796769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc79efbe-bd67-4820-8cc8-d9654fe107e5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:10.826096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bc79efbe-bd67-4820-8cc8-d9654fe107e5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Aug 30 14:51:10.826655 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 510/1030] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:10 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:10.853117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9cf1a477-075c-4a04-883b-ef80c2373af9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:10.855235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9cf1a477-075c-4a04-883b-ef80c2373af9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:10.861561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9cf1a477-075c-4a04-883b-ef80c2373af9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:10.862044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9cf1a477-075c-4a04-883b-ef80c2373af9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:10.862480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9cf1a477-075c-4a04-883b-ef80c2373af9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:10.863162 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9cf1a477-075c-4a04-883b-ef80c2373af9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:10.863635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9cf1a477-075c-4a04-883b-ef80c2373af9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:10.864056 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9cf1a477-075c-4a04-883b-ef80c2373af9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:10.892868 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9cf1a477-075c-4a04-883b-ef80c2373af9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043960 Aug 30 14:51:10.893507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 521/1031] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:10 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:11.838064 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fdf57a07-a7a6-417a-9ca1-63a51707f3d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:11.840129 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fdf57a07-a7a6-417a-9ca1-63a51707f3d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:11.846480 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdf57a07-a7a6-417a-9ca1-63a51707f3d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:11.846957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdf57a07-a7a6-417a-9ca1-63a51707f3d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:11.847431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdf57a07-a7a6-417a-9ca1-63a51707f3d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:11.848121 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdf57a07-a7a6-417a-9ca1-63a51707f3d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:11.848570 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdf57a07-a7a6-417a-9ca1-63a51707f3d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:11.848991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fdf57a07-a7a6-417a-9ca1-63a51707f3d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:11.878981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fdf57a07-a7a6-417a-9ca1-63a51707f3d2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045094 Aug 30 14:51:11.879584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 511/1032] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:11 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:11.905288 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f5e862de-3acf-4ad4-bf3b-ab90cd27fd15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:11.907432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f5e862de-3acf-4ad4-bf3b-ab90cd27fd15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:11.913723 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5e862de-3acf-4ad4-bf3b-ab90cd27fd15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:11.914197 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5e862de-3acf-4ad4-bf3b-ab90cd27fd15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:11.914628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5e862de-3acf-4ad4-bf3b-ab90cd27fd15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:11.916074 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5e862de-3acf-4ad4-bf3b-ab90cd27fd15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:11.916474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5e862de-3acf-4ad4-bf3b-ab90cd27fd15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:11.916892 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f5e862de-3acf-4ad4-bf3b-ab90cd27fd15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:11.945734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f5e862de-3acf-4ad4-bf3b-ab90cd27fd15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044589 Aug 30 14:51:11.946344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 522/1033] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:11 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:12.891080 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-96307992-df36-4a69-b60c-20e201677672 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:12.893127 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-96307992-df36-4a69-b60c-20e201677672 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:12.899464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96307992-df36-4a69-b60c-20e201677672 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:12.899944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96307992-df36-4a69-b60c-20e201677672 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:12.900363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96307992-df36-4a69-b60c-20e201677672 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:12.901038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96307992-df36-4a69-b60c-20e201677672 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:12.901477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96307992-df36-4a69-b60c-20e201677672 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:12.901889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96307992-df36-4a69-b60c-20e201677672 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:12.929998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-96307992-df36-4a69-b60c-20e201677672 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042919 Aug 30 14:51:12.931049 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 512/1034] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:12 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:12.957985 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1e451e05-3efb-4fba-9e22-5554a17c72c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:12.960175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1e451e05-3efb-4fba-9e22-5554a17c72c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:12.966522 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1e451e05-3efb-4fba-9e22-5554a17c72c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:12.967000 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1e451e05-3efb-4fba-9e22-5554a17c72c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:12.967468 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1e451e05-3efb-4fba-9e22-5554a17c72c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:12.968155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1e451e05-3efb-4fba-9e22-5554a17c72c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:12.968601 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1e451e05-3efb-4fba-9e22-5554a17c72c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:12.969020 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1e451e05-3efb-4fba-9e22-5554a17c72c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:12.998700 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1e451e05-3efb-4fba-9e22-5554a17c72c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044779 Aug 30 14:51:12.999297 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 523/1035] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:12 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:13.942248 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8f362763-e447-4a8c-bfe7-8a33e60ccd5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:13.944309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8f362763-e447-4a8c-bfe7-8a33e60ccd5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:13.951236 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f362763-e447-4a8c-bfe7-8a33e60ccd5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:13.951745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f362763-e447-4a8c-bfe7-8a33e60ccd5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:13.952178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f362763-e447-4a8c-bfe7-8a33e60ccd5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:13.952861 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f362763-e447-4a8c-bfe7-8a33e60ccd5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:13.953305 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f362763-e447-4a8c-bfe7-8a33e60ccd5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:13.953724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f362763-e447-4a8c-bfe7-8a33e60ccd5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:13.983062 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8f362763-e447-4a8c-bfe7-8a33e60ccd5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045058 Aug 30 14:51:13.983637 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 513/1036] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:13 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:14.011977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-06e789f3-aa42-4a38-9005-f26dea1d41f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:14.013705 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-06e789f3-aa42-4a38-9005-f26dea1d41f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:14.020028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-06e789f3-aa42-4a38-9005-f26dea1d41f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:14.020505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-06e789f3-aa42-4a38-9005-f26dea1d41f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:14.020932 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-06e789f3-aa42-4a38-9005-f26dea1d41f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:14.021678 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-06e789f3-aa42-4a38-9005-f26dea1d41f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:14.022124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-06e789f3-aa42-4a38-9005-f26dea1d41f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:14.022538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-06e789f3-aa42-4a38-9005-f26dea1d41f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:14.051194 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-06e789f3-aa42-4a38-9005-f26dea1d41f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044152 Aug 30 14:51:14.051755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 524/1037] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:14 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:14.994883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-63a34409-9d03-4747-bd74-2def63b2da00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:14.996984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-63a34409-9d03-4747-bd74-2def63b2da00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:15.003338 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63a34409-9d03-4747-bd74-2def63b2da00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:15.003810 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63a34409-9d03-4747-bd74-2def63b2da00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:15.004235 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63a34409-9d03-4747-bd74-2def63b2da00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:15.004907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63a34409-9d03-4747-bd74-2def63b2da00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:15.005346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63a34409-9d03-4747-bd74-2def63b2da00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:15.005756 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63a34409-9d03-4747-bd74-2def63b2da00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:15.034233 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-63a34409-9d03-4747-bd74-2def63b2da00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043322 Aug 30 14:51:15.034773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 514/1038] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:14 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:15.063339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-16fa80ea-518f-4780-9716-89a7cb1b999e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:15.065445 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-16fa80ea-518f-4780-9716-89a7cb1b999e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:15.071705 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-16fa80ea-518f-4780-9716-89a7cb1b999e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:15.072185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-16fa80ea-518f-4780-9716-89a7cb1b999e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:15.072616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-16fa80ea-518f-4780-9716-89a7cb1b999e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:15.073302 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-16fa80ea-518f-4780-9716-89a7cb1b999e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:15.073753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-16fa80ea-518f-4780-9716-89a7cb1b999e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:15.074175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-16fa80ea-518f-4780-9716-89a7cb1b999e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:15.103770 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-16fa80ea-518f-4780-9716-89a7cb1b999e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044488 Aug 30 14:51:15.104320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 525/1039] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:15 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:16.046088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3cc7060e-2a8a-45e4-b56f-605f6d511de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:16.048207 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3cc7060e-2a8a-45e4-b56f-605f6d511de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:16.054540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cc7060e-2a8a-45e4-b56f-605f6d511de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:16.055022 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cc7060e-2a8a-45e4-b56f-605f6d511de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:16.056015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cc7060e-2a8a-45e4-b56f-605f6d511de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:16.056700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cc7060e-2a8a-45e4-b56f-605f6d511de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:16.057149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cc7060e-2a8a-45e4-b56f-605f6d511de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:16.057569 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cc7060e-2a8a-45e4-b56f-605f6d511de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:16.087493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3cc7060e-2a8a-45e4-b56f-605f6d511de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045405 Aug 30 14:51:16.088064 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 515/1040] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:16 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:16.115583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d2476810-aee8-42ab-9aea-8acbe96c38b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:16.118444 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d2476810-aee8-42ab-9aea-8acbe96c38b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:16.125488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d2476810-aee8-42ab-9aea-8acbe96c38b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:16.125967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d2476810-aee8-42ab-9aea-8acbe96c38b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:16.126401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d2476810-aee8-42ab-9aea-8acbe96c38b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:16.127089 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d2476810-aee8-42ab-9aea-8acbe96c38b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:16.127575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d2476810-aee8-42ab-9aea-8acbe96c38b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:16.127996 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d2476810-aee8-42ab-9aea-8acbe96c38b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:16.156590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d2476810-aee8-42ab-9aea-8acbe96c38b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045020 Aug 30 14:51:16.157133 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 526/1041] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:16 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:17.099622 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-66c850fa-fda4-4d13-8586-5c200f937041 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:17.101646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-66c850fa-fda4-4d13-8586-5c200f937041 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:17.108057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66c850fa-fda4-4d13-8586-5c200f937041 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:17.108529 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66c850fa-fda4-4d13-8586-5c200f937041 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:17.108958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66c850fa-fda4-4d13-8586-5c200f937041 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:17.109636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66c850fa-fda4-4d13-8586-5c200f937041 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:17.110077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66c850fa-fda4-4d13-8586-5c200f937041 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:17.110489 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66c850fa-fda4-4d13-8586-5c200f937041 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:17.139822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-66c850fa-fda4-4d13-8586-5c200f937041 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044202 Aug 30 14:51:17.140369 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 516/1042] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:17 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:17.169016 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1997eb05-97d9-41ce-82c0-600b9d96f6d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:17.171135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1997eb05-97d9-41ce-82c0-600b9d96f6d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:17.177612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1997eb05-97d9-41ce-82c0-600b9d96f6d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:17.178091 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1997eb05-97d9-41ce-82c0-600b9d96f6d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:17.178522 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1997eb05-97d9-41ce-82c0-600b9d96f6d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:17.179223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1997eb05-97d9-41ce-82c0-600b9d96f6d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:17.179695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1997eb05-97d9-41ce-82c0-600b9d96f6d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:17.180148 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1997eb05-97d9-41ce-82c0-600b9d96f6d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:17.184005 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:17.210373 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1997eb05-97d9-41ce-82c0-600b9d96f6d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045587 Aug 30 14:51:17.210940 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 527/1043] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:17 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:18.151721 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b78c039b-4cde-47c9-8ac8-25999b85ba74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:18.153826 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b78c039b-4cde-47c9-8ac8-25999b85ba74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:18.160137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b78c039b-4cde-47c9-8ac8-25999b85ba74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:18.160604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b78c039b-4cde-47c9-8ac8-25999b85ba74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:18.161029 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b78c039b-4cde-47c9-8ac8-25999b85ba74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:18.161699 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b78c039b-4cde-47c9-8ac8-25999b85ba74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:18.162139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b78c039b-4cde-47c9-8ac8-25999b85ba74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:18.162552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b78c039b-4cde-47c9-8ac8-25999b85ba74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:18.190988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b78c039b-4cde-47c9-8ac8-25999b85ba74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Aug 30 14:51:18.191804 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 517/1044] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:18 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:18.223866 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9ca050dc-8fb7-4d99-8b88-4bb1c9779f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:18.225990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9ca050dc-8fb7-4d99-8b88-4bb1c9779f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:18.233131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9ca050dc-8fb7-4d99-8b88-4bb1c9779f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:18.233609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9ca050dc-8fb7-4d99-8b88-4bb1c9779f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:18.234041 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9ca050dc-8fb7-4d99-8b88-4bb1c9779f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:18.234730 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9ca050dc-8fb7-4d99-8b88-4bb1c9779f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:18.235180 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9ca050dc-8fb7-4d99-8b88-4bb1c9779f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:18.235631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9ca050dc-8fb7-4d99-8b88-4bb1c9779f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:18.263595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9ca050dc-8fb7-4d99-8b88-4bb1c9779f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043746 Aug 30 14:51:18.264139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 528/1045] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:18 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:19.203533 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1c6ab317-328e-4b62-b306-1e1015771be3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:19.205590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1c6ab317-328e-4b62-b306-1e1015771be3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:19.212269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c6ab317-328e-4b62-b306-1e1015771be3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:19.212748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c6ab317-328e-4b62-b306-1e1015771be3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:19.213175 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c6ab317-328e-4b62-b306-1e1015771be3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:19.213856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c6ab317-328e-4b62-b306-1e1015771be3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:19.214297 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c6ab317-328e-4b62-b306-1e1015771be3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:19.214766 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c6ab317-328e-4b62-b306-1e1015771be3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:19.245531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1c6ab317-328e-4b62-b306-1e1015771be3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046004 Aug 30 14:51:19.246094 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 518/1046] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:19 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:19.275992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0b147eae-5948-41c4-9bb6-7e15c7ba429d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:19.278124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0b147eae-5948-41c4-9bb6-7e15c7ba429d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:19.284420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b147eae-5948-41c4-9bb6-7e15c7ba429d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:19.284895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b147eae-5948-41c4-9bb6-7e15c7ba429d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:19.285325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b147eae-5948-41c4-9bb6-7e15c7ba429d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:19.286000 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b147eae-5948-41c4-9bb6-7e15c7ba429d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:19.286440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b147eae-5948-41c4-9bb6-7e15c7ba429d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:19.286858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b147eae-5948-41c4-9bb6-7e15c7ba429d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:19.316522 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0b147eae-5948-41c4-9bb6-7e15c7ba429d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044276 Aug 30 14:51:19.317063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 529/1047] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:19 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:20.257944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f6939b0a-1d8e-4461-906b-223b488321c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:20.260331 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f6939b0a-1d8e-4461-906b-223b488321c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:20.266266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f6939b0a-1d8e-4461-906b-223b488321c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:20.266697 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f6939b0a-1d8e-4461-906b-223b488321c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:20.267194 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f6939b0a-1d8e-4461-906b-223b488321c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:20.267897 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f6939b0a-1d8e-4461-906b-223b488321c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:20.268402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f6939b0a-1d8e-4461-906b-223b488321c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:20.268824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f6939b0a-1d8e-4461-906b-223b488321c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:20.298879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f6939b0a-1d8e-4461-906b-223b488321c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045011 Aug 30 14:51:20.299588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 519/1048] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:20 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:20.329535 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-04e48a60-c78a-4105-ba42-6b4009134ae5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:20.331688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-04e48a60-c78a-4105-ba42-6b4009134ae5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:20.338920 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04e48a60-c78a-4105-ba42-6b4009134ae5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:20.339459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04e48a60-c78a-4105-ba42-6b4009134ae5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:20.339892 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04e48a60-c78a-4105-ba42-6b4009134ae5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:20.340583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04e48a60-c78a-4105-ba42-6b4009134ae5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:20.341030 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04e48a60-c78a-4105-ba42-6b4009134ae5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:20.341453 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04e48a60-c78a-4105-ba42-6b4009134ae5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:20.370482 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-04e48a60-c78a-4105-ba42-6b4009134ae5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045031 Aug 30 14:51:20.371047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 530/1049] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:20 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:21.310915 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7284fd53-1ba9-46ef-a104-77dc3f4ac0aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:21.313096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7284fd53-1ba9-46ef-a104-77dc3f4ac0aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:21.319668 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7284fd53-1ba9-46ef-a104-77dc3f4ac0aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:21.320137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7284fd53-1ba9-46ef-a104-77dc3f4ac0aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:21.320563 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7284fd53-1ba9-46ef-a104-77dc3f4ac0aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:21.321990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7284fd53-1ba9-46ef-a104-77dc3f4ac0aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:21.322439 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7284fd53-1ba9-46ef-a104-77dc3f4ac0aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:21.322858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7284fd53-1ba9-46ef-a104-77dc3f4ac0aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:21.352548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7284fd53-1ba9-46ef-a104-77dc3f4ac0aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044994 Aug 30 14:51:21.353078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 520/1050] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:21 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:21.382595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3dd20582-9582-4462-99f9-a3b24ee5e283 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:21.384795 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3dd20582-9582-4462-99f9-a3b24ee5e283 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:21.391323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3dd20582-9582-4462-99f9-a3b24ee5e283 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:21.391806 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3dd20582-9582-4462-99f9-a3b24ee5e283 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:21.392238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3dd20582-9582-4462-99f9-a3b24ee5e283 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:21.392922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3dd20582-9582-4462-99f9-a3b24ee5e283 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:21.393369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3dd20582-9582-4462-99f9-a3b24ee5e283 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:21.393787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3dd20582-9582-4462-99f9-a3b24ee5e283 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:21.422831 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3dd20582-9582-4462-99f9-a3b24ee5e283 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044159 Aug 30 14:51:21.423404 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 531/1051] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:21 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:22.364531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8d3fd31c-fcd6-45fa-9f2e-e30be727e0dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:22.366636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8d3fd31c-fcd6-45fa-9f2e-e30be727e0dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:22.373460 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d3fd31c-fcd6-45fa-9f2e-e30be727e0dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:22.373930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d3fd31c-fcd6-45fa-9f2e-e30be727e0dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:22.374380 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d3fd31c-fcd6-45fa-9f2e-e30be727e0dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:22.375056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d3fd31c-fcd6-45fa-9f2e-e30be727e0dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:22.375524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d3fd31c-fcd6-45fa-9f2e-e30be727e0dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:22.375946 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d3fd31c-fcd6-45fa-9f2e-e30be727e0dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:22.404182 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8d3fd31c-fcd6-45fa-9f2e-e30be727e0dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043543 Aug 30 14:51:22.404722 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 521/1052] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:22 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:22.436012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-128a277d-ed00-4322-9381-1b44efc601fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:22.438126 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-128a277d-ed00-4322-9381-1b44efc601fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:22.445026 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-128a277d-ed00-4322-9381-1b44efc601fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:22.445514 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-128a277d-ed00-4322-9381-1b44efc601fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:22.446137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-128a277d-ed00-4322-9381-1b44efc601fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:22.446859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-128a277d-ed00-4322-9381-1b44efc601fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:22.447348 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-128a277d-ed00-4322-9381-1b44efc601fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:22.447773 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-128a277d-ed00-4322-9381-1b44efc601fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:22.477807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-128a277d-ed00-4322-9381-1b44efc601fa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045131 Aug 30 14:51:22.478524 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 532/1053] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:22 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:23.416795 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bdaee02a-cade-4a18-ac78-d9d85ae3a703 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:23.418945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bdaee02a-cade-4a18-ac78-d9d85ae3a703 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:23.425393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdaee02a-cade-4a18-ac78-d9d85ae3a703 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:23.425869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdaee02a-cade-4a18-ac78-d9d85ae3a703 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:23.426296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdaee02a-cade-4a18-ac78-d9d85ae3a703 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:23.426974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdaee02a-cade-4a18-ac78-d9d85ae3a703 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:23.427457 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdaee02a-cade-4a18-ac78-d9d85ae3a703 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:23.427878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdaee02a-cade-4a18-ac78-d9d85ae3a703 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:23.456811 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bdaee02a-cade-4a18-ac78-d9d85ae3a703 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044606 Aug 30 14:51:23.457293 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 522/1054] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:23 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:23.490346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a967672d-9fc9-42c3-9350-d3585e693a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:23.492537 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a967672d-9fc9-42c3-9350-d3585e693a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:23.498971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a967672d-9fc9-42c3-9350-d3585e693a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:23.499491 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a967672d-9fc9-42c3-9350-d3585e693a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:23.499933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a967672d-9fc9-42c3-9350-d3585e693a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:23.500626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a967672d-9fc9-42c3-9350-d3585e693a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:23.501077 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a967672d-9fc9-42c3-9350-d3585e693a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:23.501502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a967672d-9fc9-42c3-9350-d3585e693a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:23.530606 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a967672d-9fc9-42c3-9350-d3585e693a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044312 Aug 30 14:51:23.531159 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 533/1055] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:23 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:24.468857 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-46a8e5ab-d746-451a-acaa-766ae2c8300b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:24.471102 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-46a8e5ab-d746-451a-acaa-766ae2c8300b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:24.477974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46a8e5ab-d746-451a-acaa-766ae2c8300b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:24.478447 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46a8e5ab-d746-451a-acaa-766ae2c8300b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:24.478869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46a8e5ab-d746-451a-acaa-766ae2c8300b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:24.479575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46a8e5ab-d746-451a-acaa-766ae2c8300b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:24.480018 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46a8e5ab-d746-451a-acaa-766ae2c8300b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:24.480431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46a8e5ab-d746-451a-acaa-766ae2c8300b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:24.497769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:24.511751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-46a8e5ab-d746-451a-acaa-766ae2c8300b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046877 Aug 30 14:51:24.512308 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 523/1056] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:24 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:24.542595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5bb5cdc5-c726-440b-8f7f-1d52a563c484 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:24.544782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5bb5cdc5-c726-440b-8f7f-1d52a563c484 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:24.551112 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bb5cdc5-c726-440b-8f7f-1d52a563c484 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:24.551624 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bb5cdc5-c726-440b-8f7f-1d52a563c484 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:24.552061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bb5cdc5-c726-440b-8f7f-1d52a563c484 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:24.552752 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bb5cdc5-c726-440b-8f7f-1d52a563c484 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:24.553205 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bb5cdc5-c726-440b-8f7f-1d52a563c484 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:24.553631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5bb5cdc5-c726-440b-8f7f-1d52a563c484 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:24.583341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5bb5cdc5-c726-440b-8f7f-1d52a563c484 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045342 Aug 30 14:51:24.583898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 534/1057] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:24 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:25.524005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c528ec56-2204-4f40-8851-d151c0d2fb30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:25.526118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c528ec56-2204-4f40-8851-d151c0d2fb30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:25.532495 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c528ec56-2204-4f40-8851-d151c0d2fb30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:25.532970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c528ec56-2204-4f40-8851-d151c0d2fb30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:25.533394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c528ec56-2204-4f40-8851-d151c0d2fb30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:25.534064 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c528ec56-2204-4f40-8851-d151c0d2fb30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:25.534502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c528ec56-2204-4f40-8851-d151c0d2fb30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:25.534914 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c528ec56-2204-4f40-8851-d151c0d2fb30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:25.564115 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c528ec56-2204-4f40-8851-d151c0d2fb30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044148 Aug 30 14:51:25.564676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 524/1058] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:25 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:25.595618 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5d1ce9fb-bc16-49ea-82d1-c689d0c93fac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:25.597777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5d1ce9fb-bc16-49ea-82d1-c689d0c93fac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:25.604188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5d1ce9fb-bc16-49ea-82d1-c689d0c93fac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:25.604659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5d1ce9fb-bc16-49ea-82d1-c689d0c93fac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:25.605083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5d1ce9fb-bc16-49ea-82d1-c689d0c93fac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:25.605761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5d1ce9fb-bc16-49ea-82d1-c689d0c93fac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:25.606199 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5d1ce9fb-bc16-49ea-82d1-c689d0c93fac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:25.606612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5d1ce9fb-bc16-49ea-82d1-c689d0c93fac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:25.636535 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5d1ce9fb-bc16-49ea-82d1-c689d0c93fac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044908 Aug 30 14:51:25.637086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 535/1059] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:25 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:26.576984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ffe88b7c-a2f4-443e-af74-945359269b63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:26.579129 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ffe88b7c-a2f4-443e-af74-945359269b63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:26.585403 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffe88b7c-a2f4-443e-af74-945359269b63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:26.585879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffe88b7c-a2f4-443e-af74-945359269b63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:26.586984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffe88b7c-a2f4-443e-af74-945359269b63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:26.587897 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffe88b7c-a2f4-443e-af74-945359269b63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:26.588378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffe88b7c-a2f4-443e-af74-945359269b63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:26.588771 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffe88b7c-a2f4-443e-af74-945359269b63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:26.617021 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ffe88b7c-a2f4-443e-af74-945359269b63 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043964 Aug 30 14:51:26.617608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 525/1060] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:26 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:26.648307 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5e0f1af1-f190-4ca5-be46-97a0608a1ef5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:26.651008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5e0f1af1-f190-4ca5-be46-97a0608a1ef5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:26.657367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e0f1af1-f190-4ca5-be46-97a0608a1ef5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:26.657881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e0f1af1-f190-4ca5-be46-97a0608a1ef5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:26.658315 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e0f1af1-f190-4ca5-be46-97a0608a1ef5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:26.659006 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e0f1af1-f190-4ca5-be46-97a0608a1ef5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:26.659485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e0f1af1-f190-4ca5-be46-97a0608a1ef5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:26.659911 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e0f1af1-f190-4ca5-be46-97a0608a1ef5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:26.689393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5e0f1af1-f190-4ca5-be46-97a0608a1ef5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044665 Aug 30 14:51:26.690424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 536/1061] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:26 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:27.629140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cea9ac3e-f9c7-4e53-8be7-8dbaefb23d57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:27.631306 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cea9ac3e-f9c7-4e53-8be7-8dbaefb23d57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:27.637502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cea9ac3e-f9c7-4e53-8be7-8dbaefb23d57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:27.637973 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cea9ac3e-f9c7-4e53-8be7-8dbaefb23d57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:27.638397 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cea9ac3e-f9c7-4e53-8be7-8dbaefb23d57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:27.639077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cea9ac3e-f9c7-4e53-8be7-8dbaefb23d57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:27.639544 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cea9ac3e-f9c7-4e53-8be7-8dbaefb23d57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:27.639961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cea9ac3e-f9c7-4e53-8be7-8dbaefb23d57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:27.669348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cea9ac3e-f9c7-4e53-8be7-8dbaefb23d57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044078 Aug 30 14:51:27.669910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 526/1062] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:27 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:27.702022 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2498889e-0b95-45a7-89fe-1993dda3352f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:27.704256 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2498889e-0b95-45a7-89fe-1993dda3352f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:27.710742 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2498889e-0b95-45a7-89fe-1993dda3352f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:27.712607 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2498889e-0b95-45a7-89fe-1993dda3352f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:27.713113 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2498889e-0b95-45a7-89fe-1993dda3352f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:27.713878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2498889e-0b95-45a7-89fe-1993dda3352f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:27.714396 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2498889e-0b95-45a7-89fe-1993dda3352f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:27.714911 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2498889e-0b95-45a7-89fe-1993dda3352f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:27.746246 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2498889e-0b95-45a7-89fe-1993dda3352f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048102 Aug 30 14:51:27.747008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 537/1063] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:27 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:28.681351 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-beea87b4-5416-4199-aa3f-647dba323e7d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:28.684000 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-beea87b4-5416-4199-aa3f-647dba323e7d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:28.690379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-beea87b4-5416-4199-aa3f-647dba323e7d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:28.690853 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-beea87b4-5416-4199-aa3f-647dba323e7d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:28.691585 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-beea87b4-5416-4199-aa3f-647dba323e7d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:28.692258 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-beea87b4-5416-4199-aa3f-647dba323e7d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:28.692698 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-beea87b4-5416-4199-aa3f-647dba323e7d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:28.693112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-beea87b4-5416-4199-aa3f-647dba323e7d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:28.724891 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-beea87b4-5416-4199-aa3f-647dba323e7d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047848 Aug 30 14:51:28.725634 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 527/1064] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:28 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:28.758599 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d23ad9ea-8951-44af-a299-5b68bd4d98a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:28.760941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d23ad9ea-8951-44af-a299-5b68bd4d98a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:28.767264 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d23ad9ea-8951-44af-a299-5b68bd4d98a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:28.767752 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d23ad9ea-8951-44af-a299-5b68bd4d98a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:28.768196 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d23ad9ea-8951-44af-a299-5b68bd4d98a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:28.768889 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d23ad9ea-8951-44af-a299-5b68bd4d98a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:28.769347 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d23ad9ea-8951-44af-a299-5b68bd4d98a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:28.769772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d23ad9ea-8951-44af-a299-5b68bd4d98a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:28.798533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d23ad9ea-8951-44af-a299-5b68bd4d98a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044587 Aug 30 14:51:28.799083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 538/1065] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:28 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:29.738173 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e5ed3b16-0896-42bd-8877-4b32648d50b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:29.740214 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e5ed3b16-0896-42bd-8877-4b32648d50b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:29.746469 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5ed3b16-0896-42bd-8877-4b32648d50b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:29.746969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5ed3b16-0896-42bd-8877-4b32648d50b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:29.747429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5ed3b16-0896-42bd-8877-4b32648d50b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:29.748103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5ed3b16-0896-42bd-8877-4b32648d50b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:29.748544 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5ed3b16-0896-42bd-8877-4b32648d50b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:29.748957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5ed3b16-0896-42bd-8877-4b32648d50b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:29.781043 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e5ed3b16-0896-42bd-8877-4b32648d50b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046838 Aug 30 14:51:29.781616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 528/1066] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:29 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:29.810853 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8380c7ae-f985-465a-b19a-c0bcf457885e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:29.813019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8380c7ae-f985-465a-b19a-c0bcf457885e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:29.819602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8380c7ae-f985-465a-b19a-c0bcf457885e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:29.820070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8380c7ae-f985-465a-b19a-c0bcf457885e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:29.821622 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8380c7ae-f985-465a-b19a-c0bcf457885e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:29.822345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8380c7ae-f985-465a-b19a-c0bcf457885e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:29.822798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8380c7ae-f985-465a-b19a-c0bcf457885e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:29.823238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8380c7ae-f985-465a-b19a-c0bcf457885e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:29.853175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8380c7ae-f985-465a-b19a-c0bcf457885e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046302 Aug 30 14:51:29.853728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 539/1067] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:29 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:30.793713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4a4a89e2-3e16-4cf1-b103-afbb67b1c04d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:30.795901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4a4a89e2-3e16-4cf1-b103-afbb67b1c04d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:30.802492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a4a89e2-3e16-4cf1-b103-afbb67b1c04d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:30.802961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a4a89e2-3e16-4cf1-b103-afbb67b1c04d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:30.803416 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a4a89e2-3e16-4cf1-b103-afbb67b1c04d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:30.804095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a4a89e2-3e16-4cf1-b103-afbb67b1c04d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:30.804539 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a4a89e2-3e16-4cf1-b103-afbb67b1c04d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:30.805514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a4a89e2-3e16-4cf1-b103-afbb67b1c04d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:30.834468 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4a4a89e2-3e16-4cf1-b103-afbb67b1c04d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045499 Aug 30 14:51:30.835013 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 529/1068] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:30 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:30.865385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7cf51075-9d99-46a7-ac6e-34c8f5511870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:30.867503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7cf51075-9d99-46a7-ac6e-34c8f5511870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:30.874096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cf51075-9d99-46a7-ac6e-34c8f5511870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:30.874569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cf51075-9d99-46a7-ac6e-34c8f5511870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:30.874997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cf51075-9d99-46a7-ac6e-34c8f5511870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:30.875722 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cf51075-9d99-46a7-ac6e-34c8f5511870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:30.876165 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cf51075-9d99-46a7-ac6e-34c8f5511870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:30.876583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cf51075-9d99-46a7-ac6e-34c8f5511870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:30.905434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7cf51075-9d99-46a7-ac6e-34c8f5511870 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043965 Aug 30 14:51:30.905975 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 540/1069] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:30 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:31.848082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f601d7ef-979d-4e3b-8153-6ebf2299e129 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:31.850121 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f601d7ef-979d-4e3b-8153-6ebf2299e129 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:31.856926 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f601d7ef-979d-4e3b-8153-6ebf2299e129 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:31.857403 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f601d7ef-979d-4e3b-8153-6ebf2299e129 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:31.857838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f601d7ef-979d-4e3b-8153-6ebf2299e129 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:31.858519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f601d7ef-979d-4e3b-8153-6ebf2299e129 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:31.858969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f601d7ef-979d-4e3b-8153-6ebf2299e129 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:31.859419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f601d7ef-979d-4e3b-8153-6ebf2299e129 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:31.888548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f601d7ef-979d-4e3b-8153-6ebf2299e129 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Aug 30 14:51:31.889102 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 530/1070] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:31 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:31.918148 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-12b80808-cd45-44d7-ac07-e8f1e2c55891 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:31.920347 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-12b80808-cd45-44d7-ac07-e8f1e2c55891 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:31.926641 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12b80808-cd45-44d7-ac07-e8f1e2c55891 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:31.927119 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12b80808-cd45-44d7-ac07-e8f1e2c55891 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:31.927589 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12b80808-cd45-44d7-ac07-e8f1e2c55891 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:31.928274 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12b80808-cd45-44d7-ac07-e8f1e2c55891 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:31.928722 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12b80808-cd45-44d7-ac07-e8f1e2c55891 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:31.929146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12b80808-cd45-44d7-ac07-e8f1e2c55891 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:31.959500 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-12b80808-cd45-44d7-ac07-e8f1e2c55891 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045870 Aug 30 14:51:31.960059 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 541/1071] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:31 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:32.901519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6617eb23-5557-4e1c-9ad6-0498e7e256fd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:32.903612 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6617eb23-5557-4e1c-9ad6-0498e7e256fd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:32.909891 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6617eb23-5557-4e1c-9ad6-0498e7e256fd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:32.910370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6617eb23-5557-4e1c-9ad6-0498e7e256fd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:32.910821 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6617eb23-5557-4e1c-9ad6-0498e7e256fd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:32.911526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6617eb23-5557-4e1c-9ad6-0498e7e256fd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:32.911977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6617eb23-5557-4e1c-9ad6-0498e7e256fd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:32.912395 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6617eb23-5557-4e1c-9ad6-0498e7e256fd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:32.941339 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6617eb23-5557-4e1c-9ad6-0498e7e256fd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Aug 30 14:51:32.941895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 531/1072] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:32 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:32.972008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4c509e82-dd85-4925-98cf-def9e0969191 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:32.974144 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4c509e82-dd85-4925-98cf-def9e0969191 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:32.980539 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4c509e82-dd85-4925-98cf-def9e0969191 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:32.981016 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4c509e82-dd85-4925-98cf-def9e0969191 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:32.981447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4c509e82-dd85-4925-98cf-def9e0969191 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:32.982140 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4c509e82-dd85-4925-98cf-def9e0969191 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:32.982587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4c509e82-dd85-4925-98cf-def9e0969191 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:32.983005 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4c509e82-dd85-4925-98cf-def9e0969191 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:33.012514 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4c509e82-dd85-4925-98cf-def9e0969191 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044443 Aug 30 14:51:33.013592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 542/1073] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:32 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:33.954217 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6f627fb3-79bf-4130-817f-80d0974205aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:33.956278 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6f627fb3-79bf-4130-817f-80d0974205aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:33.963325 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f627fb3-79bf-4130-817f-80d0974205aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:33.963803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f627fb3-79bf-4130-817f-80d0974205aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:33.964233 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f627fb3-79bf-4130-817f-80d0974205aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:33.964911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f627fb3-79bf-4130-817f-80d0974205aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:33.965355 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f627fb3-79bf-4130-817f-80d0974205aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:33.965776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f627fb3-79bf-4130-817f-80d0974205aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:33.995837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6f627fb3-79bf-4130-817f-80d0974205aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045847 Aug 30 14:51:33.996399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 532/1074] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:33 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:34.025339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6b0f06f5-970e-4823-a6e2-fe9e1d4bf091 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:34.027494 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6b0f06f5-970e-4823-a6e2-fe9e1d4bf091 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:34.033731 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6b0f06f5-970e-4823-a6e2-fe9e1d4bf091 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:34.034203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6b0f06f5-970e-4823-a6e2-fe9e1d4bf091 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:34.034632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6b0f06f5-970e-4823-a6e2-fe9e1d4bf091 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:34.035338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6b0f06f5-970e-4823-a6e2-fe9e1d4bf091 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:34.035780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6b0f06f5-970e-4823-a6e2-fe9e1d4bf091 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:34.036193 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6b0f06f5-970e-4823-a6e2-fe9e1d4bf091 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:34.061020 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:34.066517 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6b0f06f5-970e-4823-a6e2-fe9e1d4bf091 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045476 Aug 30 14:51:34.067064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 543/1075] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:34 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:35.007855 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-08f764ac-6181-4cb7-8d57-71ac05365244 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:35.009976 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-08f764ac-6181-4cb7-8d57-71ac05365244 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:35.012285 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=58 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:35.017914 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08f764ac-6181-4cb7-8d57-71ac05365244 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:35.018406 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08f764ac-6181-4cb7-8d57-71ac05365244 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:35.018873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08f764ac-6181-4cb7-8d57-71ac05365244 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:35.019608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08f764ac-6181-4cb7-8d57-71ac05365244 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:35.020064 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08f764ac-6181-4cb7-8d57-71ac05365244 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:35.020492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08f764ac-6181-4cb7-8d57-71ac05365244 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:35.049846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-08f764ac-6181-4cb7-8d57-71ac05365244 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045876 Aug 30 14:51:35.050402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 533/1076] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:35 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:35.079549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cc362451-0b35-45cb-a371-2360ef4c5034 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:35.081705 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cc362451-0b35-45cb-a371-2360ef4c5034 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:35.088242 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc362451-0b35-45cb-a371-2360ef4c5034 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:35.088732 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc362451-0b35-45cb-a371-2360ef4c5034 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:35.089165 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc362451-0b35-45cb-a371-2360ef4c5034 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:35.089852 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc362451-0b35-45cb-a371-2360ef4c5034 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:35.090304 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc362451-0b35-45cb-a371-2360ef4c5034 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:35.090726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc362451-0b35-45cb-a371-2360ef4c5034 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:35.120214 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cc362451-0b35-45cb-a371-2360ef4c5034 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044572 Aug 30 14:51:35.120706 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 544/1077] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:35 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:36.061945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a65317d8-0af8-4324-81f7-c643f2bddf51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:36.064148 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a65317d8-0af8-4324-81f7-c643f2bddf51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:36.071958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65317d8-0af8-4324-81f7-c643f2bddf51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:36.072433 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65317d8-0af8-4324-81f7-c643f2bddf51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:36.072860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65317d8-0af8-4324-81f7-c643f2bddf51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:36.073535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65317d8-0af8-4324-81f7-c643f2bddf51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:36.073979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65317d8-0af8-4324-81f7-c643f2bddf51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:36.074392 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65317d8-0af8-4324-81f7-c643f2bddf51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:36.103264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a65317d8-0af8-4324-81f7-c643f2bddf51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045240 Aug 30 14:51:36.103810 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 534/1078] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:36 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:36.132311 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0cd854ca-556e-4bbf-b4e2-2451dcb16fb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:36.135150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0cd854ca-556e-4bbf-b4e2-2451dcb16fb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:36.137444 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=58 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:36.142564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0cd854ca-556e-4bbf-b4e2-2451dcb16fb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:36.143042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0cd854ca-556e-4bbf-b4e2-2451dcb16fb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:36.143501 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0cd854ca-556e-4bbf-b4e2-2451dcb16fb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:36.144198 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0cd854ca-556e-4bbf-b4e2-2451dcb16fb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:36.144635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0cd854ca-556e-4bbf-b4e2-2451dcb16fb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:36.145050 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0cd854ca-556e-4bbf-b4e2-2451dcb16fb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:36.173914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0cd854ca-556e-4bbf-b4e2-2451dcb16fb8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045574 Aug 30 14:51:36.174558 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 545/1079] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:36 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:37.115558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c491ec3d-bb00-4083-8d37-98f8f79eac48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:37.117606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c491ec3d-bb00-4083-8d37-98f8f79eac48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:37.123991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c491ec3d-bb00-4083-8d37-98f8f79eac48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:37.124443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c491ec3d-bb00-4083-8d37-98f8f79eac48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:37.124863 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c491ec3d-bb00-4083-8d37-98f8f79eac48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:37.125538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c491ec3d-bb00-4083-8d37-98f8f79eac48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:37.125977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c491ec3d-bb00-4083-8d37-98f8f79eac48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:37.126389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c491ec3d-bb00-4083-8d37-98f8f79eac48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:37.155947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c491ec3d-bb00-4083-8d37-98f8f79eac48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044460 Aug 30 14:51:37.156643 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 535/1080] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:37 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:37.186076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7f3719c8-6b62-44d4-bc94-2527617e6cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:37.188243 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7f3719c8-6b62-44d4-bc94-2527617e6cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:37.194841 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f3719c8-6b62-44d4-bc94-2527617e6cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:37.195946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f3719c8-6b62-44d4-bc94-2527617e6cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:37.196388 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f3719c8-6b62-44d4-bc94-2527617e6cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:37.197081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f3719c8-6b62-44d4-bc94-2527617e6cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:37.197532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f3719c8-6b62-44d4-bc94-2527617e6cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:37.197952 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7f3719c8-6b62-44d4-bc94-2527617e6cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:37.228043 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7f3719c8-6b62-44d4-bc94-2527617e6cd2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045933 Aug 30 14:51:37.228610 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 546/1081] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:37 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:38.169206 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9ee42983-0409-4390-bf0a-65731e48cce3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:38.171252 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9ee42983-0409-4390-bf0a-65731e48cce3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:38.177582 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ee42983-0409-4390-bf0a-65731e48cce3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:38.178052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ee42983-0409-4390-bf0a-65731e48cce3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:38.178477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ee42983-0409-4390-bf0a-65731e48cce3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:38.179150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ee42983-0409-4390-bf0a-65731e48cce3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:38.180329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ee42983-0409-4390-bf0a-65731e48cce3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:38.180748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ee42983-0409-4390-bf0a-65731e48cce3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:38.210368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9ee42983-0409-4390-bf0a-65731e48cce3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045423 Aug 30 14:51:38.211655 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 536/1082] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:38 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:38.240256 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fe95950b-9cbf-4949-8753-00b2bc2032ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:38.242486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fe95950b-9cbf-4949-8753-00b2bc2032ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:38.248827 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe95950b-9cbf-4949-8753-00b2bc2032ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:38.249309 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe95950b-9cbf-4949-8753-00b2bc2032ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:38.249743 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe95950b-9cbf-4949-8753-00b2bc2032ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:38.250437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe95950b-9cbf-4949-8753-00b2bc2032ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:38.250886 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe95950b-9cbf-4949-8753-00b2bc2032ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:38.251339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe95950b-9cbf-4949-8753-00b2bc2032ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:38.281036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fe95950b-9cbf-4949-8753-00b2bc2032ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044780 Aug 30 14:51:38.281595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 547/1083] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:38 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:39.222740 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5aaa5ef9-71a3-4ecb-a791-f8372d85bd1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:39.224899 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5aaa5ef9-71a3-4ecb-a791-f8372d85bd1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:39.231494 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5aaa5ef9-71a3-4ecb-a791-f8372d85bd1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:39.231975 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5aaa5ef9-71a3-4ecb-a791-f8372d85bd1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:39.232411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5aaa5ef9-71a3-4ecb-a791-f8372d85bd1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:39.233097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5aaa5ef9-71a3-4ecb-a791-f8372d85bd1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:39.233547 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5aaa5ef9-71a3-4ecb-a791-f8372d85bd1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:39.233967 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5aaa5ef9-71a3-4ecb-a791-f8372d85bd1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:39.263682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5aaa5ef9-71a3-4ecb-a791-f8372d85bd1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044927 Aug 30 14:51:39.264245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 537/1084] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:39 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:51:39.293767 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-492abd6a-d154-4315-aa3e-4215c34f651f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:39.295903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-492abd6a-d154-4315-aa3e-4215c34f651f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:39.302131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-492abd6a-d154-4315-aa3e-4215c34f651f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:39.302606 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-492abd6a-d154-4315-aa3e-4215c34f651f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:39.303033 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-492abd6a-d154-4315-aa3e-4215c34f651f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:39.303778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-492abd6a-d154-4315-aa3e-4215c34f651f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:39.304221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-492abd6a-d154-4315-aa3e-4215c34f651f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:39.305603 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-492abd6a-d154-4315-aa3e-4215c34f651f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:39.335073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-492abd6a-d154-4315-aa3e-4215c34f651f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045818 Aug 30 14:51:39.335849 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 548/1085] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:39 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:40.276656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e5abda19-1333-469f-9f54-772f772fabb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:40.278760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e5abda19-1333-469f-9f54-772f772fabb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:40.284998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5abda19-1333-469f-9f54-772f772fabb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:40.285466 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5abda19-1333-469f-9f54-772f772fabb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:40.285893 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5abda19-1333-469f-9f54-772f772fabb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:40.286565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5abda19-1333-469f-9f54-772f772fabb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:40.287001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5abda19-1333-469f-9f54-772f772fabb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:40.287444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5abda19-1333-469f-9f54-772f772fabb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:40.315764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e5abda19-1333-469f-9f54-772f772fabb5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043772 Aug 30 14:51:40.316605 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 538/1086] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:40 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:40.347597 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-76a07ece-f89f-4c56-bddf-969489c0b0d6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:40.349696 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-76a07ece-f89f-4c56-bddf-969489c0b0d6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:40.357029 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-76a07ece-f89f-4c56-bddf-969489c0b0d6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:40.357507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-76a07ece-f89f-4c56-bddf-969489c0b0d6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:40.357939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-76a07ece-f89f-4c56-bddf-969489c0b0d6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:40.358617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-76a07ece-f89f-4c56-bddf-969489c0b0d6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:40.359059 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-76a07ece-f89f-4c56-bddf-969489c0b0d6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:40.359678 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-76a07ece-f89f-4c56-bddf-969489c0b0d6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:40.389277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-76a07ece-f89f-4c56-bddf-969489c0b0d6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045681 Aug 30 14:51:40.389849 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 549/1087] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:40 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:41.329015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d8137d53-786b-4b1e-a261-3fd8eb4647a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:41.331176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d8137d53-786b-4b1e-a261-3fd8eb4647a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:41.338247 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8137d53-786b-4b1e-a261-3fd8eb4647a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:41.338733 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8137d53-786b-4b1e-a261-3fd8eb4647a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:41.339165 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8137d53-786b-4b1e-a261-3fd8eb4647a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:41.339948 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8137d53-786b-4b1e-a261-3fd8eb4647a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:41.340396 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8137d53-786b-4b1e-a261-3fd8eb4647a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:41.340822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8137d53-786b-4b1e-a261-3fd8eb4647a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:41.369869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d8137d53-786b-4b1e-a261-3fd8eb4647a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044872 Aug 30 14:51:41.370543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 539/1088] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:41 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:41.401708 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-144c709f-826f-43ce-965d-35233876461b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:41.403923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-144c709f-826f-43ce-965d-35233876461b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:41.410441 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-144c709f-826f-43ce-965d-35233876461b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:41.410934 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-144c709f-826f-43ce-965d-35233876461b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:41.411423 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-144c709f-826f-43ce-965d-35233876461b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:41.412122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-144c709f-826f-43ce-965d-35233876461b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:41.412573 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-144c709f-826f-43ce-965d-35233876461b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:41.413028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-144c709f-826f-43ce-965d-35233876461b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:41.442468 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-144c709f-826f-43ce-965d-35233876461b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045859 Aug 30 14:51:41.443008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 550/1089] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:41 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:42.382577 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-868609f7-d6d5-4516-9b59-f64ae9c32e0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:42.384667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-868609f7-d6d5-4516-9b59-f64ae9c32e0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:42.390957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-868609f7-d6d5-4516-9b59-f64ae9c32e0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:42.391471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-868609f7-d6d5-4516-9b59-f64ae9c32e0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:42.391905 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-868609f7-d6d5-4516-9b59-f64ae9c32e0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:42.392590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-868609f7-d6d5-4516-9b59-f64ae9c32e0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:42.393041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-868609f7-d6d5-4516-9b59-f64ae9c32e0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:42.393463 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-868609f7-d6d5-4516-9b59-f64ae9c32e0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:42.397007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:42.422978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-868609f7-d6d5-4516-9b59-f64ae9c32e0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044486 Aug 30 14:51:42.423567 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 540/1090] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:42 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:42.454845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5b5bce29-fce2-424a-aa61-d6a226901e57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:42.456990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5b5bce29-fce2-424a-aa61-d6a226901e57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:42.463626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b5bce29-fce2-424a-aa61-d6a226901e57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:42.464107 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b5bce29-fce2-424a-aa61-d6a226901e57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:42.464538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b5bce29-fce2-424a-aa61-d6a226901e57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:42.465223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b5bce29-fce2-424a-aa61-d6a226901e57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:42.465670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b5bce29-fce2-424a-aa61-d6a226901e57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:42.466119 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b5bce29-fce2-424a-aa61-d6a226901e57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:42.495716 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5b5bce29-fce2-424a-aa61-d6a226901e57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044837 Aug 30 14:51:42.496269 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 551/1091] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:42 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:43.435116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0e63d1b5-82bd-4787-aade-ff63e9d6d3eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:43.437275 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0e63d1b5-82bd-4787-aade-ff63e9d6d3eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:43.443883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e63d1b5-82bd-4787-aade-ff63e9d6d3eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:43.444352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e63d1b5-82bd-4787-aade-ff63e9d6d3eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:43.444778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e63d1b5-82bd-4787-aade-ff63e9d6d3eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:43.446192 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e63d1b5-82bd-4787-aade-ff63e9d6d3eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:43.446638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e63d1b5-82bd-4787-aade-ff63e9d6d3eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:43.447052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e63d1b5-82bd-4787-aade-ff63e9d6d3eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:43.477350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0e63d1b5-82bd-4787-aade-ff63e9d6d3eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046093 Aug 30 14:51:43.477839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 541/1092] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:43 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:43.508485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b200fb9f-a331-4340-9ee4-711dab253164 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:43.510656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b200fb9f-a331-4340-9ee4-711dab253164 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:43.517061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b200fb9f-a331-4340-9ee4-711dab253164 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:43.517600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b200fb9f-a331-4340-9ee4-711dab253164 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:43.518038 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b200fb9f-a331-4340-9ee4-711dab253164 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:43.518724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b200fb9f-a331-4340-9ee4-711dab253164 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:43.519171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b200fb9f-a331-4340-9ee4-711dab253164 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:43.519619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b200fb9f-a331-4340-9ee4-711dab253164 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:43.548500 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b200fb9f-a331-4340-9ee4-711dab253164 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044683 Aug 30 14:51:43.549045 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 552/1093] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:43 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:44.489464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-721150c4-b338-4820-af57-437f8eb803d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:44.491560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-721150c4-b338-4820-af57-437f8eb803d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:44.497958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-721150c4-b338-4820-af57-437f8eb803d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:44.498432 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-721150c4-b338-4820-af57-437f8eb803d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:44.498887 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-721150c4-b338-4820-af57-437f8eb803d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:44.499641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-721150c4-b338-4820-af57-437f8eb803d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:44.500096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-721150c4-b338-4820-af57-437f8eb803d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:44.500517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-721150c4-b338-4820-af57-437f8eb803d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:44.529578 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-721150c4-b338-4820-af57-437f8eb803d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Aug 30 14:51:44.530123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 542/1094] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:44 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:44.560980 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-356dc877-5be4-470b-bedc-52271f7430cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:44.563104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-356dc877-5be4-470b-bedc-52271f7430cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:44.569449 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-356dc877-5be4-470b-bedc-52271f7430cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:44.570572 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-356dc877-5be4-470b-bedc-52271f7430cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:44.571136 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-356dc877-5be4-470b-bedc-52271f7430cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:44.571986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-356dc877-5be4-470b-bedc-52271f7430cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:44.572439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-356dc877-5be4-470b-bedc-52271f7430cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:44.572865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-356dc877-5be4-470b-bedc-52271f7430cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:44.602250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-356dc877-5be4-470b-bedc-52271f7430cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045176 Aug 30 14:51:44.602792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 553/1095] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:44 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:45.542737 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d605a4eb-4443-4d57-832e-84b36eaec045 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:45.544869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d605a4eb-4443-4d57-832e-84b36eaec045 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:45.551196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d605a4eb-4443-4d57-832e-84b36eaec045 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:45.551692 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d605a4eb-4443-4d57-832e-84b36eaec045 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:45.552118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d605a4eb-4443-4d57-832e-84b36eaec045 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:45.552793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d605a4eb-4443-4d57-832e-84b36eaec045 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:45.553233 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d605a4eb-4443-4d57-832e-84b36eaec045 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:45.553645 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d605a4eb-4443-4d57-832e-84b36eaec045 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:45.583486 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d605a4eb-4443-4d57-832e-84b36eaec045 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045633 Aug 30 14:51:45.584034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 543/1096] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:45 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:45.614182 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2e8755c6-0946-4640-ab51-9e9017ab07cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:45.616345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2e8755c6-0946-4640-ab51-9e9017ab07cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:45.623342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e8755c6-0946-4640-ab51-9e9017ab07cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:45.623837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e8755c6-0946-4640-ab51-9e9017ab07cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:45.624273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e8755c6-0946-4640-ab51-9e9017ab07cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:45.624971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e8755c6-0946-4640-ab51-9e9017ab07cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:45.625418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e8755c6-0946-4640-ab51-9e9017ab07cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:45.625843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e8755c6-0946-4640-ab51-9e9017ab07cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:45.654349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2e8755c6-0946-4640-ab51-9e9017ab07cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044356 Aug 30 14:51:45.654906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 554/1097] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:45 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:46.595794 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b1fa4956-6097-4123-8f86-43df6f6b9cd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:46.597924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b1fa4956-6097-4123-8f86-43df6f6b9cd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:46.604644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1fa4956-6097-4123-8f86-43df6f6b9cd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:46.605121 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1fa4956-6097-4123-8f86-43df6f6b9cd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:46.605554 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1fa4956-6097-4123-8f86-43df6f6b9cd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:46.606232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1fa4956-6097-4123-8f86-43df6f6b9cd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:46.606681 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1fa4956-6097-4123-8f86-43df6f6b9cd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:46.607098 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1fa4956-6097-4123-8f86-43df6f6b9cd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:46.637349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b1fa4956-6097-4123-8f86-43df6f6b9cd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045697 Aug 30 14:51:46.637913 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 544/1098] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:46 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:46.666232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f8ae2180-6b02-445b-a97c-0a952d6384d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:46.668369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f8ae2180-6b02-445b-a97c-0a952d6384d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:46.674544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8ae2180-6b02-445b-a97c-0a952d6384d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:46.675015 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8ae2180-6b02-445b-a97c-0a952d6384d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:46.675484 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8ae2180-6b02-445b-a97c-0a952d6384d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:46.676167 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8ae2180-6b02-445b-a97c-0a952d6384d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:46.676608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8ae2180-6b02-445b-a97c-0a952d6384d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:46.677022 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f8ae2180-6b02-445b-a97c-0a952d6384d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:46.707304 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f8ae2180-6b02-445b-a97c-0a952d6384d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045294 Aug 30 14:51:46.707847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 555/1099] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:46 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:47.650098 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-df403bfa-7bb7-45f8-a7d7-a809e38a1867 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:47.652256 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-df403bfa-7bb7-45f8-a7d7-a809e38a1867 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:47.658725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df403bfa-7bb7-45f8-a7d7-a809e38a1867 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:47.659272 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df403bfa-7bb7-45f8-a7d7-a809e38a1867 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:47.659714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df403bfa-7bb7-45f8-a7d7-a809e38a1867 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:47.660407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df403bfa-7bb7-45f8-a7d7-a809e38a1867 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:47.660860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df403bfa-7bb7-45f8-a7d7-a809e38a1867 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:47.661284 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df403bfa-7bb7-45f8-a7d7-a809e38a1867 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:47.719866 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f9c702a7-30a0-4088-9bd1-772145e7066c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:47.722106 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f9c702a7-30a0-4088-9bd1-772145e7066c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:47.729133 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9c702a7-30a0-4088-9bd1-772145e7066c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:47.729622 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9c702a7-30a0-4088-9bd1-772145e7066c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:47.730058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9c702a7-30a0-4088-9bd1-772145e7066c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:47.730777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9c702a7-30a0-4088-9bd1-772145e7066c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:47.731248 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9c702a7-30a0-4088-9bd1-772145e7066c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:47.731679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9c702a7-30a0-4088-9bd1-772145e7066c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:47.764286 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f9c702a7-30a0-4088-9bd1-772145e7066c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048418 Aug 30 14:51:47.764883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 556/1100] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:47 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:51:47.837875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-df403bfa-7bb7-45f8-a7d7-a809e38a1867 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192317 Aug 30 14:51:47.838617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 545/1101] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:47 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:48.777427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2c7e0247-1b33-47ec-a973-b20d55b08337 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:48.779527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2c7e0247-1b33-47ec-a973-b20d55b08337 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:48.785845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c7e0247-1b33-47ec-a973-b20d55b08337 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:48.786328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c7e0247-1b33-47ec-a973-b20d55b08337 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:48.786766 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c7e0247-1b33-47ec-a973-b20d55b08337 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:48.787497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c7e0247-1b33-47ec-a973-b20d55b08337 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:48.787960 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c7e0247-1b33-47ec-a973-b20d55b08337 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:48.788385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2c7e0247-1b33-47ec-a973-b20d55b08337 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:48.818331 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2c7e0247-1b33-47ec-a973-b20d55b08337 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045560 Aug 30 14:51:48.818886 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 557/1102] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:48 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:48.850059 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a312390f-7a61-4983-bad1-894d7a5d2077 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:48.852161 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a312390f-7a61-4983-bad1-894d7a5d2077 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:48.859043 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a312390f-7a61-4983-bad1-894d7a5d2077 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:48.859947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a312390f-7a61-4983-bad1-894d7a5d2077 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:48.860371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a312390f-7a61-4983-bad1-894d7a5d2077 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:48.861053 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a312390f-7a61-4983-bad1-894d7a5d2077 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:48.861496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a312390f-7a61-4983-bad1-894d7a5d2077 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:48.861910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a312390f-7a61-4983-bad1-894d7a5d2077 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:48.891183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a312390f-7a61-4983-bad1-894d7a5d2077 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045133 Aug 30 14:51:48.891769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 546/1103] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:48 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:49.830351 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-50fc9363-72cb-41ce-b7ac-aa829039ced1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:49.832518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-50fc9363-72cb-41ce-b7ac-aa829039ced1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:49.839160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-50fc9363-72cb-41ce-b7ac-aa829039ced1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:49.839671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-50fc9363-72cb-41ce-b7ac-aa829039ced1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:49.840102 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-50fc9363-72cb-41ce-b7ac-aa829039ced1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:49.840785 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-50fc9363-72cb-41ce-b7ac-aa829039ced1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:49.841232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-50fc9363-72cb-41ce-b7ac-aa829039ced1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:49.841649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-50fc9363-72cb-41ce-b7ac-aa829039ced1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:49.871344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-50fc9363-72cb-41ce-b7ac-aa829039ced1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044909 Aug 30 14:51:49.871895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 558/1104] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:49 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:49.902543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1499887a-42f2-4ecb-8bde-dd84086ffbe0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:49.904699 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1499887a-42f2-4ecb-8bde-dd84086ffbe0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:49.910736 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1499887a-42f2-4ecb-8bde-dd84086ffbe0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:49.911291 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1499887a-42f2-4ecb-8bde-dd84086ffbe0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:49.911726 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1499887a-42f2-4ecb-8bde-dd84086ffbe0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:49.912406 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1499887a-42f2-4ecb-8bde-dd84086ffbe0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:49.912852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1499887a-42f2-4ecb-8bde-dd84086ffbe0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:49.913268 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1499887a-42f2-4ecb-8bde-dd84086ffbe0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:49.944526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1499887a-42f2-4ecb-8bde-dd84086ffbe0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045974 Aug 30 14:51:49.945751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 547/1105] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:49 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:50.884224 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-224052cf-30a9-450e-9917-bad07de8334f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:50.886367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-224052cf-30a9-450e-9917-bad07de8334f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:50.892759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-224052cf-30a9-450e-9917-bad07de8334f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:50.893234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-224052cf-30a9-450e-9917-bad07de8334f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:50.893664 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-224052cf-30a9-450e-9917-bad07de8334f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:50.894346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-224052cf-30a9-450e-9917-bad07de8334f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:50.894782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-224052cf-30a9-450e-9917-bad07de8334f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:50.895193 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-224052cf-30a9-450e-9917-bad07de8334f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:50.924556 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-224052cf-30a9-450e-9917-bad07de8334f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044918 Aug 30 14:51:50.925109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 559/1106] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:50 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:50.956791 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b4455903-e61b-4dc0-b9dd-d1f1bdb32c85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:50.958946 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b4455903-e61b-4dc0-b9dd-d1f1bdb32c85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:50.966048 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4455903-e61b-4dc0-b9dd-d1f1bdb32c85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:50.966520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4455903-e61b-4dc0-b9dd-d1f1bdb32c85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:50.966946 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4455903-e61b-4dc0-b9dd-d1f1bdb32c85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:50.967657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4455903-e61b-4dc0-b9dd-d1f1bdb32c85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:50.968099 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4455903-e61b-4dc0-b9dd-d1f1bdb32c85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:50.968510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4455903-e61b-4dc0-b9dd-d1f1bdb32c85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:50.999086 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b4455903-e61b-4dc0-b9dd-d1f1bdb32c85 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046147 Aug 30 14:51:50.999674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 548/1107] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:50 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:51.937031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5420235f-5c51-4c5a-bf6a-e0d1c20ef372 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:51.939115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5420235f-5c51-4c5a-bf6a-e0d1c20ef372 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:51.946425 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5420235f-5c51-4c5a-bf6a-e0d1c20ef372 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:51.946904 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5420235f-5c51-4c5a-bf6a-e0d1c20ef372 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:51.947370 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5420235f-5c51-4c5a-bf6a-e0d1c20ef372 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:51.948066 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5420235f-5c51-4c5a-bf6a-e0d1c20ef372 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:51.948516 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5420235f-5c51-4c5a-bf6a-e0d1c20ef372 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:51.948940 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5420235f-5c51-4c5a-bf6a-e0d1c20ef372 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:51.965122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:51.978679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5420235f-5c51-4c5a-bf6a-e0d1c20ef372 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045741 Aug 30 14:51:51.979254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 560/1108] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:51 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:52.011896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-050dedd0-e025-4229-92cf-1f4e09fa9454 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:52.014062 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-050dedd0-e025-4229-92cf-1f4e09fa9454 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:52.020424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-050dedd0-e025-4229-92cf-1f4e09fa9454 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:52.020895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-050dedd0-e025-4229-92cf-1f4e09fa9454 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:52.021320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-050dedd0-e025-4229-92cf-1f4e09fa9454 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:52.021995 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-050dedd0-e025-4229-92cf-1f4e09fa9454 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:52.022439 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-050dedd0-e025-4229-92cf-1f4e09fa9454 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:52.022894 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-050dedd0-e025-4229-92cf-1f4e09fa9454 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:52.051990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-050dedd0-e025-4229-92cf-1f4e09fa9454 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044765 Aug 30 14:51:52.052752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 549/1109] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:52 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:52.990068 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3e21ba54-982a-41dc-bc0a-7628234dd171 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:52.993004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3e21ba54-982a-41dc-bc0a-7628234dd171 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:52.999400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e21ba54-982a-41dc-bc0a-7628234dd171 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:52.999885 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e21ba54-982a-41dc-bc0a-7628234dd171 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:53.000328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e21ba54-982a-41dc-bc0a-7628234dd171 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:53.001021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e21ba54-982a-41dc-bc0a-7628234dd171 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:53.001479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e21ba54-982a-41dc-bc0a-7628234dd171 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:53.001902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e21ba54-982a-41dc-bc0a-7628234dd171 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:53.032023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3e21ba54-982a-41dc-bc0a-7628234dd171 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045977 Aug 30 14:51:53.032582 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 561/1110] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:52 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:53.064500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1e5bf7a5-ee53-4976-b795-2faf348183b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:53.066943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1e5bf7a5-ee53-4976-b795-2faf348183b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:53.073876 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e5bf7a5-ee53-4976-b795-2faf348183b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:53.074354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e5bf7a5-ee53-4976-b795-2faf348183b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:53.074789 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e5bf7a5-ee53-4976-b795-2faf348183b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:53.075504 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e5bf7a5-ee53-4976-b795-2faf348183b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:53.075958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e5bf7a5-ee53-4976-b795-2faf348183b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:53.076379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e5bf7a5-ee53-4976-b795-2faf348183b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:53.107314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1e5bf7a5-ee53-4976-b795-2faf348183b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046690 Aug 30 14:51:53.107876 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 550/1111] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:53 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:54.044582 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4d8e3ce5-b235-4968-bdeb-215260e507b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:54.046636 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4d8e3ce5-b235-4968-bdeb-215260e507b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:54.052951 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d8e3ce5-b235-4968-bdeb-215260e507b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:54.053427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d8e3ce5-b235-4968-bdeb-215260e507b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:54.054383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d8e3ce5-b235-4968-bdeb-215260e507b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:54.055093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d8e3ce5-b235-4968-bdeb-215260e507b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:54.055549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d8e3ce5-b235-4968-bdeb-215260e507b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:54.055965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d8e3ce5-b235-4968-bdeb-215260e507b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:54.084768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4d8e3ce5-b235-4968-bdeb-215260e507b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044328 Aug 30 14:51:54.085338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 562/1112] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:54 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:54.120254 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-23a88da1-6b76-4bb1-bf75-c88da02d7d8e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:54.122405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-23a88da1-6b76-4bb1-bf75-c88da02d7d8e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:54.128742 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23a88da1-6b76-4bb1-bf75-c88da02d7d8e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:54.129215 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23a88da1-6b76-4bb1-bf75-c88da02d7d8e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:54.129644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23a88da1-6b76-4bb1-bf75-c88da02d7d8e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:54.130329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23a88da1-6b76-4bb1-bf75-c88da02d7d8e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:54.130775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23a88da1-6b76-4bb1-bf75-c88da02d7d8e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:54.131193 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23a88da1-6b76-4bb1-bf75-c88da02d7d8e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:54.162836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-23a88da1-6b76-4bb1-bf75-c88da02d7d8e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047280 Aug 30 14:51:54.163481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 551/1113] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:54 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:55.097371 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-832b8928-ae1a-4400-a258-46f49f1b47f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:55.099558 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-832b8928-ae1a-4400-a258-46f49f1b47f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:55.106040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-832b8928-ae1a-4400-a258-46f49f1b47f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:55.106517 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-832b8928-ae1a-4400-a258-46f49f1b47f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:55.106958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-832b8928-ae1a-4400-a258-46f49f1b47f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:55.107673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-832b8928-ae1a-4400-a258-46f49f1b47f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:55.108125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-832b8928-ae1a-4400-a258-46f49f1b47f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:55.108549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-832b8928-ae1a-4400-a258-46f49f1b47f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:55.137594 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-832b8928-ae1a-4400-a258-46f49f1b47f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044232 Aug 30 14:51:55.138143 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 563/1114] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:55 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:55.174859 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cc3529a8-4ee1-4780-8bee-d5c97fce5d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:55.176978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cc3529a8-4ee1-4780-8bee-d5c97fce5d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:55.183252 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc3529a8-4ee1-4780-8bee-d5c97fce5d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:55.183729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc3529a8-4ee1-4780-8bee-d5c97fce5d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:55.184156 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc3529a8-4ee1-4780-8bee-d5c97fce5d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:55.184834 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc3529a8-4ee1-4780-8bee-d5c97fce5d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:55.185279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc3529a8-4ee1-4780-8bee-d5c97fce5d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:55.185695 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc3529a8-4ee1-4780-8bee-d5c97fce5d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:55.216344 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cc3529a8-4ee1-4780-8bee-d5c97fce5d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045272 Aug 30 14:51:55.216905 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 552/1115] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:55 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:56.149841 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-61542a01-9a1c-46db-92a0-7b0951952f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:56.152010 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-61542a01-9a1c-46db-92a0-7b0951952f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:56.158284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61542a01-9a1c-46db-92a0-7b0951952f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:56.158761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61542a01-9a1c-46db-92a0-7b0951952f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:56.159188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61542a01-9a1c-46db-92a0-7b0951952f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:56.159890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61542a01-9a1c-46db-92a0-7b0951952f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:56.160333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61542a01-9a1c-46db-92a0-7b0951952f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:56.160749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61542a01-9a1c-46db-92a0-7b0951952f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:56.189877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-61542a01-9a1c-46db-92a0-7b0951952f7a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043985 Aug 30 14:51:56.190422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 564/1116] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:56 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:56.229808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8cafcb36-3f31-4688-9a4c-f0e9708b3d34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:56.232010 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8cafcb36-3f31-4688-9a4c-f0e9708b3d34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:56.238411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cafcb36-3f31-4688-9a4c-f0e9708b3d34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:56.238887 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cafcb36-3f31-4688-9a4c-f0e9708b3d34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:56.239359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cafcb36-3f31-4688-9a4c-f0e9708b3d34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:56.240040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cafcb36-3f31-4688-9a4c-f0e9708b3d34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:56.240487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cafcb36-3f31-4688-9a4c-f0e9708b3d34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:56.240908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8cafcb36-3f31-4688-9a4c-f0e9708b3d34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:56.269933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8cafcb36-3f31-4688-9a4c-f0e9708b3d34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044969 Aug 30 14:51:56.270600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 553/1117] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:56 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:57.202119 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d4d26577-4781-4735-b1e6-716fccec880b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:57.204200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d4d26577-4781-4735-b1e6-716fccec880b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:57.210737 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d4d26577-4781-4735-b1e6-716fccec880b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:57.211252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d4d26577-4781-4735-b1e6-716fccec880b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:57.211692 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d4d26577-4781-4735-b1e6-716fccec880b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:57.212822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d4d26577-4781-4735-b1e6-716fccec880b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:57.212924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d4d26577-4781-4735-b1e6-716fccec880b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:57.213259 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d4d26577-4781-4735-b1e6-716fccec880b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:57.242616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d4d26577-4781-4735-b1e6-716fccec880b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044371 Aug 30 14:51:57.243164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 565/1118] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:57 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:57.282521 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e41dac88-63ce-43d2-9f4c-e3124a9857f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:57.284699 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e41dac88-63ce-43d2-9f4c-e3124a9857f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:57.291469 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e41dac88-63ce-43d2-9f4c-e3124a9857f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:57.291953 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e41dac88-63ce-43d2-9f4c-e3124a9857f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:57.292388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e41dac88-63ce-43d2-9f4c-e3124a9857f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:57.293074 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e41dac88-63ce-43d2-9f4c-e3124a9857f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:57.293524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e41dac88-63ce-43d2-9f4c-e3124a9857f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:57.293946 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e41dac88-63ce-43d2-9f4c-e3124a9857f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:57.325222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e41dac88-63ce-43d2-9f4c-e3124a9857f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046555 Aug 30 14:51:57.325784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 554/1119] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:57 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:58.255070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9855515c-f405-4879-b582-8307bbff08b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:58.257924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9855515c-f405-4879-b582-8307bbff08b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:58.264288 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9855515c-f405-4879-b582-8307bbff08b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:58.264769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9855515c-f405-4879-b582-8307bbff08b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:58.265201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9855515c-f405-4879-b582-8307bbff08b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:58.265888 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9855515c-f405-4879-b582-8307bbff08b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:58.266333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9855515c-f405-4879-b582-8307bbff08b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:58.266751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9855515c-f405-4879-b582-8307bbff08b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:58.295465 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9855515c-f405-4879-b582-8307bbff08b5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044362 Aug 30 14:51:58.296012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 566/1120] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:58 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:58.338081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-382ce9ce-ca6d-476f-9b89-1ccc8cecf878 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:58.340263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-382ce9ce-ca6d-476f-9b89-1ccc8cecf878 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:58.346447 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-382ce9ce-ca6d-476f-9b89-1ccc8cecf878 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:58.346988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-382ce9ce-ca6d-476f-9b89-1ccc8cecf878 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:58.347461 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-382ce9ce-ca6d-476f-9b89-1ccc8cecf878 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:58.348146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-382ce9ce-ca6d-476f-9b89-1ccc8cecf878 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:58.348592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-382ce9ce-ca6d-476f-9b89-1ccc8cecf878 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:58.349024 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-382ce9ce-ca6d-476f-9b89-1ccc8cecf878 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:58.377814 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-382ce9ce-ca6d-476f-9b89-1ccc8cecf878 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044417 Aug 30 14:51:58.378382 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 555/1121] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:58 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:51:59.308296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b2872ec4-21f5-4347-bcff-58ceedc965c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:59.310437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b2872ec4-21f5-4347-bcff-58ceedc965c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:59.317252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2872ec4-21f5-4347-bcff-58ceedc965c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:59.317728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2872ec4-21f5-4347-bcff-58ceedc965c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:59.318161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2872ec4-21f5-4347-bcff-58ceedc965c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:59.318846 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2872ec4-21f5-4347-bcff-58ceedc965c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:59.319377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2872ec4-21f5-4347-bcff-58ceedc965c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:59.319845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2872ec4-21f5-4347-bcff-58ceedc965c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:59.348739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b2872ec4-21f5-4347-bcff-58ceedc965c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044487 Aug 30 14:51:59.349296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 567/1122] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:51:59 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:51:59.390331 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-67890424-4be3-49f3-8135-0352e01246bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:51:59.392444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-67890424-4be3-49f3-8135-0352e01246bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:51:59.399121 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67890424-4be3-49f3-8135-0352e01246bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:59.399626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67890424-4be3-49f3-8135-0352e01246bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:59.400055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67890424-4be3-49f3-8135-0352e01246bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:59.400736 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67890424-4be3-49f3-8135-0352e01246bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:51:59.401179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67890424-4be3-49f3-8135-0352e01246bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:51:59.401589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67890424-4be3-49f3-8135-0352e01246bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:51:59.426640 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:51:59.431872 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-67890424-4be3-49f3-8135-0352e01246bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045499 Aug 30 14:51:59.432424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 556/1123] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:51:59 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:00.361675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2e306668-3624-4dd7-b61d-6327c0370aaa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:00.363809 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2e306668-3624-4dd7-b61d-6327c0370aaa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:00.370571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e306668-3624-4dd7-b61d-6327c0370aaa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:00.371039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e306668-3624-4dd7-b61d-6327c0370aaa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:00.371499 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e306668-3624-4dd7-b61d-6327c0370aaa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:00.372175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e306668-3624-4dd7-b61d-6327c0370aaa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:00.372616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e306668-3624-4dd7-b61d-6327c0370aaa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:00.373028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e306668-3624-4dd7-b61d-6327c0370aaa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:00.404191 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2e306668-3624-4dd7-b61d-6327c0370aaa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046498 Aug 30 14:52:00.404741 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 568/1124] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:00 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:00.445129 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1bf837f4-5ec0-4ee5-8545-d0f7177c3c08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:00.447239 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1bf837f4-5ec0-4ee5-8545-d0f7177c3c08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:00.454244 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bf837f4-5ec0-4ee5-8545-d0f7177c3c08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:00.454733 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bf837f4-5ec0-4ee5-8545-d0f7177c3c08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:00.455167 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bf837f4-5ec0-4ee5-8545-d0f7177c3c08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:00.455886 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bf837f4-5ec0-4ee5-8545-d0f7177c3c08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:00.456339 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bf837f4-5ec0-4ee5-8545-d0f7177c3c08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:00.456756 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bf837f4-5ec0-4ee5-8545-d0f7177c3c08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:00.487172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1bf837f4-5ec0-4ee5-8545-d0f7177c3c08 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047082 Aug 30 14:52:00.487786 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 557/1125] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:00 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:01.417250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6588309c-f1b2-42eb-8104-788cd625437d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:01.419461 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6588309c-f1b2-42eb-8104-788cd625437d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:01.425794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6588309c-f1b2-42eb-8104-788cd625437d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:01.426276 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6588309c-f1b2-42eb-8104-788cd625437d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:01.426713 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6588309c-f1b2-42eb-8104-788cd625437d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:01.427446 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6588309c-f1b2-42eb-8104-788cd625437d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:01.427902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6588309c-f1b2-42eb-8104-788cd625437d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:01.428328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6588309c-f1b2-42eb-8104-788cd625437d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:01.458536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6588309c-f1b2-42eb-8104-788cd625437d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045976 Aug 30 14:52:01.459098 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 569/1126] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:01 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:01.499447 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-230cdadb-15ed-4f86-a6f5-8903ce9d3846 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:01.501552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-230cdadb-15ed-4f86-a6f5-8903ce9d3846 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:01.508257 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-230cdadb-15ed-4f86-a6f5-8903ce9d3846 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:01.508752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-230cdadb-15ed-4f86-a6f5-8903ce9d3846 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:01.509243 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-230cdadb-15ed-4f86-a6f5-8903ce9d3846 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:01.509947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-230cdadb-15ed-4f86-a6f5-8903ce9d3846 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:01.510430 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-230cdadb-15ed-4f86-a6f5-8903ce9d3846 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:01.510856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-230cdadb-15ed-4f86-a6f5-8903ce9d3846 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:01.541839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-230cdadb-15ed-4f86-a6f5-8903ce9d3846 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046376 Aug 30 14:52:01.542677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 558/1127] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:01 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:02.471816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-73cc30fb-da5f-46d0-b92a-4c0c402e55e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:02.473869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-73cc30fb-da5f-46d0-b92a-4c0c402e55e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:02.480265 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73cc30fb-da5f-46d0-b92a-4c0c402e55e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:02.480751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73cc30fb-da5f-46d0-b92a-4c0c402e55e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:02.481188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73cc30fb-da5f-46d0-b92a-4c0c402e55e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:02.481879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73cc30fb-da5f-46d0-b92a-4c0c402e55e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:02.482333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73cc30fb-da5f-46d0-b92a-4c0c402e55e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:02.482756 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-73cc30fb-da5f-46d0-b92a-4c0c402e55e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:02.512734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-73cc30fb-da5f-46d0-b92a-4c0c402e55e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045063 Aug 30 14:52:02.513294 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 570/1128] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:02 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:02.558498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6c8e5d3e-89ae-455e-af58-bc8b606b26d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:02.560687 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6c8e5d3e-89ae-455e-af58-bc8b606b26d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:02.567463 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c8e5d3e-89ae-455e-af58-bc8b606b26d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:02.567945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c8e5d3e-89ae-455e-af58-bc8b606b26d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:02.568380 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c8e5d3e-89ae-455e-af58-bc8b606b26d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:02.569078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c8e5d3e-89ae-455e-af58-bc8b606b26d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:02.570222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c8e5d3e-89ae-455e-af58-bc8b606b26d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:02.570654 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c8e5d3e-89ae-455e-af58-bc8b606b26d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:02.600177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6c8e5d3e-89ae-455e-af58-bc8b606b26d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046228 Aug 30 14:52:02.601241 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 559/1129] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:02 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:03.525825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2a358988-b185-4ce4-b30e-05efae383075 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:03.527983 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2a358988-b185-4ce4-b30e-05efae383075 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:03.534272 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a358988-b185-4ce4-b30e-05efae383075 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:03.534757 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a358988-b185-4ce4-b30e-05efae383075 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:03.535192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a358988-b185-4ce4-b30e-05efae383075 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:03.535911 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a358988-b185-4ce4-b30e-05efae383075 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:03.536360 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a358988-b185-4ce4-b30e-05efae383075 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:03.536783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a358988-b185-4ce4-b30e-05efae383075 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:03.566928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2a358988-b185-4ce4-b30e-05efae383075 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045857 Aug 30 14:52:03.567531 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 571/1130] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:03 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:03.612711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-da776ff8-600a-47d6-80ab-1eb0dc650a27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:03.614804 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-da776ff8-600a-47d6-80ab-1eb0dc650a27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:03.621401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da776ff8-600a-47d6-80ab-1eb0dc650a27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:03.621877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da776ff8-600a-47d6-80ab-1eb0dc650a27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:03.622401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da776ff8-600a-47d6-80ab-1eb0dc650a27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:03.623097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da776ff8-600a-47d6-80ab-1eb0dc650a27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:03.623564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da776ff8-600a-47d6-80ab-1eb0dc650a27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:03.623977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da776ff8-600a-47d6-80ab-1eb0dc650a27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:03.655329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-da776ff8-600a-47d6-80ab-1eb0dc650a27 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046460 Aug 30 14:52:03.655878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 560/1131] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:03 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:04.580527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-36ea8f0d-a676-478e-ad45-322ec51aaeda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:04.582707 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-36ea8f0d-a676-478e-ad45-322ec51aaeda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:04.589866 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36ea8f0d-a676-478e-ad45-322ec51aaeda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:04.590334 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36ea8f0d-a676-478e-ad45-322ec51aaeda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:04.590760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36ea8f0d-a676-478e-ad45-322ec51aaeda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:04.591471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36ea8f0d-a676-478e-ad45-322ec51aaeda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:04.591971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36ea8f0d-a676-478e-ad45-322ec51aaeda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:04.592387 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36ea8f0d-a676-478e-ad45-322ec51aaeda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:04.621546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-36ea8f0d-a676-478e-ad45-322ec51aaeda tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045063 Aug 30 14:52:04.622096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 572/1132] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:04 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:04.667977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2d2715df-aa1e-49b9-af61-387595d449d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:04.670106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2d2715df-aa1e-49b9-af61-387595d449d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:04.676382 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2715df-aa1e-49b9-af61-387595d449d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:04.676863 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2715df-aa1e-49b9-af61-387595d449d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:04.677297 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2715df-aa1e-49b9-af61-387595d449d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:04.678024 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2715df-aa1e-49b9-af61-387595d449d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:04.678477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2715df-aa1e-49b9-af61-387595d449d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:04.678901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d2715df-aa1e-49b9-af61-387595d449d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:04.708736 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2d2715df-aa1e-49b9-af61-387595d449d9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045372 Aug 30 14:52:04.709290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 561/1133] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:04 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:05.634434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-47052805-30b8-45f6-a037-43e48f6e1fc1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:05.636658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-47052805-30b8-45f6-a037-43e48f6e1fc1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:05.643447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-47052805-30b8-45f6-a037-43e48f6e1fc1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:05.643932 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-47052805-30b8-45f6-a037-43e48f6e1fc1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:05.644365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-47052805-30b8-45f6-a037-43e48f6e1fc1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:05.645068 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-47052805-30b8-45f6-a037-43e48f6e1fc1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:05.645511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-47052805-30b8-45f6-a037-43e48f6e1fc1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:05.645927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-47052805-30b8-45f6-a037-43e48f6e1fc1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:05.678129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-47052805-30b8-45f6-a037-43e48f6e1fc1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047918 Aug 30 14:52:05.678708 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 573/1134] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:05 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:05.722240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-34d7dac0-8f1c-4203-8c4a-d0545bb8bbe1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:05.724513 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-34d7dac0-8f1c-4203-8c4a-d0545bb8bbe1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:05.727644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=58 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:05.732955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34d7dac0-8f1c-4203-8c4a-d0545bb8bbe1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:05.733487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34d7dac0-8f1c-4203-8c4a-d0545bb8bbe1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:05.733864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34d7dac0-8f1c-4203-8c4a-d0545bb8bbe1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:05.734561 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34d7dac0-8f1c-4203-8c4a-d0545bb8bbe1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:05.735009 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34d7dac0-8f1c-4203-8c4a-d0545bb8bbe1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:05.735458 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34d7dac0-8f1c-4203-8c4a-d0545bb8bbe1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:05.765532 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-34d7dac0-8f1c-4203-8c4a-d0545bb8bbe1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047501 Aug 30 14:52:05.766086 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 562/1135] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:05 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:06.691744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e1bb3e0c-77b3-45ed-8f7b-be6567346dbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:06.693896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e1bb3e0c-77b3-45ed-8f7b-be6567346dbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:06.697018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=58 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:06.702290 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e1bb3e0c-77b3-45ed-8f7b-be6567346dbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:06.702775 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e1bb3e0c-77b3-45ed-8f7b-be6567346dbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:06.703225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e1bb3e0c-77b3-45ed-8f7b-be6567346dbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:06.703927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e1bb3e0c-77b3-45ed-8f7b-be6567346dbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:06.704371 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e1bb3e0c-77b3-45ed-8f7b-be6567346dbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:06.704790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e1bb3e0c-77b3-45ed-8f7b-be6567346dbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:06.733572 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e1bb3e0c-77b3-45ed-8f7b-be6567346dbc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046101 Aug 30 14:52:06.734128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 574/1136] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:06 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:06.777885 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0f772a1e-a4fc-4d0a-bc54-3b79d605167d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:06.780036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0f772a1e-a4fc-4d0a-bc54-3b79d605167d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:06.785743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f772a1e-a4fc-4d0a-bc54-3b79d605167d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:06.786222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f772a1e-a4fc-4d0a-bc54-3b79d605167d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:06.786656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f772a1e-a4fc-4d0a-bc54-3b79d605167d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:06.787379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f772a1e-a4fc-4d0a-bc54-3b79d605167d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:06.787828 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f772a1e-a4fc-4d0a-bc54-3b79d605167d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:06.788249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f772a1e-a4fc-4d0a-bc54-3b79d605167d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:06.821463 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0f772a1e-a4fc-4d0a-bc54-3b79d605167d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047963 Aug 30 14:52:06.822025 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 563/1137] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:06 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:07.745904 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ff06660b-acd7-4537-8f7d-e187782c4325 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:07.747980 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ff06660b-acd7-4537-8f7d-e187782c4325 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:07.754412 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ff06660b-acd7-4537-8f7d-e187782c4325 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:07.754896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ff06660b-acd7-4537-8f7d-e187782c4325 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:07.755369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ff06660b-acd7-4537-8f7d-e187782c4325 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:07.756061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ff06660b-acd7-4537-8f7d-e187782c4325 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:07.756510 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ff06660b-acd7-4537-8f7d-e187782c4325 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:07.756933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ff06660b-acd7-4537-8f7d-e187782c4325 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:07.785823 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ff06660b-acd7-4537-8f7d-e187782c4325 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044209 Aug 30 14:52:07.786376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 575/1138] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:07 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:07.833373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d77158b7-b82e-4eaa-88b0-a33ce7a3049d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:07.836789 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d77158b7-b82e-4eaa-88b0-a33ce7a3049d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:07.843114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d77158b7-b82e-4eaa-88b0-a33ce7a3049d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:07.843616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d77158b7-b82e-4eaa-88b0-a33ce7a3049d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:07.844041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d77158b7-b82e-4eaa-88b0-a33ce7a3049d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:07.844741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d77158b7-b82e-4eaa-88b0-a33ce7a3049d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:07.845157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d77158b7-b82e-4eaa-88b0-a33ce7a3049d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:07.845568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d77158b7-b82e-4eaa-88b0-a33ce7a3049d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:07.875077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d77158b7-b82e-4eaa-88b0-a33ce7a3049d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045584 Aug 30 14:52:07.875662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 564/1139] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:07 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:08.798723 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d8088935-4e39-4eb5-84c9-61924ce8c650 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:08.800987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d8088935-4e39-4eb5-84c9-61924ce8c650 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:08.807900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8088935-4e39-4eb5-84c9-61924ce8c650 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:08.808380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8088935-4e39-4eb5-84c9-61924ce8c650 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:08.808810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8088935-4e39-4eb5-84c9-61924ce8c650 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:08.809493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8088935-4e39-4eb5-84c9-61924ce8c650 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:08.809940 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8088935-4e39-4eb5-84c9-61924ce8c650 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:08.810358 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8088935-4e39-4eb5-84c9-61924ce8c650 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:08.840538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d8088935-4e39-4eb5-84c9-61924ce8c650 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045854 Aug 30 14:52:08.841087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 576/1140] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:08 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:08.887848 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7d7330bc-e99c-47d7-99cd-4461cf9c20b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:08.890180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7d7330bc-e99c-47d7-99cd-4461cf9c20b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:08.896119 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d7330bc-e99c-47d7-99cd-4461cf9c20b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:08.896592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d7330bc-e99c-47d7-99cd-4461cf9c20b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:08.897019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d7330bc-e99c-47d7-99cd-4461cf9c20b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:08.897696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d7330bc-e99c-47d7-99cd-4461cf9c20b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:08.898988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d7330bc-e99c-47d7-99cd-4461cf9c20b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:08.899757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d7330bc-e99c-47d7-99cd-4461cf9c20b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:08.937618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7d7330bc-e99c-47d7-99cd-4461cf9c20b5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054898 Aug 30 14:52:08.938170 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 565/1141] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:08 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:09.853919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2e11f0bf-c25c-4f81-bda2-3c9607f97587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:09.856086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2e11f0bf-c25c-4f81-bda2-3c9607f97587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:09.862318 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e11f0bf-c25c-4f81-bda2-3c9607f97587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:09.862798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e11f0bf-c25c-4f81-bda2-3c9607f97587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:09.863252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e11f0bf-c25c-4f81-bda2-3c9607f97587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:09.863933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e11f0bf-c25c-4f81-bda2-3c9607f97587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:09.864373 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e11f0bf-c25c-4f81-bda2-3c9607f97587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:09.864791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2e11f0bf-c25c-4f81-bda2-3c9607f97587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:09.868701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:09.894690 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2e11f0bf-c25c-4f81-bda2-3c9607f97587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045895 Aug 30 14:52:09.895363 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 577/1142] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:09 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:09.949872 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-52a1e9e8-3fb8-4a42-adf3-04517516c6fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:09.952144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-52a1e9e8-3fb8-4a42-adf3-04517516c6fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:09.958476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52a1e9e8-3fb8-4a42-adf3-04517516c6fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:09.958952 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52a1e9e8-3fb8-4a42-adf3-04517516c6fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:09.959416 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52a1e9e8-3fb8-4a42-adf3-04517516c6fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:09.960099 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52a1e9e8-3fb8-4a42-adf3-04517516c6fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:09.961097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52a1e9e8-3fb8-4a42-adf3-04517516c6fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:09.961508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52a1e9e8-3fb8-4a42-adf3-04517516c6fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:09.991294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-52a1e9e8-3fb8-4a42-adf3-04517516c6fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045286 Aug 30 14:52:09.992051 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 566/1143] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:09 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:52:10.908212 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-da125e1e-8f35-4adf-ac21-92921088ce9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:10.910398 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-da125e1e-8f35-4adf-ac21-92921088ce9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:10.917350 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da125e1e-8f35-4adf-ac21-92921088ce9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:10.917827 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da125e1e-8f35-4adf-ac21-92921088ce9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:10.918256 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da125e1e-8f35-4adf-ac21-92921088ce9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:10.918941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da125e1e-8f35-4adf-ac21-92921088ce9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:10.919416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da125e1e-8f35-4adf-ac21-92921088ce9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:10.919836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da125e1e-8f35-4adf-ac21-92921088ce9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:10.964777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-da125e1e-8f35-4adf-ac21-92921088ce9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060507 Aug 30 14:52:10.965329 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 578/1144] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:10 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:11.003408 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c80ec37c-225b-46d8-ba41-544ca29ee87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:11.006163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c80ec37c-225b-46d8-ba41-544ca29ee87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:11.012488 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c80ec37c-225b-46d8-ba41-544ca29ee87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:11.012980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c80ec37c-225b-46d8-ba41-544ca29ee87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:11.013360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c80ec37c-225b-46d8-ba41-544ca29ee87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:11.014038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c80ec37c-225b-46d8-ba41-544ca29ee87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:11.014549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c80ec37c-225b-46d8-ba41-544ca29ee87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:11.014968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c80ec37c-225b-46d8-ba41-544ca29ee87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:11.044167 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c80ec37c-225b-46d8-ba41-544ca29ee87b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044645 Aug 30 14:52:11.044710 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 567/1145] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:10 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:11.977320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a660a1a1-f716-4e8f-a544-7cbadf64884d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:11.979408 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a660a1a1-f716-4e8f-a544-7cbadf64884d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:11.985701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a660a1a1-f716-4e8f-a544-7cbadf64884d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:11.986175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a660a1a1-f716-4e8f-a544-7cbadf64884d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:11.986606 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a660a1a1-f716-4e8f-a544-7cbadf64884d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:11.987315 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a660a1a1-f716-4e8f-a544-7cbadf64884d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:11.987764 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a660a1a1-f716-4e8f-a544-7cbadf64884d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:11.988185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a660a1a1-f716-4e8f-a544-7cbadf64884d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:12.016685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a660a1a1-f716-4e8f-a544-7cbadf64884d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044116 Aug 30 14:52:12.017231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 579/1146] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:11 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:12.056203 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-913a9c9c-3221-40e8-a0d9-498d5c4894ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:12.058517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-913a9c9c-3221-40e8-a0d9-498d5c4894ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:12.064611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-913a9c9c-3221-40e8-a0d9-498d5c4894ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:12.065093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-913a9c9c-3221-40e8-a0d9-498d5c4894ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:12.065527 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-913a9c9c-3221-40e8-a0d9-498d5c4894ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:12.066484 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-913a9c9c-3221-40e8-a0d9-498d5c4894ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:12.067115 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-913a9c9c-3221-40e8-a0d9-498d5c4894ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:12.067570 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-913a9c9c-3221-40e8-a0d9-498d5c4894ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:12.097257 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-913a9c9c-3221-40e8-a0d9-498d5c4894ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Aug 30 14:52:12.097825 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 568/1147] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:12 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:13.029271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0b6e19e3-4e60-4d6b-b730-e1876235cb91 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:13.031438 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0b6e19e3-4e60-4d6b-b730-e1876235cb91 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:13.037977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b6e19e3-4e60-4d6b-b730-e1876235cb91 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:13.038611 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b6e19e3-4e60-4d6b-b730-e1876235cb91 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:13.039769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b6e19e3-4e60-4d6b-b730-e1876235cb91 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:13.040625 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b6e19e3-4e60-4d6b-b730-e1876235cb91 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:13.041110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b6e19e3-4e60-4d6b-b730-e1876235cb91 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:13.041536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b6e19e3-4e60-4d6b-b730-e1876235cb91 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:13.072091 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0b6e19e3-4e60-4d6b-b730-e1876235cb91 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047029 Aug 30 14:52:13.072642 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 580/1148] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:13 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:13.109882 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-faff5b36-1e86-4052-b423-90a8cffd859f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:13.112587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-faff5b36-1e86-4052-b423-90a8cffd859f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:13.122404 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faff5b36-1e86-4052-b423-90a8cffd859f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:13.122883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faff5b36-1e86-4052-b423-90a8cffd859f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:13.123342 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faff5b36-1e86-4052-b423-90a8cffd859f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:13.124052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faff5b36-1e86-4052-b423-90a8cffd859f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:13.124528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faff5b36-1e86-4052-b423-90a8cffd859f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:13.124944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faff5b36-1e86-4052-b423-90a8cffd859f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:13.153641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-faff5b36-1e86-4052-b423-90a8cffd859f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047652 Aug 30 14:52:13.154186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 569/1149] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:13 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:14.084473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7c9040ff-fb2b-4697-8088-44bd011132dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:14.086652 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7c9040ff-fb2b-4697-8088-44bd011132dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:14.093089 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c9040ff-fb2b-4697-8088-44bd011132dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:14.093570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c9040ff-fb2b-4697-8088-44bd011132dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:14.094004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c9040ff-fb2b-4697-8088-44bd011132dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:14.094694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c9040ff-fb2b-4697-8088-44bd011132dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:14.095143 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c9040ff-fb2b-4697-8088-44bd011132dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:14.095590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c9040ff-fb2b-4697-8088-44bd011132dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:14.125071 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7c9040ff-fb2b-4697-8088-44bd011132dd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044560 Aug 30 14:52:14.125613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 581/1150] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:14 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:52:14.166154 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a5b8395b-b180-44cf-bbac-bc10ae12c875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:14.168437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a5b8395b-b180-44cf-bbac-bc10ae12c875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:14.174761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5b8395b-b180-44cf-bbac-bc10ae12c875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:14.175266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5b8395b-b180-44cf-bbac-bc10ae12c875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:14.175704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5b8395b-b180-44cf-bbac-bc10ae12c875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:14.176387 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5b8395b-b180-44cf-bbac-bc10ae12c875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:14.176833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5b8395b-b180-44cf-bbac-bc10ae12c875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:14.177252 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5b8395b-b180-44cf-bbac-bc10ae12c875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:14.206483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a5b8395b-b180-44cf-bbac-bc10ae12c875 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044747 Aug 30 14:52:14.207037 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 570/1151] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:14 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:15.137509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-81626780-da94-41ca-97f3-407a7bad695c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:15.139673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-81626780-da94-41ca-97f3-407a7bad695c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:15.145666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81626780-da94-41ca-97f3-407a7bad695c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:15.146146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81626780-da94-41ca-97f3-407a7bad695c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:15.146579 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81626780-da94-41ca-97f3-407a7bad695c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:15.147286 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81626780-da94-41ca-97f3-407a7bad695c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:15.147799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81626780-da94-41ca-97f3-407a7bad695c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:15.148230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81626780-da94-41ca-97f3-407a7bad695c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:15.176722 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-81626780-da94-41ca-97f3-407a7bad695c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043480 Aug 30 14:52:15.177266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 582/1152] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:15 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:15.218362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6ef05c6e-c830-43f8-9832-9fed0f9482ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:15.223996 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6ef05c6e-c830-43f8-9832-9fed0f9482ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:15.227150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ef05c6e-c830-43f8-9832-9fed0f9482ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:15.227674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ef05c6e-c830-43f8-9832-9fed0f9482ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:15.228108 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ef05c6e-c830-43f8-9832-9fed0f9482ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:15.228805 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ef05c6e-c830-43f8-9832-9fed0f9482ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:15.229256 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ef05c6e-c830-43f8-9832-9fed0f9482ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:15.229682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ef05c6e-c830-43f8-9832-9fed0f9482ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:15.259939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6ef05c6e-c830-43f8-9832-9fed0f9482ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045455 Aug 30 14:52:15.260495 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 571/1153] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:15 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:16.190147 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2ca16dff-d201-4a1e-a335-50f9ae77f9b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:16.192570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2ca16dff-d201-4a1e-a335-50f9ae77f9b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:16.199694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ca16dff-d201-4a1e-a335-50f9ae77f9b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:16.200167 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ca16dff-d201-4a1e-a335-50f9ae77f9b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:16.200595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ca16dff-d201-4a1e-a335-50f9ae77f9b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:16.201280 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ca16dff-d201-4a1e-a335-50f9ae77f9b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:16.201722 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ca16dff-d201-4a1e-a335-50f9ae77f9b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:16.202142 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ca16dff-d201-4a1e-a335-50f9ae77f9b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:16.236458 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2ca16dff-d201-4a1e-a335-50f9ae77f9b7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049123 Aug 30 14:52:16.237043 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 583/1154] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:16 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:16.272452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3d2b83ce-e8af-4ce6-97d3-b846bdcdc1ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:16.275423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3d2b83ce-e8af-4ce6-97d3-b846bdcdc1ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:16.281752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d2b83ce-e8af-4ce6-97d3-b846bdcdc1ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:16.282312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d2b83ce-e8af-4ce6-97d3-b846bdcdc1ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:16.282758 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d2b83ce-e8af-4ce6-97d3-b846bdcdc1ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:16.283474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d2b83ce-e8af-4ce6-97d3-b846bdcdc1ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:16.283930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d2b83ce-e8af-4ce6-97d3-b846bdcdc1ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:16.284351 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d2b83ce-e8af-4ce6-97d3-b846bdcdc1ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:16.312700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3d2b83ce-e8af-4ce6-97d3-b846bdcdc1ee tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044460 Aug 30 14:52:16.313248 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 572/1155] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:16 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:16.903546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3e61dc51-2ec6-4408-9d3d-8b1aa071d17a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:16.904073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3e61dc51-2ec6-4408-9d3d-8b1aa071d17a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:16.910031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e61dc51-2ec6-4408-9d3d-8b1aa071d17a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:16.910513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e61dc51-2ec6-4408-9d3d-8b1aa071d17a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:16.910942 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e61dc51-2ec6-4408-9d3d-8b1aa071d17a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:16.911670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e61dc51-2ec6-4408-9d3d-8b1aa071d17a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:16.912122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e61dc51-2ec6-4408-9d3d-8b1aa071d17a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:16.912543 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3e61dc51-2ec6-4408-9d3d-8b1aa071d17a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:17.095459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.objects.instance [None req-3e61dc51-2ec6-4408-9d3d-8b1aa071d17a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lazy-loading 'services' on Instance uuid 38cae1b8-5973-4846-b2f4-79ed7e98be62 {{(pid=127089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:52:17.185028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3e61dc51-2ec6-4408-9d3d-8b1aa071d17a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [3fc6e75c-0cce-425d-887f-747d8b9403b8] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 14:52:17.248901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f0ab57a6-4b22-4159-b80c-549904a8d3d8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:17.251091 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f0ab57a6-4b22-4159-b80c-549904a8d3d8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:17.257695 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0ab57a6-4b22-4159-b80c-549904a8d3d8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:17.258180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0ab57a6-4b22-4159-b80c-549904a8d3d8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:17.258611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0ab57a6-4b22-4159-b80c-549904a8d3d8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:17.259337 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0ab57a6-4b22-4159-b80c-549904a8d3d8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:17.259782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0ab57a6-4b22-4159-b80c-549904a8d3d8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:17.260203 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0ab57a6-4b22-4159-b80c-549904a8d3d8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:17.276815 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:17.291483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f0ab57a6-4b22-4159-b80c-549904a8d3d8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046571 Aug 30 14:52:17.292052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 573/1156] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:17 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:52:17.325908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-10220ce6-da1d-40f5-bc1f-83586dd5ad48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:17.328067 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-10220ce6-da1d-40f5-bc1f-83586dd5ad48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:17.333868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10220ce6-da1d-40f5-bc1f-83586dd5ad48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:17.334347 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10220ce6-da1d-40f5-bc1f-83586dd5ad48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:17.334781 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10220ce6-da1d-40f5-bc1f-83586dd5ad48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:17.335600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10220ce6-da1d-40f5-bc1f-83586dd5ad48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:17.336048 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10220ce6-da1d-40f5-bc1f-83586dd5ad48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:17.336469 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10220ce6-da1d-40f5-bc1f-83586dd5ad48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:17.364979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-10220ce6-da1d-40f5-bc1f-83586dd5ad48 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042969 Aug 30 14:52:17.365524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 574/1157] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:17 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:52:18.191862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [None req-3e61dc51-2ec6-4408-9d3d-8b1aa071d17a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [3fc6e75c-0cce-425d-887f-747d8b9403b8] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 53328. Aug 30 14:52:18.195421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3e61dc51-2ec6-4408-9d3d-8b1aa071d17a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62/os-volume_attachments/bb4947a0-1df0-41da-8b36-045778982ab8" status: 202 len: 0 microversion: 2.1 time: 1.295827 Aug 30 14:52:18.196003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 584/1158] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 14:52:16 2022] DELETE /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62/os-volume_attachments/bb4947a0-1df0-41da-8b36-045778982ab8 => generated 0 bytes in 1298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:52:18.303961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-93447058-f12d-44ea-beac-88d5a895288e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:18.306252 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-93447058-f12d-44ea-beac-88d5a895288e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:18.313119 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93447058-f12d-44ea-beac-88d5a895288e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:18.313598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93447058-f12d-44ea-beac-88d5a895288e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:18.314032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93447058-f12d-44ea-beac-88d5a895288e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:18.314724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93447058-f12d-44ea-beac-88d5a895288e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:18.315176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93447058-f12d-44ea-beac-88d5a895288e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:18.315625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93447058-f12d-44ea-beac-88d5a895288e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:18.346435 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-93447058-f12d-44ea-beac-88d5a895288e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046543 Aug 30 14:52:18.347001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 575/1159] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:18 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:18.378778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0c648858-8cf8-4b0d-8caa-5486c18b7cd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:18.381186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0c648858-8cf8-4b0d-8caa-5486c18b7cd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:18.388080 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c648858-8cf8-4b0d-8caa-5486c18b7cd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:18.388632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c648858-8cf8-4b0d-8caa-5486c18b7cd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:18.389072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c648858-8cf8-4b0d-8caa-5486c18b7cd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:18.389774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c648858-8cf8-4b0d-8caa-5486c18b7cd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:18.390245 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c648858-8cf8-4b0d-8caa-5486c18b7cd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:18.390671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c648858-8cf8-4b0d-8caa-5486c18b7cd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:18.420951 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0c648858-8cf8-4b0d-8caa-5486c18b7cd1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047177 Aug 30 14:52:18.421495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 585/1160] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:18 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:19.358015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3e8db2ac-e047-44f5-b86a-83a5665a8fdf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:19.360148 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3e8db2ac-e047-44f5-b86a-83a5665a8fdf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:19.366388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e8db2ac-e047-44f5-b86a-83a5665a8fdf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:19.367031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e8db2ac-e047-44f5-b86a-83a5665a8fdf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:19.367494 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e8db2ac-e047-44f5-b86a-83a5665a8fdf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:19.368181 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e8db2ac-e047-44f5-b86a-83a5665a8fdf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:19.368664 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e8db2ac-e047-44f5-b86a-83a5665a8fdf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:19.369082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e8db2ac-e047-44f5-b86a-83a5665a8fdf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:19.398877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3e8db2ac-e047-44f5-b86a-83a5665a8fdf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044225 Aug 30 14:52:19.399481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 576/1161] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:19 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:19.433419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ed84820c-de89-4061-9081-a39bb0aa252b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:19.435575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ed84820c-de89-4061-9081-a39bb0aa252b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:19.442349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ed84820c-de89-4061-9081-a39bb0aa252b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:19.442829 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ed84820c-de89-4061-9081-a39bb0aa252b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:19.443284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ed84820c-de89-4061-9081-a39bb0aa252b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:19.443970 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ed84820c-de89-4061-9081-a39bb0aa252b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:19.445157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ed84820c-de89-4061-9081-a39bb0aa252b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:19.445684 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ed84820c-de89-4061-9081-a39bb0aa252b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:19.474825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ed84820c-de89-4061-9081-a39bb0aa252b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045706 Aug 30 14:52:19.475583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 586/1162] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:19 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:20.411467 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d97110dc-8992-4ac1-ac4a-21b1f6dd206e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:20.413652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d97110dc-8992-4ac1-ac4a-21b1f6dd206e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:20.419702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d97110dc-8992-4ac1-ac4a-21b1f6dd206e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:20.420180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d97110dc-8992-4ac1-ac4a-21b1f6dd206e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:20.420609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d97110dc-8992-4ac1-ac4a-21b1f6dd206e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:20.421319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d97110dc-8992-4ac1-ac4a-21b1f6dd206e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:20.421765 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d97110dc-8992-4ac1-ac4a-21b1f6dd206e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:20.422210 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d97110dc-8992-4ac1-ac4a-21b1f6dd206e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:20.452079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d97110dc-8992-4ac1-ac4a-21b1f6dd206e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044663 Aug 30 14:52:20.452638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 577/1163] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:20 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:20.488480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d7bb7b95-a641-4557-8fce-3566ff1ec0f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:20.490679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d7bb7b95-a641-4557-8fce-3566ff1ec0f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:20.497694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d7bb7b95-a641-4557-8fce-3566ff1ec0f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:20.498180 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d7bb7b95-a641-4557-8fce-3566ff1ec0f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:20.498619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d7bb7b95-a641-4557-8fce-3566ff1ec0f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:20.499358 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d7bb7b95-a641-4557-8fce-3566ff1ec0f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:20.499810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d7bb7b95-a641-4557-8fce-3566ff1ec0f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:20.500235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d7bb7b95-a641-4557-8fce-3566ff1ec0f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:20.529882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d7bb7b95-a641-4557-8fce-3566ff1ec0f7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045276 Aug 30 14:52:20.530443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 587/1164] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:20 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:21.465053 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2cf26440-e7d7-42e7-84b2-d81e424d3560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:21.467201 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2cf26440-e7d7-42e7-84b2-d81e424d3560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:21.473545 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2cf26440-e7d7-42e7-84b2-d81e424d3560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:21.474012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2cf26440-e7d7-42e7-84b2-d81e424d3560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:21.474439 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2cf26440-e7d7-42e7-84b2-d81e424d3560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:21.475112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2cf26440-e7d7-42e7-84b2-d81e424d3560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:21.475581 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2cf26440-e7d7-42e7-84b2-d81e424d3560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:21.476011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2cf26440-e7d7-42e7-84b2-d81e424d3560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:21.504974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2cf26440-e7d7-42e7-84b2-d81e424d3560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044389 Aug 30 14:52:21.505535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 578/1165] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:21 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:21.544244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-53e25bac-70ad-4847-8649-f306fa7a8d13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:21.546380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-53e25bac-70ad-4847-8649-f306fa7a8d13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:21.553132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53e25bac-70ad-4847-8649-f306fa7a8d13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:21.553616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53e25bac-70ad-4847-8649-f306fa7a8d13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:21.554049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53e25bac-70ad-4847-8649-f306fa7a8d13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:21.554837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53e25bac-70ad-4847-8649-f306fa7a8d13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:21.555320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53e25bac-70ad-4847-8649-f306fa7a8d13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:21.555747 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53e25bac-70ad-4847-8649-f306fa7a8d13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:21.586242 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-53e25bac-70ad-4847-8649-f306fa7a8d13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045815 Aug 30 14:52:21.586803 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 588/1166] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:21 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:22.517885 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-04a6c0ff-b6cf-49d5-be66-8bfc0c93ff39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:22.520037 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-04a6c0ff-b6cf-49d5-be66-8bfc0c93ff39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:22.526036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04a6c0ff-b6cf-49d5-be66-8bfc0c93ff39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:22.526508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04a6c0ff-b6cf-49d5-be66-8bfc0c93ff39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:22.526929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04a6c0ff-b6cf-49d5-be66-8bfc0c93ff39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:22.527647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04a6c0ff-b6cf-49d5-be66-8bfc0c93ff39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:22.528084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04a6c0ff-b6cf-49d5-be66-8bfc0c93ff39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:22.528499 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04a6c0ff-b6cf-49d5-be66-8bfc0c93ff39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:22.559043 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-04a6c0ff-b6cf-49d5-be66-8bfc0c93ff39 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045053 Aug 30 14:52:22.559636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 579/1167] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:22 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:22.597972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a55666e4-051e-4d57-9dec-6dc60dcde67f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:22.600166 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a55666e4-051e-4d57-9dec-6dc60dcde67f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:22.606491 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a55666e4-051e-4d57-9dec-6dc60dcde67f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:22.606973 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a55666e4-051e-4d57-9dec-6dc60dcde67f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:22.607466 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a55666e4-051e-4d57-9dec-6dc60dcde67f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:22.608209 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a55666e4-051e-4d57-9dec-6dc60dcde67f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:22.608617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a55666e4-051e-4d57-9dec-6dc60dcde67f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:22.609041 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a55666e4-051e-4d57-9dec-6dc60dcde67f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:22.638857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a55666e4-051e-4d57-9dec-6dc60dcde67f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044889 Aug 30 14:52:22.639466 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 589/1168] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:22 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:23.572196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7ed84ed0-7dbd-46e3-86f1-5f847aedede7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:23.574303 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7ed84ed0-7dbd-46e3-86f1-5f847aedede7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:23.580923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ed84ed0-7dbd-46e3-86f1-5f847aedede7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:23.581620 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ed84ed0-7dbd-46e3-86f1-5f847aedede7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:23.582078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ed84ed0-7dbd-46e3-86f1-5f847aedede7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:23.582761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ed84ed0-7dbd-46e3-86f1-5f847aedede7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:23.583202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ed84ed0-7dbd-46e3-86f1-5f847aedede7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:23.583681 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ed84ed0-7dbd-46e3-86f1-5f847aedede7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:23.621514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7ed84ed0-7dbd-46e3-86f1-5f847aedede7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053698 Aug 30 14:52:23.622264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 580/1169] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:23 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:23.651958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5c321c29-fddd-436a-9273-ab5a2c102be8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:23.654140 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5c321c29-fddd-436a-9273-ab5a2c102be8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:23.660721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c321c29-fddd-436a-9273-ab5a2c102be8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:23.661211 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c321c29-fddd-436a-9273-ab5a2c102be8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:23.661646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c321c29-fddd-436a-9273-ab5a2c102be8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:23.662336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c321c29-fddd-436a-9273-ab5a2c102be8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:23.662787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c321c29-fddd-436a-9273-ab5a2c102be8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:23.663266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c321c29-fddd-436a-9273-ab5a2c102be8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:23.698582 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5c321c29-fddd-436a-9273-ab5a2c102be8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051675 Aug 30 14:52:23.699455 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 590/1170] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:23 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:24.634152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f866682b-379d-4a67-b4e4-39097d6d529d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:24.636402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f866682b-379d-4a67-b4e4-39097d6d529d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:24.642547 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f866682b-379d-4a67-b4e4-39097d6d529d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:24.643049 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f866682b-379d-4a67-b4e4-39097d6d529d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:24.643707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f866682b-379d-4a67-b4e4-39097d6d529d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:24.644392 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f866682b-379d-4a67-b4e4-39097d6d529d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:24.644837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f866682b-379d-4a67-b4e4-39097d6d529d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:24.645253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f866682b-379d-4a67-b4e4-39097d6d529d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:24.679671 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f866682b-379d-4a67-b4e4-39097d6d529d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048656 Aug 30 14:52:24.680247 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 581/1171] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:24 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:24.711862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-051b1d7f-95b3-467c-a370-5826fcda4a7f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:24.714138 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-051b1d7f-95b3-467c-a370-5826fcda4a7f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:24.721061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-051b1d7f-95b3-467c-a370-5826fcda4a7f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:24.721886 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-051b1d7f-95b3-467c-a370-5826fcda4a7f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:24.722327 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-051b1d7f-95b3-467c-a370-5826fcda4a7f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:24.723094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-051b1d7f-95b3-467c-a370-5826fcda4a7f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:24.723643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-051b1d7f-95b3-467c-a370-5826fcda4a7f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:24.724153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-051b1d7f-95b3-467c-a370-5826fcda4a7f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:24.758808 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-051b1d7f-95b3-467c-a370-5826fcda4a7f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051812 Aug 30 14:52:24.759511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 591/1172] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:24 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:25.691595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e27c2bef-e19e-480d-80c9-97580e14aa2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:25.693941 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e27c2bef-e19e-480d-80c9-97580e14aa2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:25.701304 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e27c2bef-e19e-480d-80c9-97580e14aa2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:25.701785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e27c2bef-e19e-480d-80c9-97580e14aa2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:25.702236 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e27c2bef-e19e-480d-80c9-97580e14aa2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:25.703166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e27c2bef-e19e-480d-80c9-97580e14aa2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:25.703684 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e27c2bef-e19e-480d-80c9-97580e14aa2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:25.704273 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e27c2bef-e19e-480d-80c9-97580e14aa2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:25.733970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e27c2bef-e19e-480d-80c9-97580e14aa2a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046751 Aug 30 14:52:25.734524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 582/1173] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:25 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 14:52:25.771273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f57dcad4-e2ef-4606-b876-8d0e0f1cb30d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:25.773754 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f57dcad4-e2ef-4606-b876-8d0e0f1cb30d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:25.780331 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f57dcad4-e2ef-4606-b876-8d0e0f1cb30d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:25.780811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f57dcad4-e2ef-4606-b876-8d0e0f1cb30d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:25.781240 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f57dcad4-e2ef-4606-b876-8d0e0f1cb30d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:25.781927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f57dcad4-e2ef-4606-b876-8d0e0f1cb30d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:25.782405 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f57dcad4-e2ef-4606-b876-8d0e0f1cb30d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:25.782822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f57dcad4-e2ef-4606-b876-8d0e0f1cb30d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:25.817303 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f57dcad4-e2ef-4606-b876-8d0e0f1cb30d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050042 Aug 30 14:52:25.818150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 592/1174] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:25 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:26.745960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-492add18-b714-4848-b980-6fe992a0b094 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:26.748123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-492add18-b714-4848-b980-6fe992a0b094 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:26.754463 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-492add18-b714-4848-b980-6fe992a0b094 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:26.754942 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-492add18-b714-4848-b980-6fe992a0b094 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:26.755473 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-492add18-b714-4848-b980-6fe992a0b094 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:26.756108 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-492add18-b714-4848-b980-6fe992a0b094 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:26.756552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-492add18-b714-4848-b980-6fe992a0b094 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:26.757511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-492add18-b714-4848-b980-6fe992a0b094 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:26.786546 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-492add18-b714-4848-b980-6fe992a0b094 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044586 Aug 30 14:52:26.787096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 583/1175] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:26 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:26.829902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4746717a-7bdb-4e2c-b524-26e47c6ab4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:26.832061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4746717a-7bdb-4e2c-b524-26e47c6ab4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:26.839337 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4746717a-7bdb-4e2c-b524-26e47c6ab4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:26.839822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4746717a-7bdb-4e2c-b524-26e47c6ab4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:26.840261 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4746717a-7bdb-4e2c-b524-26e47c6ab4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:26.840953 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4746717a-7bdb-4e2c-b524-26e47c6ab4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:26.841409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4746717a-7bdb-4e2c-b524-26e47c6ab4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:26.841833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4746717a-7bdb-4e2c-b524-26e47c6ab4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:26.845553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:26.871350 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4746717a-7bdb-4e2c-b524-26e47c6ab4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045347 Aug 30 14:52:26.871912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 593/1176] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:26 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:27.798873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4a5b3f91-b62b-42ea-b665-632f4756e802 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:27.801050 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4a5b3f91-b62b-42ea-b665-632f4756e802 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:27.808599 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a5b3f91-b62b-42ea-b665-632f4756e802 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:27.809067 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a5b3f91-b62b-42ea-b665-632f4756e802 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:27.809492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a5b3f91-b62b-42ea-b665-632f4756e802 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:27.810169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a5b3f91-b62b-42ea-b665-632f4756e802 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:27.810612 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a5b3f91-b62b-42ea-b665-632f4756e802 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:27.811028 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a5b3f91-b62b-42ea-b665-632f4756e802 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:27.841641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4a5b3f91-b62b-42ea-b665-632f4756e802 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046704 Aug 30 14:52:27.842183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 584/1177] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:27 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:27.884634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b4c97fde-aeb3-4b1d-8f79-a93052f82524 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:27.886798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b4c97fde-aeb3-4b1d-8f79-a93052f82524 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:27.893122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b4c97fde-aeb3-4b1d-8f79-a93052f82524 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:27.893605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b4c97fde-aeb3-4b1d-8f79-a93052f82524 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:27.894040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b4c97fde-aeb3-4b1d-8f79-a93052f82524 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:27.894726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b4c97fde-aeb3-4b1d-8f79-a93052f82524 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:27.895175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b4c97fde-aeb3-4b1d-8f79-a93052f82524 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:27.895621 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b4c97fde-aeb3-4b1d-8f79-a93052f82524 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:27.924842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b4c97fde-aeb3-4b1d-8f79-a93052f82524 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045507 Aug 30 14:52:27.925393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 594/1178] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:27 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:28.854145 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-095dc3e5-5388-4732-bf9f-284b802bd5b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:28.856310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-095dc3e5-5388-4732-bf9f-284b802bd5b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:28.863153 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-095dc3e5-5388-4732-bf9f-284b802bd5b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:28.863655 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-095dc3e5-5388-4732-bf9f-284b802bd5b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:28.864085 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-095dc3e5-5388-4732-bf9f-284b802bd5b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:28.864760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-095dc3e5-5388-4732-bf9f-284b802bd5b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:28.865278 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-095dc3e5-5388-4732-bf9f-284b802bd5b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:28.865701 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-095dc3e5-5388-4732-bf9f-284b802bd5b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:28.894652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-095dc3e5-5388-4732-bf9f-284b802bd5b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044565 Aug 30 14:52:28.895193 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 585/1179] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:28 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:28.937860 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-83d81184-fc47-4386-b18c-ce1d3d92bfdf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:28.940079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-83d81184-fc47-4386-b18c-ce1d3d92bfdf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:28.947300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83d81184-fc47-4386-b18c-ce1d3d92bfdf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:28.947786 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83d81184-fc47-4386-b18c-ce1d3d92bfdf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:28.948226 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83d81184-fc47-4386-b18c-ce1d3d92bfdf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:28.948916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83d81184-fc47-4386-b18c-ce1d3d92bfdf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:28.949371 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83d81184-fc47-4386-b18c-ce1d3d92bfdf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:28.949796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83d81184-fc47-4386-b18c-ce1d3d92bfdf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:28.981392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-83d81184-fc47-4386-b18c-ce1d3d92bfdf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047438 Aug 30 14:52:28.981952 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 595/1180] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:28 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:29.907983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-be2e2256-7c6f-4049-bc53-210f4019a1c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:29.910780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-be2e2256-7c6f-4049-bc53-210f4019a1c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:29.918046 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be2e2256-7c6f-4049-bc53-210f4019a1c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:29.918517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be2e2256-7c6f-4049-bc53-210f4019a1c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:29.918943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be2e2256-7c6f-4049-bc53-210f4019a1c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:29.919656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be2e2256-7c6f-4049-bc53-210f4019a1c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:29.920096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be2e2256-7c6f-4049-bc53-210f4019a1c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:29.920508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be2e2256-7c6f-4049-bc53-210f4019a1c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:29.950493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-be2e2256-7c6f-4049-bc53-210f4019a1c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046577 Aug 30 14:52:29.951053 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 586/1181] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 30 14:52:29 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:52:29.993834 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-616fd8f1-228c-48b2-98bf-8d6fb154aea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:29.996032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-616fd8f1-228c-48b2-98bf-8d6fb154aea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:30.002495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-616fd8f1-228c-48b2-98bf-8d6fb154aea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:30.002978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-616fd8f1-228c-48b2-98bf-8d6fb154aea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:30.003451 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-616fd8f1-228c-48b2-98bf-8d6fb154aea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:30.004145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-616fd8f1-228c-48b2-98bf-8d6fb154aea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:30.004597 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-616fd8f1-228c-48b2-98bf-8d6fb154aea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:30.005020 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-616fd8f1-228c-48b2-98bf-8d6fb154aea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:30.034808 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-616fd8f1-228c-48b2-98bf-8d6fb154aea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044984 Aug 30 14:52:30.035390 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 596/1182] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:29 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:30.962211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8aa78f1a-d6d5-4fca-95e2-e3877a4df0b1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:52:30.964375 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8aa78f1a-d6d5-4fca-95e2-e3877a4df0b1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:30.970688 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aa78f1a-d6d5-4fca-95e2-e3877a4df0b1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:30.971164 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aa78f1a-d6d5-4fca-95e2-e3877a4df0b1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:30.971632 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aa78f1a-d6d5-4fca-95e2-e3877a4df0b1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:30.972312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aa78f1a-d6d5-4fca-95e2-e3877a4df0b1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:30.972757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aa78f1a-d6d5-4fca-95e2-e3877a4df0b1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:30.973172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aa78f1a-d6d5-4fca-95e2-e3877a4df0b1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:30.999571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8aa78f1a-d6d5-4fca-95e2-e3877a4df0b1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [ee50b762-5726-4142-94d6-4a6dbad0667f] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 14:52:31.270627 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-830afda7-8aa8-4a93-bbf8-902e7013775d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:31.272888 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-830afda7-8aa8-4a93-bbf8-902e7013775d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:31.278929 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-830afda7-8aa8-4a93-bbf8-902e7013775d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:31.279457 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-830afda7-8aa8-4a93-bbf8-902e7013775d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:31.280033 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-830afda7-8aa8-4a93-bbf8-902e7013775d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:31.280868 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-830afda7-8aa8-4a93-bbf8-902e7013775d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:31.281447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-830afda7-8aa8-4a93-bbf8-902e7013775d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:31.281889 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-830afda7-8aa8-4a93-bbf8-902e7013775d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:31.312576 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-830afda7-8aa8-4a93-bbf8-902e7013775d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.268157 Aug 30 14:52:31.313145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 597/1183] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:31 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:52:32.006958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [None req-8aa78f1a-d6d5-4fca-95e2-e3877a4df0b1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [ee50b762-5726-4142-94d6-4a6dbad0667f] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 53558. Aug 30 14:52:32.083378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8aa78f1a-d6d5-4fca-95e2-e3877a4df0b1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "POST /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/action" status: 200 len: 37785 microversion: 2.20 time: 1.125177 Aug 30 14:52:32.084058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 587/1184] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 30 14:52:30 2022] POST /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0/action => generated 37785 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:52:32.325850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6c8510c4-55dd-498e-8fc0-0bee14f839ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:32.328211 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6c8510c4-55dd-498e-8fc0-0bee14f839ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:32.335131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c8510c4-55dd-498e-8fc0-0bee14f839ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:32.335736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c8510c4-55dd-498e-8fc0-0bee14f839ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:32.336173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c8510c4-55dd-498e-8fc0-0bee14f839ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:32.336870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c8510c4-55dd-498e-8fc0-0bee14f839ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:32.337322 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c8510c4-55dd-498e-8fc0-0bee14f839ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:32.337744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c8510c4-55dd-498e-8fc0-0bee14f839ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:32.367473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6c8510c4-55dd-498e-8fc0-0bee14f839ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045755 Aug 30 14:52:32.368350 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 598/1185] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:32 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:33.380292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-105c6446-c855-4863-bfcc-1dc449fd51cf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:33.383153 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-105c6446-c855-4863-bfcc-1dc449fd51cf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:33.390240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-105c6446-c855-4863-bfcc-1dc449fd51cf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:33.390723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-105c6446-c855-4863-bfcc-1dc449fd51cf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:33.391156 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-105c6446-c855-4863-bfcc-1dc449fd51cf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:33.391873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-105c6446-c855-4863-bfcc-1dc449fd51cf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:33.392323 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-105c6446-c855-4863-bfcc-1dc449fd51cf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:33.392745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-105c6446-c855-4863-bfcc-1dc449fd51cf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:33.424958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-105c6446-c855-4863-bfcc-1dc449fd51cf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049001 Aug 30 14:52:33.425657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 588/1186] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:33 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:34.437137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-566b353c-c808-4c03-8279-2bcbf67eae05 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:34.439254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-566b353c-c808-4c03-8279-2bcbf67eae05 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:34.446232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-566b353c-c808-4c03-8279-2bcbf67eae05 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:34.446718 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-566b353c-c808-4c03-8279-2bcbf67eae05 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:34.447148 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-566b353c-c808-4c03-8279-2bcbf67eae05 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:34.447872 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-566b353c-c808-4c03-8279-2bcbf67eae05 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:34.448316 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-566b353c-c808-4c03-8279-2bcbf67eae05 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:34.448736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-566b353c-c808-4c03-8279-2bcbf67eae05 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:34.479785 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-566b353c-c808-4c03-8279-2bcbf67eae05 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046399 Aug 30 14:52:34.480779 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 599/1187] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:34 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:35.492615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2dce4ab1-5411-4263-919f-215247ef18c7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:35.495358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2dce4ab1-5411-4263-919f-215247ef18c7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:35.497870 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 14:52:35.498031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 14:52:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments (ip 10.222.0.30) !!! Aug 30 14:52:35.512393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dce4ab1-5411-4263-919f-215247ef18c7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:35.512930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dce4ab1-5411-4263-919f-215247ef18c7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:35.513402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dce4ab1-5411-4263-919f-215247ef18c7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:35.514185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dce4ab1-5411-4263-919f-215247ef18c7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:35.515057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dce4ab1-5411-4263-919f-215247ef18c7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:35.516004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2dce4ab1-5411-4263-919f-215247ef18c7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:35.547656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2dce4ab1-5411-4263-919f-215247ef18c7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059549 Aug 30 14:52:35.548218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 589/1188] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:35 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:36.560023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-62918557-2987-4eea-8ee2-0da2ef4ccf61 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:36.562122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-62918557-2987-4eea-8ee2-0da2ef4ccf61 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:36.569016 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62918557-2987-4eea-8ee2-0da2ef4ccf61 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:36.569504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62918557-2987-4eea-8ee2-0da2ef4ccf61 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:36.569967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62918557-2987-4eea-8ee2-0da2ef4ccf61 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:36.571513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62918557-2987-4eea-8ee2-0da2ef4ccf61 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:36.571972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62918557-2987-4eea-8ee2-0da2ef4ccf61 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:36.572395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62918557-2987-4eea-8ee2-0da2ef4ccf61 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:36.605082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-62918557-2987-4eea-8ee2-0da2ef4ccf61 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049165 Aug 30 14:52:36.605846 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 600/1189] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:36 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:52:37.617685 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ef02a6f7-eaa5-4b9a-acf4-42ac56981278 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:37.620661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ef02a6f7-eaa5-4b9a-acf4-42ac56981278 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:37.623037 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=56 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:37.628316 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef02a6f7-eaa5-4b9a-acf4-42ac56981278 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:37.628801 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef02a6f7-eaa5-4b9a-acf4-42ac56981278 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:37.629224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef02a6f7-eaa5-4b9a-acf4-42ac56981278 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:37.629917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef02a6f7-eaa5-4b9a-acf4-42ac56981278 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:37.630360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef02a6f7-eaa5-4b9a-acf4-42ac56981278 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:37.630775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef02a6f7-eaa5-4b9a-acf4-42ac56981278 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:37.648916 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:37.663150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ef02a6f7-eaa5-4b9a-acf4-42ac56981278 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049680 Aug 30 14:52:37.663750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 590/1190] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:37 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:38.676152 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-01f4edce-dc50-4109-a3b3-5be83882e957 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:38.678285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-01f4edce-dc50-4109-a3b3-5be83882e957 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:38.680891 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=54 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:38.688032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-01f4edce-dc50-4109-a3b3-5be83882e957 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:38.688513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-01f4edce-dc50-4109-a3b3-5be83882e957 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:38.688942 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-01f4edce-dc50-4109-a3b3-5be83882e957 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:38.689631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-01f4edce-dc50-4109-a3b3-5be83882e957 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:38.690089 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-01f4edce-dc50-4109-a3b3-5be83882e957 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:38.690488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-01f4edce-dc50-4109-a3b3-5be83882e957 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:38.720709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-01f4edce-dc50-4109-a3b3-5be83882e957 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049422 Aug 30 14:52:38.721275 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 601/1191] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:38 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:39.733357 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f4e600b7-d47b-4e50-9881-b808f0b5b238 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:39.736846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f4e600b7-d47b-4e50-9881-b808f0b5b238 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:39.744311 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4e600b7-d47b-4e50-9881-b808f0b5b238 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:39.744840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4e600b7-d47b-4e50-9881-b808f0b5b238 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:39.745285 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4e600b7-d47b-4e50-9881-b808f0b5b238 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:39.746049 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4e600b7-d47b-4e50-9881-b808f0b5b238 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:39.746505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4e600b7-d47b-4e50-9881-b808f0b5b238 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:39.746933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4e600b7-d47b-4e50-9881-b808f0b5b238 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:39.778360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f4e600b7-d47b-4e50-9881-b808f0b5b238 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048822 Aug 30 14:52:39.778936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 591/1192] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:39 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:40.792073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3ee6dfc6-2bfa-4376-a369-09a81570b70a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:40.792672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3ee6dfc6-2bfa-4376-a369-09a81570b70a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:40.799104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ee6dfc6-2bfa-4376-a369-09a81570b70a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:40.799622 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ee6dfc6-2bfa-4376-a369-09a81570b70a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:40.800062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ee6dfc6-2bfa-4376-a369-09a81570b70a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:40.801072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ee6dfc6-2bfa-4376-a369-09a81570b70a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:40.801223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ee6dfc6-2bfa-4376-a369-09a81570b70a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:40.801656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ee6dfc6-2bfa-4376-a369-09a81570b70a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:40.831171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3ee6dfc6-2bfa-4376-a369-09a81570b70a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045214 Aug 30 14:52:40.831755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 602/1193] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:40 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:41.843452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d2687636-87c0-48eb-b2ff-4be277b738b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:41.845645 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d2687636-87c0-48eb-b2ff-4be277b738b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:41.851888 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2687636-87c0-48eb-b2ff-4be277b738b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:41.852380 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2687636-87c0-48eb-b2ff-4be277b738b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:41.852870 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2687636-87c0-48eb-b2ff-4be277b738b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:41.853740 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2687636-87c0-48eb-b2ff-4be277b738b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:41.854184 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2687636-87c0-48eb-b2ff-4be277b738b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:41.854602 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2687636-87c0-48eb-b2ff-4be277b738b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:41.883484 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d2687636-87c0-48eb-b2ff-4be277b738b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043935 Aug 30 14:52:41.884626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 592/1194] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:41 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:42.895523 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8d4500f4-d7e4-4f5d-904a-cf0cd2dcc32d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:42.897684 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8d4500f4-d7e4-4f5d-904a-cf0cd2dcc32d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:42.904600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d4500f4-d7e4-4f5d-904a-cf0cd2dcc32d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:42.905086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d4500f4-d7e4-4f5d-904a-cf0cd2dcc32d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:42.905520 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d4500f4-d7e4-4f5d-904a-cf0cd2dcc32d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:42.906207 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d4500f4-d7e4-4f5d-904a-cf0cd2dcc32d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:42.906658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d4500f4-d7e4-4f5d-904a-cf0cd2dcc32d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:42.907080 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d4500f4-d7e4-4f5d-904a-cf0cd2dcc32d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:42.935590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8d4500f4-d7e4-4f5d-904a-cf0cd2dcc32d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043958 Aug 30 14:52:42.936144 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 603/1195] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:42 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:43.947976 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9c27ec42-1b0b-47b0-bed4-c679838f306e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:43.950171 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9c27ec42-1b0b-47b0-bed4-c679838f306e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:43.956643 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c27ec42-1b0b-47b0-bed4-c679838f306e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:43.957109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c27ec42-1b0b-47b0-bed4-c679838f306e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:43.957532 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c27ec42-1b0b-47b0-bed4-c679838f306e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:43.958211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c27ec42-1b0b-47b0-bed4-c679838f306e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:43.958652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c27ec42-1b0b-47b0-bed4-c679838f306e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:43.959065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c27ec42-1b0b-47b0-bed4-c679838f306e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:43.988405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9c27ec42-1b0b-47b0-bed4-c679838f306e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044440 Aug 30 14:52:43.988939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 593/1196] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:43 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:45.001082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d8b1c2fb-95ae-4565-a79d-855c451bacc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:45.003180 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d8b1c2fb-95ae-4565-a79d-855c451bacc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:45.009179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8b1c2fb-95ae-4565-a79d-855c451bacc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:45.009636 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8b1c2fb-95ae-4565-a79d-855c451bacc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:45.010062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8b1c2fb-95ae-4565-a79d-855c451bacc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:45.010744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8b1c2fb-95ae-4565-a79d-855c451bacc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:45.011189 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8b1c2fb-95ae-4565-a79d-855c451bacc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:45.011638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8b1c2fb-95ae-4565-a79d-855c451bacc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:45.039825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d8b1c2fb-95ae-4565-a79d-855c451bacc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042682 Aug 30 14:52:45.040957 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 604/1197] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:44 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:46.051739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-af7779b3-baf0-4921-ada3-4223c593aede tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:46.053858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-af7779b3-baf0-4921-ada3-4223c593aede tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:46.060125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af7779b3-baf0-4921-ada3-4223c593aede tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:46.060619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af7779b3-baf0-4921-ada3-4223c593aede tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:46.061051 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af7779b3-baf0-4921-ada3-4223c593aede tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:46.061759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af7779b3-baf0-4921-ada3-4223c593aede tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:46.062210 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af7779b3-baf0-4921-ada3-4223c593aede tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:46.062706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af7779b3-baf0-4921-ada3-4223c593aede tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:46.092508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-af7779b3-baf0-4921-ada3-4223c593aede tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044634 Aug 30 14:52:46.093063 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 594/1198] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:46 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:47.104838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5258e766-00c6-4e32-804f-a60433cd1106 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:47.107009 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5258e766-00c6-4e32-804f-a60433cd1106 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:47.113475 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5258e766-00c6-4e32-804f-a60433cd1106 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:47.113963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5258e766-00c6-4e32-804f-a60433cd1106 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:47.114400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5258e766-00c6-4e32-804f-a60433cd1106 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:47.115096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5258e766-00c6-4e32-804f-a60433cd1106 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:47.115581 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5258e766-00c6-4e32-804f-a60433cd1106 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:47.116007 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5258e766-00c6-4e32-804f-a60433cd1106 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:47.146471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5258e766-00c6-4e32-804f-a60433cd1106 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Aug 30 14:52:47.147018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 605/1199] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:47 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:48.158045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-99a7a88d-7eca-413e-996f-a8106deaed9d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:48.160229 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-99a7a88d-7eca-413e-996f-a8106deaed9d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:48.167098 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99a7a88d-7eca-413e-996f-a8106deaed9d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:48.167625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99a7a88d-7eca-413e-996f-a8106deaed9d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:48.168058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99a7a88d-7eca-413e-996f-a8106deaed9d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:48.168747 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99a7a88d-7eca-413e-996f-a8106deaed9d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:48.169190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99a7a88d-7eca-413e-996f-a8106deaed9d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:48.169604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99a7a88d-7eca-413e-996f-a8106deaed9d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:48.199174 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-99a7a88d-7eca-413e-996f-a8106deaed9d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045142 Aug 30 14:52:48.199749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 595/1200] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:48 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:49.212036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7ee44b56-24d1-458f-a237-2291be64ffdd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:49.213656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7ee44b56-24d1-458f-a237-2291be64ffdd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:49.219994 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ee44b56-24d1-458f-a237-2291be64ffdd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:49.220478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ee44b56-24d1-458f-a237-2291be64ffdd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:49.220916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ee44b56-24d1-458f-a237-2291be64ffdd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:49.221612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ee44b56-24d1-458f-a237-2291be64ffdd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:49.222063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ee44b56-24d1-458f-a237-2291be64ffdd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:49.222478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ee44b56-24d1-458f-a237-2291be64ffdd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:49.253518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7ee44b56-24d1-458f-a237-2291be64ffdd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046186 Aug 30 14:52:49.254007 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 606/1201] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:49 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:50.266198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2ea62e79-e92e-4005-af94-0e59cecfe3a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:50.268405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2ea62e79-e92e-4005-af94-0e59cecfe3a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:50.274856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ea62e79-e92e-4005-af94-0e59cecfe3a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:50.275367 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ea62e79-e92e-4005-af94-0e59cecfe3a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:50.275828 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ea62e79-e92e-4005-af94-0e59cecfe3a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:50.276596 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ea62e79-e92e-4005-af94-0e59cecfe3a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:50.276954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ea62e79-e92e-4005-af94-0e59cecfe3a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:50.277376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ea62e79-e92e-4005-af94-0e59cecfe3a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:50.306688 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2ea62e79-e92e-4005-af94-0e59cecfe3a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044463 Aug 30 14:52:50.308069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 596/1202] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:50 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:51.320717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b1f23dd5-e669-4d94-adaa-200eff4bf767 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:51.323523 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b1f23dd5-e669-4d94-adaa-200eff4bf767 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:51.329946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b1f23dd5-e669-4d94-adaa-200eff4bf767 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:51.330628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b1f23dd5-e669-4d94-adaa-200eff4bf767 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:51.331114 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b1f23dd5-e669-4d94-adaa-200eff4bf767 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:51.331838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b1f23dd5-e669-4d94-adaa-200eff4bf767 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:51.332287 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b1f23dd5-e669-4d94-adaa-200eff4bf767 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:51.332914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b1f23dd5-e669-4d94-adaa-200eff4bf767 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:51.362484 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b1f23dd5-e669-4d94-adaa-200eff4bf767 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047520 Aug 30 14:52:51.363053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 607/1203] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:51 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:52.374469 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3cdd96fa-704c-4962-a07b-ab9b1eb381e4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:52.377213 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3cdd96fa-704c-4962-a07b-ab9b1eb381e4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:52.383164 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cdd96fa-704c-4962-a07b-ab9b1eb381e4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:52.383663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cdd96fa-704c-4962-a07b-ab9b1eb381e4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:52.384097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cdd96fa-704c-4962-a07b-ab9b1eb381e4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:52.384785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cdd96fa-704c-4962-a07b-ab9b1eb381e4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:52.385335 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cdd96fa-704c-4962-a07b-ab9b1eb381e4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:52.385763 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3cdd96fa-704c-4962-a07b-ab9b1eb381e4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:52.417410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3cdd96fa-704c-4962-a07b-ab9b1eb381e4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046717 Aug 30 14:52:52.417987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 597/1204] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:52 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:53.429984 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cf3a52e5-17aa-4839-9301-a19204aa8ee2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:53.432325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cf3a52e5-17aa-4839-9301-a19204aa8ee2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:53.439319 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cf3a52e5-17aa-4839-9301-a19204aa8ee2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:53.439807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cf3a52e5-17aa-4839-9301-a19204aa8ee2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:53.440242 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cf3a52e5-17aa-4839-9301-a19204aa8ee2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:53.440945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cf3a52e5-17aa-4839-9301-a19204aa8ee2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:53.441656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cf3a52e5-17aa-4839-9301-a19204aa8ee2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:53.442081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cf3a52e5-17aa-4839-9301-a19204aa8ee2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:53.472462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cf3a52e5-17aa-4839-9301-a19204aa8ee2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046776 Aug 30 14:52:53.473027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 608/1205] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:53 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:54.485563 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1bf6bc4c-f0ae-446f-9440-e8e7671b8e23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:54.487738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1bf6bc4c-f0ae-446f-9440-e8e7671b8e23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:54.494193 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bf6bc4c-f0ae-446f-9440-e8e7671b8e23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:54.494665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bf6bc4c-f0ae-446f-9440-e8e7671b8e23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:54.495088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bf6bc4c-f0ae-446f-9440-e8e7671b8e23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:54.496230 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bf6bc4c-f0ae-446f-9440-e8e7671b8e23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:54.496677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bf6bc4c-f0ae-446f-9440-e8e7671b8e23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:54.497094 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bf6bc4c-f0ae-446f-9440-e8e7671b8e23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:54.529102 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1bf6bc4c-f0ae-446f-9440-e8e7671b8e23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048114 Aug 30 14:52:54.529676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 598/1206] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:54 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:55.541524 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3d2ee748-0806-454b-8bb1-381d8eb3b570 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:55.544356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3d2ee748-0806-454b-8bb1-381d8eb3b570 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:55.550635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d2ee748-0806-454b-8bb1-381d8eb3b570 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:55.551363 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d2ee748-0806-454b-8bb1-381d8eb3b570 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:55.551802 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d2ee748-0806-454b-8bb1-381d8eb3b570 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:55.552499 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d2ee748-0806-454b-8bb1-381d8eb3b570 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:55.552946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d2ee748-0806-454b-8bb1-381d8eb3b570 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:55.553368 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d2ee748-0806-454b-8bb1-381d8eb3b570 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:55.580119 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:52:55.585773 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3d2ee748-0806-454b-8bb1-381d8eb3b570 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048399 Aug 30 14:52:55.586342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 609/1207] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:55 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:56.599329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-88559b22-2124-4ba7-ac86-55b78701a9ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:56.601681 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-88559b22-2124-4ba7-ac86-55b78701a9ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:56.609913 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88559b22-2124-4ba7-ac86-55b78701a9ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:56.610396 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88559b22-2124-4ba7-ac86-55b78701a9ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:56.610860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88559b22-2124-4ba7-ac86-55b78701a9ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:56.611591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88559b22-2124-4ba7-ac86-55b78701a9ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:56.612042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88559b22-2124-4ba7-ac86-55b78701a9ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:56.612496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88559b22-2124-4ba7-ac86-55b78701a9ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:56.643234 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-88559b22-2124-4ba7-ac86-55b78701a9ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047761 Aug 30 14:52:56.643984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 599/1208] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:56 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:57.655857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-390b6ef2-994a-4562-90c4-54f8dd4e6e40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:57.657981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-390b6ef2-994a-4562-90c4-54f8dd4e6e40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:57.665676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-390b6ef2-994a-4562-90c4-54f8dd4e6e40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:57.666226 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-390b6ef2-994a-4562-90c4-54f8dd4e6e40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:57.666655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-390b6ef2-994a-4562-90c4-54f8dd4e6e40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:57.668240 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-390b6ef2-994a-4562-90c4-54f8dd4e6e40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:57.668901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-390b6ef2-994a-4562-90c4-54f8dd4e6e40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:57.669320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-390b6ef2-994a-4562-90c4-54f8dd4e6e40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:57.699792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-390b6ef2-994a-4562-90c4-54f8dd4e6e40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048521 Aug 30 14:52:57.700678 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 610/1209] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:57 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:58.712418 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-85ac9c7d-7067-4a25-b497-a06b0bbba33f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:58.715334 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-85ac9c7d-7067-4a25-b497-a06b0bbba33f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:58.721840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85ac9c7d-7067-4a25-b497-a06b0bbba33f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:58.722401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85ac9c7d-7067-4a25-b497-a06b0bbba33f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:58.722828 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85ac9c7d-7067-4a25-b497-a06b0bbba33f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:58.723547 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85ac9c7d-7067-4a25-b497-a06b0bbba33f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:58.723990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85ac9c7d-7067-4a25-b497-a06b0bbba33f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:58.724406 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85ac9c7d-7067-4a25-b497-a06b0bbba33f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:58.756428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-85ac9c7d-7067-4a25-b497-a06b0bbba33f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048622 Aug 30 14:52:58.756977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 600/1210] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:58 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:52:59.770353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3fc840da-b59b-4ea4-bdc5-06aed7f6bf77 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:52:59.771621 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3fc840da-b59b-4ea4-bdc5-06aed7f6bf77 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:52:59.779243 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3fc840da-b59b-4ea4-bdc5-06aed7f6bf77 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:59.779809 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3fc840da-b59b-4ea4-bdc5-06aed7f6bf77 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:59.780318 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3fc840da-b59b-4ea4-bdc5-06aed7f6bf77 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:59.781106 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3fc840da-b59b-4ea4-bdc5-06aed7f6bf77 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:52:59.781630 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3fc840da-b59b-4ea4-bdc5-06aed7f6bf77 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:52:59.782057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3fc840da-b59b-4ea4-bdc5-06aed7f6bf77 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:52:59.819648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3fc840da-b59b-4ea4-bdc5-06aed7f6bf77 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047566 Aug 30 14:52:59.819648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 611/1211] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:52:59 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:00.824312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c6fcaddf-8409-4e18-8e96-861268c8de81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:00.826495 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c6fcaddf-8409-4e18-8e96-861268c8de81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:00.833100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6fcaddf-8409-4e18-8e96-861268c8de81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:00.833591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6fcaddf-8409-4e18-8e96-861268c8de81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:00.834030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6fcaddf-8409-4e18-8e96-861268c8de81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:00.834726 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6fcaddf-8409-4e18-8e96-861268c8de81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:00.835174 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6fcaddf-8409-4e18-8e96-861268c8de81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:00.835627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6fcaddf-8409-4e18-8e96-861268c8de81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:00.867618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c6fcaddf-8409-4e18-8e96-861268c8de81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047260 Aug 30 14:53:00.868480 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 601/1212] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:00 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:01.879734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-66762e9f-f2dd-44de-8ebe-3bf1fe93e7dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:01.882132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-66762e9f-f2dd-44de-8ebe-3bf1fe93e7dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:01.889379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-66762e9f-f2dd-44de-8ebe-3bf1fe93e7dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:01.889933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-66762e9f-f2dd-44de-8ebe-3bf1fe93e7dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:01.890433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-66762e9f-f2dd-44de-8ebe-3bf1fe93e7dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:01.891190 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-66762e9f-f2dd-44de-8ebe-3bf1fe93e7dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:01.891757 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-66762e9f-f2dd-44de-8ebe-3bf1fe93e7dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:01.892184 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-66762e9f-f2dd-44de-8ebe-3bf1fe93e7dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:01.921998 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-66762e9f-f2dd-44de-8ebe-3bf1fe93e7dd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046044 Aug 30 14:53:01.922612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 612/1213] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:01 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:02.934219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bc3a65b2-1f5f-42f3-8769-e0743e3831c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:02.937006 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bc3a65b2-1f5f-42f3-8769-e0743e3831c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:02.943741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc3a65b2-1f5f-42f3-8769-e0743e3831c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:02.944254 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc3a65b2-1f5f-42f3-8769-e0743e3831c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:02.944686 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc3a65b2-1f5f-42f3-8769-e0743e3831c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:02.945335 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc3a65b2-1f5f-42f3-8769-e0743e3831c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:02.945788 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc3a65b2-1f5f-42f3-8769-e0743e3831c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:02.946200 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc3a65b2-1f5f-42f3-8769-e0743e3831c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:02.977038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bc3a65b2-1f5f-42f3-8769-e0743e3831c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047032 Aug 30 14:53:02.977601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 602/1214] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:02 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:03.989927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-dc1726ea-fb90-44bb-85d7-f185d9b09c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:03.992246 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-dc1726ea-fb90-44bb-85d7-f185d9b09c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:03.999458 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc1726ea-fb90-44bb-85d7-f185d9b09c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:03.999950 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc1726ea-fb90-44bb-85d7-f185d9b09c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:04.000383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc1726ea-fb90-44bb-85d7-f185d9b09c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:04.001082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc1726ea-fb90-44bb-85d7-f185d9b09c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:04.001539 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc1726ea-fb90-44bb-85d7-f185d9b09c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:04.001963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc1726ea-fb90-44bb-85d7-f185d9b09c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:04.034289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-dc1726ea-fb90-44bb-85d7-f185d9b09c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048294 Aug 30 14:53:04.034869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 613/1215] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:03 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:05.046582 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4e605275-6e9f-462d-8a3e-ce3a34e1ae80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:05.048735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4e605275-6e9f-462d-8a3e-ce3a34e1ae80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:05.055450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e605275-6e9f-462d-8a3e-ce3a34e1ae80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:05.055937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e605275-6e9f-462d-8a3e-ce3a34e1ae80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:05.056369 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e605275-6e9f-462d-8a3e-ce3a34e1ae80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:05.057060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e605275-6e9f-462d-8a3e-ce3a34e1ae80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:05.058901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e605275-6e9f-462d-8a3e-ce3a34e1ae80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:05.059359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e605275-6e9f-462d-8a3e-ce3a34e1ae80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:05.089502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4e605275-6e9f-462d-8a3e-ce3a34e1ae80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046729 Aug 30 14:53:05.090342 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 603/1216] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:05 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:06.101905 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-32af8e4b-afc5-4328-b6f3-3cfbc0a11c0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:06.104079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-32af8e4b-afc5-4328-b6f3-3cfbc0a11c0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:06.111070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32af8e4b-afc5-4328-b6f3-3cfbc0a11c0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:06.111596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32af8e4b-afc5-4328-b6f3-3cfbc0a11c0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:06.112028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32af8e4b-afc5-4328-b6f3-3cfbc0a11c0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:06.112724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32af8e4b-afc5-4328-b6f3-3cfbc0a11c0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:06.113177 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32af8e4b-afc5-4328-b6f3-3cfbc0a11c0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:06.113599 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32af8e4b-afc5-4328-b6f3-3cfbc0a11c0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:06.143823 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-32af8e4b-afc5-4328-b6f3-3cfbc0a11c0d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045759 Aug 30 14:53:06.144312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 614/1217] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:06 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:07.155989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dcffc0a2-262e-4635-9eb7-4e3409c48516 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:07.161010 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dcffc0a2-262e-4635-9eb7-4e3409c48516 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:07.168666 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcffc0a2-262e-4635-9eb7-4e3409c48516 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:07.169431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcffc0a2-262e-4635-9eb7-4e3409c48516 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:07.169872 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcffc0a2-262e-4635-9eb7-4e3409c48516 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:07.170572 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcffc0a2-262e-4635-9eb7-4e3409c48516 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:07.171024 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcffc0a2-262e-4635-9eb7-4e3409c48516 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:07.171487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcffc0a2-262e-4635-9eb7-4e3409c48516 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:07.202552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dcffc0a2-262e-4635-9eb7-4e3409c48516 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050483 Aug 30 14:53:07.203432 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 604/1218] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:07 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:08.214739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d789fe3d-8950-4e14-8615-0da886f465fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:08.216890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d789fe3d-8950-4e14-8615-0da886f465fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:08.223222 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d789fe3d-8950-4e14-8615-0da886f465fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:08.223616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d789fe3d-8950-4e14-8615-0da886f465fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:08.224366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d789fe3d-8950-4e14-8615-0da886f465fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:08.225088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d789fe3d-8950-4e14-8615-0da886f465fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:08.225545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d789fe3d-8950-4e14-8615-0da886f465fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:08.225972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d789fe3d-8950-4e14-8615-0da886f465fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:08.255934 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d789fe3d-8950-4e14-8615-0da886f465fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045907 Aug 30 14:53:08.256506 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 615/1219] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:08 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:09.267985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0ed8a844-c624-4a6e-96e8-db70d187d4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:09.270238 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0ed8a844-c624-4a6e-96e8-db70d187d4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:09.272576 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=30 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:09.278439 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ed8a844-c624-4a6e-96e8-db70d187d4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:09.279054 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ed8a844-c624-4a6e-96e8-db70d187d4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:09.279519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ed8a844-c624-4a6e-96e8-db70d187d4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:09.280211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ed8a844-c624-4a6e-96e8-db70d187d4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:09.280663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ed8a844-c624-4a6e-96e8-db70d187d4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:09.281086 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0ed8a844-c624-4a6e-96e8-db70d187d4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:09.283745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=87 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:09.311645 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0ed8a844-c624-4a6e-96e8-db70d187d4d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047424 Aug 30 14:53:09.315991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 605/1220] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:09 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:10.323922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1470e9a7-8b59-4d76-a40a-2402c7f07efa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:10.326028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1470e9a7-8b59-4d76-a40a-2402c7f07efa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:10.328325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=30 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:10.333693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1470e9a7-8b59-4d76-a40a-2402c7f07efa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:10.334419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1470e9a7-8b59-4d76-a40a-2402c7f07efa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:10.334848 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1470e9a7-8b59-4d76-a40a-2402c7f07efa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:10.335584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1470e9a7-8b59-4d76-a40a-2402c7f07efa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:10.336197 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1470e9a7-8b59-4d76-a40a-2402c7f07efa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:10.336700 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1470e9a7-8b59-4d76-a40a-2402c7f07efa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:10.369021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1470e9a7-8b59-4d76-a40a-2402c7f07efa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049187 Aug 30 14:53:10.369774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 616/1221] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:10 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:11.381505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3a61c924-3749-42d1-b8dd-814d68a6094d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:11.383718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3a61c924-3749-42d1-b8dd-814d68a6094d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:11.390203 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a61c924-3749-42d1-b8dd-814d68a6094d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:11.390687 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a61c924-3749-42d1-b8dd-814d68a6094d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:11.391120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a61c924-3749-42d1-b8dd-814d68a6094d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:11.391839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a61c924-3749-42d1-b8dd-814d68a6094d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:11.392296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a61c924-3749-42d1-b8dd-814d68a6094d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:11.392721 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a61c924-3749-42d1-b8dd-814d68a6094d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:11.423481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3a61c924-3749-42d1-b8dd-814d68a6094d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045835 Aug 30 14:53:11.424053 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 606/1222] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:11 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:12.436143 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ce35bf3d-5b6f-4bf3-ad0b-04e887213eb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:12.438318 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ce35bf3d-5b6f-4bf3-ad0b-04e887213eb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:12.445320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce35bf3d-5b6f-4bf3-ad0b-04e887213eb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:12.445808 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce35bf3d-5b6f-4bf3-ad0b-04e887213eb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:12.446279 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce35bf3d-5b6f-4bf3-ad0b-04e887213eb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:12.446971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce35bf3d-5b6f-4bf3-ad0b-04e887213eb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:12.447450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce35bf3d-5b6f-4bf3-ad0b-04e887213eb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:12.447874 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce35bf3d-5b6f-4bf3-ad0b-04e887213eb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:12.479414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ce35bf3d-5b6f-4bf3-ad0b-04e887213eb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047728 Aug 30 14:53:12.480200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 617/1223] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:12 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:13.491589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-888f5cb1-9308-4d53-9636-f41012c343db tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:13.493776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-888f5cb1-9308-4d53-9636-f41012c343db tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:13.500125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-888f5cb1-9308-4d53-9636-f41012c343db tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:13.500602 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-888f5cb1-9308-4d53-9636-f41012c343db tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:13.501032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-888f5cb1-9308-4d53-9636-f41012c343db tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:13.501719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-888f5cb1-9308-4d53-9636-f41012c343db tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:13.502172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-888f5cb1-9308-4d53-9636-f41012c343db tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:13.502565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-888f5cb1-9308-4d53-9636-f41012c343db tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:13.532118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-888f5cb1-9308-4d53-9636-f41012c343db tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044444 Aug 30 14:53:13.532859 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 607/1224] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:13 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:14.544083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6e3208ba-d15c-4f2c-8ffe-f94e8fea750f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:14.546247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6e3208ba-d15c-4f2c-8ffe-f94e8fea750f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:14.552289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e3208ba-d15c-4f2c-8ffe-f94e8fea750f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:14.552769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e3208ba-d15c-4f2c-8ffe-f94e8fea750f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:14.553203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e3208ba-d15c-4f2c-8ffe-f94e8fea750f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:14.553896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e3208ba-d15c-4f2c-8ffe-f94e8fea750f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:14.554342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e3208ba-d15c-4f2c-8ffe-f94e8fea750f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:14.554759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e3208ba-d15c-4f2c-8ffe-f94e8fea750f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:14.585925 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6e3208ba-d15c-4f2c-8ffe-f94e8fea750f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045866 Aug 30 14:53:14.586754 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 618/1225] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:14 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:15.598380 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d9aefc0a-c7c1-4e3b-b5d3-d963357d1af6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:15.600544 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d9aefc0a-c7c1-4e3b-b5d3-d963357d1af6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:15.607685 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9aefc0a-c7c1-4e3b-b5d3-d963357d1af6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:15.608159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9aefc0a-c7c1-4e3b-b5d3-d963357d1af6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:15.608587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9aefc0a-c7c1-4e3b-b5d3-d963357d1af6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:15.609267 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9aefc0a-c7c1-4e3b-b5d3-d963357d1af6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:15.609710 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9aefc0a-c7c1-4e3b-b5d3-d963357d1af6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:15.610128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9aefc0a-c7c1-4e3b-b5d3-d963357d1af6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:15.639391 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d9aefc0a-c7c1-4e3b-b5d3-d963357d1af6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Aug 30 14:53:15.650289 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 608/1226] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:15 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:16.653061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-77944e9b-591d-4b5d-bed1-f891f9a435f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:16.655284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-77944e9b-591d-4b5d-bed1-f891f9a435f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:16.663378 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77944e9b-591d-4b5d-bed1-f891f9a435f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:16.663867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77944e9b-591d-4b5d-bed1-f891f9a435f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:16.665646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77944e9b-591d-4b5d-bed1-f891f9a435f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:16.666030 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77944e9b-591d-4b5d-bed1-f891f9a435f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:16.667396 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77944e9b-591d-4b5d-bed1-f891f9a435f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:16.667831 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77944e9b-591d-4b5d-bed1-f891f9a435f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:16.896018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-77944e9b-591d-4b5d-bed1-f891f9a435f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.247907 Aug 30 14:53:16.896586 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 619/1227] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:16 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:53:17.909529 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-72826d1b-d693-433c-b1f9-31f8a5c33ea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:17.911641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-72826d1b-d693-433c-b1f9-31f8a5c33ea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:17.918882 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72826d1b-d693-433c-b1f9-31f8a5c33ea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:17.919395 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72826d1b-d693-433c-b1f9-31f8a5c33ea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:17.919835 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72826d1b-d693-433c-b1f9-31f8a5c33ea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:17.920531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72826d1b-d693-433c-b1f9-31f8a5c33ea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:17.920979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72826d1b-d693-433c-b1f9-31f8a5c33ea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:17.921406 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72826d1b-d693-433c-b1f9-31f8a5c33ea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:17.951388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-72826d1b-d693-433c-b1f9-31f8a5c33ea2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045829 Aug 30 14:53:17.951962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 609/1228] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:17 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:18.964369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-10dfea01-0726-445f-8125-169ed261816b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:18.966388 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-10dfea01-0726-445f-8125-169ed261816b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:18.972894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-10dfea01-0726-445f-8125-169ed261816b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:18.973367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-10dfea01-0726-445f-8125-169ed261816b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:18.973827 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-10dfea01-0726-445f-8125-169ed261816b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:18.974505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-10dfea01-0726-445f-8125-169ed261816b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:18.974946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-10dfea01-0726-445f-8125-169ed261816b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:18.975390 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-10dfea01-0726-445f-8125-169ed261816b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:19.005520 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-10dfea01-0726-445f-8125-169ed261816b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045541 Aug 30 14:53:19.006044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 620/1229] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:18 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:20.017511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7757fd76-9bb2-4659-974f-9780ab94943c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:20.019603 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7757fd76-9bb2-4659-974f-9780ab94943c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:20.025627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7757fd76-9bb2-4659-974f-9780ab94943c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:20.026201 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7757fd76-9bb2-4659-974f-9780ab94943c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:20.026736 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7757fd76-9bb2-4659-974f-9780ab94943c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:20.027467 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7757fd76-9bb2-4659-974f-9780ab94943c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:20.027920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7757fd76-9bb2-4659-974f-9780ab94943c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:20.028343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7757fd76-9bb2-4659-974f-9780ab94943c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:20.058036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7757fd76-9bb2-4659-974f-9780ab94943c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043864 Aug 30 14:53:20.058736 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 610/1230] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:20 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:21.070536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7ddbc9c8-4261-4a79-99fb-e98f33ae1ba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:21.072596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7ddbc9c8-4261-4a79-99fb-e98f33ae1ba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:21.079837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ddbc9c8-4261-4a79-99fb-e98f33ae1ba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:21.080317 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ddbc9c8-4261-4a79-99fb-e98f33ae1ba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:21.080767 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ddbc9c8-4261-4a79-99fb-e98f33ae1ba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:21.081448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ddbc9c8-4261-4a79-99fb-e98f33ae1ba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:21.081892 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ddbc9c8-4261-4a79-99fb-e98f33ae1ba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:21.082307 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ddbc9c8-4261-4a79-99fb-e98f33ae1ba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:21.111127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7ddbc9c8-4261-4a79-99fb-e98f33ae1ba4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044707 Aug 30 14:53:21.111721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 621/1231] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:21 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:22.123648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-21640a4c-db6a-4995-a11c-73d47df6c90c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:22.125786 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-21640a4c-db6a-4995-a11c-73d47df6c90c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:22.132742 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21640a4c-db6a-4995-a11c-73d47df6c90c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:22.133210 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21640a4c-db6a-4995-a11c-73d47df6c90c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:22.133636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21640a4c-db6a-4995-a11c-73d47df6c90c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:22.134308 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21640a4c-db6a-4995-a11c-73d47df6c90c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:22.134751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21640a4c-db6a-4995-a11c-73d47df6c90c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:22.135825 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21640a4c-db6a-4995-a11c-73d47df6c90c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:22.164760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-21640a4c-db6a-4995-a11c-73d47df6c90c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 Aug 30 14:53:22.165297 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 611/1232] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:22 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:23.176344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-393ae561-8b49-4265-9884-af4cfcc0a151 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:23.178461 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-393ae561-8b49-4265-9884-af4cfcc0a151 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:23.184888 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-393ae561-8b49-4265-9884-af4cfcc0a151 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:23.185369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-393ae561-8b49-4265-9884-af4cfcc0a151 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:23.185801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-393ae561-8b49-4265-9884-af4cfcc0a151 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:23.186489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-393ae561-8b49-4265-9884-af4cfcc0a151 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:23.186941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-393ae561-8b49-4265-9884-af4cfcc0a151 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:23.187399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-393ae561-8b49-4265-9884-af4cfcc0a151 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:23.217600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-393ae561-8b49-4265-9884-af4cfcc0a151 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045089 Aug 30 14:53:23.218193 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 622/1233] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:23 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:24.230571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-02fdbd3b-ccae-4ae0-970b-b757b324617c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:24.232732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-02fdbd3b-ccae-4ae0-970b-b757b324617c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:24.239016 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02fdbd3b-ccae-4ae0-970b-b757b324617c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:24.239522 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02fdbd3b-ccae-4ae0-970b-b757b324617c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:24.239950 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02fdbd3b-ccae-4ae0-970b-b757b324617c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:24.240634 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02fdbd3b-ccae-4ae0-970b-b757b324617c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:24.241083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02fdbd3b-ccae-4ae0-970b-b757b324617c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:24.241512 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02fdbd3b-ccae-4ae0-970b-b757b324617c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:24.270385 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-02fdbd3b-ccae-4ae0-970b-b757b324617c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044402 Aug 30 14:53:24.270931 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 612/1234] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:24 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:53:25.283331 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-121df1ba-62c7-4f00-81d0-a7cba68b7659 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:25.285545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-121df1ba-62c7-4f00-81d0-a7cba68b7659 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:25.291878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-121df1ba-62c7-4f00-81d0-a7cba68b7659 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:25.292497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-121df1ba-62c7-4f00-81d0-a7cba68b7659 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:25.292943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-121df1ba-62c7-4f00-81d0-a7cba68b7659 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:25.293634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-121df1ba-62c7-4f00-81d0-a7cba68b7659 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:25.294088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-121df1ba-62c7-4f00-81d0-a7cba68b7659 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:25.294508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-121df1ba-62c7-4f00-81d0-a7cba68b7659 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:25.326173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-121df1ba-62c7-4f00-81d0-a7cba68b7659 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046829 Aug 30 14:53:25.326726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 623/1235] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:25 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:26.337873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3998137f-e9df-4c26-a663-bb09ece037b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:26.340748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3998137f-e9df-4c26-a663-bb09ece037b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:26.347030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3998137f-e9df-4c26-a663-bb09ece037b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:26.347479 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3998137f-e9df-4c26-a663-bb09ece037b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:26.347909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3998137f-e9df-4c26-a663-bb09ece037b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:26.348585 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3998137f-e9df-4c26-a663-bb09ece037b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:26.349029 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3998137f-e9df-4c26-a663-bb09ece037b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:26.349448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3998137f-e9df-4c26-a663-bb09ece037b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:26.378431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3998137f-e9df-4c26-a663-bb09ece037b4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044454 Aug 30 14:53:26.378974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 613/1236] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:26 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:27.391381 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0aaed098-efc7-4bc9-a0a9-e0d6ada6e38d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:27.393495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0aaed098-efc7-4bc9-a0a9-e0d6ada6e38d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:27.399926 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0aaed098-efc7-4bc9-a0a9-e0d6ada6e38d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:27.400397 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0aaed098-efc7-4bc9-a0a9-e0d6ada6e38d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:27.400822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0aaed098-efc7-4bc9-a0a9-e0d6ada6e38d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:27.401497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0aaed098-efc7-4bc9-a0a9-e0d6ada6e38d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:27.402403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0aaed098-efc7-4bc9-a0a9-e0d6ada6e38d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:27.402807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0aaed098-efc7-4bc9-a0a9-e0d6ada6e38d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:27.405151 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=85 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:27.433787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0aaed098-efc7-4bc9-a0a9-e0d6ada6e38d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046820 Aug 30 14:53:27.434341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 624/1237] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:27 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:28.446042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-881f941e-dbe1-4815-b53f-8327fe10c071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:28.448265 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-881f941e-dbe1-4815-b53f-8327fe10c071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:28.455195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-881f941e-dbe1-4815-b53f-8327fe10c071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:28.455665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-881f941e-dbe1-4815-b53f-8327fe10c071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:28.456078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-881f941e-dbe1-4815-b53f-8327fe10c071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:28.456762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-881f941e-dbe1-4815-b53f-8327fe10c071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:28.457207 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-881f941e-dbe1-4815-b53f-8327fe10c071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:28.457628 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-881f941e-dbe1-4815-b53f-8327fe10c071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:28.486106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-881f941e-dbe1-4815-b53f-8327fe10c071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044231 Aug 30 14:53:28.486655 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 614/1238] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:28 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:29.498215 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6c4db41d-316f-4417-bed2-a6d4bdcd814c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:29.500405 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6c4db41d-316f-4417-bed2-a6d4bdcd814c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:29.506743 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c4db41d-316f-4417-bed2-a6d4bdcd814c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:29.507236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c4db41d-316f-4417-bed2-a6d4bdcd814c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:29.507680 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c4db41d-316f-4417-bed2-a6d4bdcd814c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:29.508392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c4db41d-316f-4417-bed2-a6d4bdcd814c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:29.508841 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c4db41d-316f-4417-bed2-a6d4bdcd814c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:29.509254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c4db41d-316f-4417-bed2-a6d4bdcd814c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:29.541418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6c4db41d-316f-4417-bed2-a6d4bdcd814c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047129 Aug 30 14:53:29.541896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 625/1239] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:29 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:30.553545 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-041351fe-6fb2-455c-98fe-fb8028de5754 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:30.556023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-041351fe-6fb2-455c-98fe-fb8028de5754 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:30.562620 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-041351fe-6fb2-455c-98fe-fb8028de5754 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:30.563098 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-041351fe-6fb2-455c-98fe-fb8028de5754 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:30.563575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-041351fe-6fb2-455c-98fe-fb8028de5754 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:30.564266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-041351fe-6fb2-455c-98fe-fb8028de5754 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:30.564714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-041351fe-6fb2-455c-98fe-fb8028de5754 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:30.565133 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-041351fe-6fb2-455c-98fe-fb8028de5754 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:30.597421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-041351fe-6fb2-455c-98fe-fb8028de5754 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047784 Aug 30 14:53:30.597989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 615/1240] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:30 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:31.610548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cab46404-9f0e-4bfb-9199-89836f99f28f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:31.612886 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cab46404-9f0e-4bfb-9199-89836f99f28f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:31.619124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cab46404-9f0e-4bfb-9199-89836f99f28f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:31.619635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cab46404-9f0e-4bfb-9199-89836f99f28f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:31.620066 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cab46404-9f0e-4bfb-9199-89836f99f28f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:31.620752 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cab46404-9f0e-4bfb-9199-89836f99f28f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:31.621323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cab46404-9f0e-4bfb-9199-89836f99f28f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:31.621748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cab46404-9f0e-4bfb-9199-89836f99f28f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:31.649873 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cab46404-9f0e-4bfb-9199-89836f99f28f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043205 Aug 30 14:53:31.650346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 626/1241] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:31 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:32.661837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7333603d-aa7a-4ba3-a966-c8fcf7bb3f0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:32.664044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7333603d-aa7a-4ba3-a966-c8fcf7bb3f0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:32.671362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7333603d-aa7a-4ba3-a966-c8fcf7bb3f0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:32.671837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7333603d-aa7a-4ba3-a966-c8fcf7bb3f0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:32.672273 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7333603d-aa7a-4ba3-a966-c8fcf7bb3f0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:32.672954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7333603d-aa7a-4ba3-a966-c8fcf7bb3f0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:32.673395 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7333603d-aa7a-4ba3-a966-c8fcf7bb3f0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:32.673812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7333603d-aa7a-4ba3-a966-c8fcf7bb3f0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:32.702909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7333603d-aa7a-4ba3-a966-c8fcf7bb3f0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044982 Aug 30 14:53:32.703482 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 616/1242] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:32 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:33.713873 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b3c0dbd2-e51e-4cf5-bd69-c20b9879bc28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:33.716057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b3c0dbd2-e51e-4cf5-bd69-c20b9879bc28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:33.722393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3c0dbd2-e51e-4cf5-bd69-c20b9879bc28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:33.722867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3c0dbd2-e51e-4cf5-bd69-c20b9879bc28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:33.723326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3c0dbd2-e51e-4cf5-bd69-c20b9879bc28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:33.724012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3c0dbd2-e51e-4cf5-bd69-c20b9879bc28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:33.724459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3c0dbd2-e51e-4cf5-bd69-c20b9879bc28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:33.724877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3c0dbd2-e51e-4cf5-bd69-c20b9879bc28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:33.753568 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b3c0dbd2-e51e-4cf5-bd69-c20b9879bc28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 Aug 30 14:53:33.754058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 627/1243] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:33 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:34.765551 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2f8fc8f7-cf6d-40aa-a805-7c78b7ed061c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:34.767828 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2f8fc8f7-cf6d-40aa-a805-7c78b7ed061c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:34.774566 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f8fc8f7-cf6d-40aa-a805-7c78b7ed061c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:34.775050 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f8fc8f7-cf6d-40aa-a805-7c78b7ed061c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:34.775514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f8fc8f7-cf6d-40aa-a805-7c78b7ed061c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:34.776210 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f8fc8f7-cf6d-40aa-a805-7c78b7ed061c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:34.776656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f8fc8f7-cf6d-40aa-a805-7c78b7ed061c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:34.777076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f8fc8f7-cf6d-40aa-a805-7c78b7ed061c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:34.807550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2f8fc8f7-cf6d-40aa-a805-7c78b7ed061c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046032 Aug 30 14:53:34.808116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 617/1244] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:34 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:35.820381 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0e11a75f-039c-4348-9a67-370b50721057 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:35.822481 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0e11a75f-039c-4348-9a67-370b50721057 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:35.829312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e11a75f-039c-4348-9a67-370b50721057 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:35.829798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e11a75f-039c-4348-9a67-370b50721057 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:35.830235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e11a75f-039c-4348-9a67-370b50721057 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:35.830922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e11a75f-039c-4348-9a67-370b50721057 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:35.831404 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e11a75f-039c-4348-9a67-370b50721057 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:35.831825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e11a75f-039c-4348-9a67-370b50721057 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:35.860289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0e11a75f-039c-4348-9a67-370b50721057 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Aug 30 14:53:35.860829 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 628/1245] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:35 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:36.872231 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7a750b32-c57c-43b1-819d-88fcb93c286e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:36.874351 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7a750b32-c57c-43b1-819d-88fcb93c286e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:36.880649 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a750b32-c57c-43b1-819d-88fcb93c286e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:36.881126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a750b32-c57c-43b1-819d-88fcb93c286e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:36.881563 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a750b32-c57c-43b1-819d-88fcb93c286e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:36.882242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a750b32-c57c-43b1-819d-88fcb93c286e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:36.882691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a750b32-c57c-43b1-819d-88fcb93c286e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:36.883112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a750b32-c57c-43b1-819d-88fcb93c286e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:36.912060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7a750b32-c57c-43b1-819d-88fcb93c286e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043716 Aug 30 14:53:36.912554 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 618/1246] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:36 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:37.924096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4d57b4b6-e623-4d26-9736-3a63a5fd16ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:37.926248 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4d57b4b6-e623-4d26-9736-3a63a5fd16ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:37.932534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d57b4b6-e623-4d26-9736-3a63a5fd16ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:37.933009 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d57b4b6-e623-4d26-9736-3a63a5fd16ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:37.934067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d57b4b6-e623-4d26-9736-3a63a5fd16ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:37.934842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d57b4b6-e623-4d26-9736-3a63a5fd16ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:37.935323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d57b4b6-e623-4d26-9736-3a63a5fd16ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:37.935749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d57b4b6-e623-4d26-9736-3a63a5fd16ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:37.964297 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4d57b4b6-e623-4d26-9736-3a63a5fd16ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044044 Aug 30 14:53:37.964849 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 629/1247] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:37 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:38.976409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e7c8854d-ab38-4ce8-aaac-00af77192f3e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:38.978547 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e7c8854d-ab38-4ce8-aaac-00af77192f3e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:38.985468 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7c8854d-ab38-4ce8-aaac-00af77192f3e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:38.985945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7c8854d-ab38-4ce8-aaac-00af77192f3e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:38.986380 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7c8854d-ab38-4ce8-aaac-00af77192f3e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:38.987094 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7c8854d-ab38-4ce8-aaac-00af77192f3e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:38.987581 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7c8854d-ab38-4ce8-aaac-00af77192f3e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:38.988006 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7c8854d-ab38-4ce8-aaac-00af77192f3e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:39.016601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e7c8854d-ab38-4ce8-aaac-00af77192f3e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044050 Aug 30 14:53:39.017068 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 619/1248] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:38 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:40.028467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5a26503e-87f9-46e4-96d2-5c3389e184a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:40.030634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5a26503e-87f9-46e4-96d2-5c3389e184a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:40.037053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a26503e-87f9-46e4-96d2-5c3389e184a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:40.037534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a26503e-87f9-46e4-96d2-5c3389e184a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:40.037971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a26503e-87f9-46e4-96d2-5c3389e184a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:40.038695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a26503e-87f9-46e4-96d2-5c3389e184a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:40.039182 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a26503e-87f9-46e4-96d2-5c3389e184a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:40.039677 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a26503e-87f9-46e4-96d2-5c3389e184a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:40.069682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5a26503e-87f9-46e4-96d2-5c3389e184a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045062 Aug 30 14:53:40.070157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 630/1249] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:40 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:41.082530 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5d362567-f105-440c-8599-a0496217e2e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:41.084822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5d362567-f105-440c-8599-a0496217e2e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:41.087079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=30 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:41.093033 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d362567-f105-440c-8599-a0496217e2e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:41.093508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d362567-f105-440c-8599-a0496217e2e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:41.093934 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d362567-f105-440c-8599-a0496217e2e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:41.094613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d362567-f105-440c-8599-a0496217e2e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:41.095059 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d362567-f105-440c-8599-a0496217e2e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:41.095500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d362567-f105-440c-8599-a0496217e2e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:41.099180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=90 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:41.125664 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5d362567-f105-440c-8599-a0496217e2e8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047039 Aug 30 14:53:41.126151 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 620/1250] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:41 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:42.138084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f03cad72-c908-45ff-9be4-6a3f5f57d38c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:42.140437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f03cad72-c908-45ff-9be4-6a3f5f57d38c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:42.142689 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=30 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:42.147839 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f03cad72-c908-45ff-9be4-6a3f5f57d38c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:42.148314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f03cad72-c908-45ff-9be4-6a3f5f57d38c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:42.148749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f03cad72-c908-45ff-9be4-6a3f5f57d38c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:42.149451 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f03cad72-c908-45ff-9be4-6a3f5f57d38c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:42.149894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f03cad72-c908-45ff-9be4-6a3f5f57d38c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:42.150309 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f03cad72-c908-45ff-9be4-6a3f5f57d38c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:42.179506 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f03cad72-c908-45ff-9be4-6a3f5f57d38c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046217 Aug 30 14:53:42.179965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 631/1251] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:42 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:43.192603 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5cbecbd9-6b25-4fd3-b199-c9d37428cf6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:43.194732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5cbecbd9-6b25-4fd3-b199-c9d37428cf6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:43.201830 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cbecbd9-6b25-4fd3-b199-c9d37428cf6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:43.202295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cbecbd9-6b25-4fd3-b199-c9d37428cf6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:43.202725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cbecbd9-6b25-4fd3-b199-c9d37428cf6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:43.203431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cbecbd9-6b25-4fd3-b199-c9d37428cf6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:43.203876 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cbecbd9-6b25-4fd3-b199-c9d37428cf6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:43.204288 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cbecbd9-6b25-4fd3-b199-c9d37428cf6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:43.234909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5cbecbd9-6b25-4fd3-b199-c9d37428cf6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046586 Aug 30 14:53:43.235450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 621/1252] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:43 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:44.246415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cbb0ea7e-b110-4100-8d64-14d5d401b4a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:44.248584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cbb0ea7e-b110-4100-8d64-14d5d401b4a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:44.254782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb0ea7e-b110-4100-8d64-14d5d401b4a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:44.255292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb0ea7e-b110-4100-8d64-14d5d401b4a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:44.255728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb0ea7e-b110-4100-8d64-14d5d401b4a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:44.256421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb0ea7e-b110-4100-8d64-14d5d401b4a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:44.256872 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb0ea7e-b110-4100-8d64-14d5d401b4a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:44.257298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbb0ea7e-b110-4100-8d64-14d5d401b4a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:44.286354 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cbb0ea7e-b110-4100-8d64-14d5d401b4a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044322 Aug 30 14:53:44.286892 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 632/1253] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:44 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:45.297995 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-66d175c6-ba16-4b9a-b4f5-c133bd5f7a5a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:45.300192 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-66d175c6-ba16-4b9a-b4f5-c133bd5f7a5a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:45.306391 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66d175c6-ba16-4b9a-b4f5-c133bd5f7a5a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:45.306873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66d175c6-ba16-4b9a-b4f5-c133bd5f7a5a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:45.307346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66d175c6-ba16-4b9a-b4f5-c133bd5f7a5a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:45.308041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66d175c6-ba16-4b9a-b4f5-c133bd5f7a5a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:45.308518 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66d175c6-ba16-4b9a-b4f5-c133bd5f7a5a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:45.308937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66d175c6-ba16-4b9a-b4f5-c133bd5f7a5a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:45.343318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-66d175c6-ba16-4b9a-b4f5-c133bd5f7a5a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049266 Aug 30 14:53:45.343884 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 622/1254] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:45 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 14:53:46.356146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8d70a525-39f5-4d17-b15b-81356ac19387 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:46.358296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8d70a525-39f5-4d17-b15b-81356ac19387 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:46.364103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d70a525-39f5-4d17-b15b-81356ac19387 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:46.364586 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d70a525-39f5-4d17-b15b-81356ac19387 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:46.365009 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d70a525-39f5-4d17-b15b-81356ac19387 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:46.365768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d70a525-39f5-4d17-b15b-81356ac19387 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:46.366135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d70a525-39f5-4d17-b15b-81356ac19387 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:46.366555 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d70a525-39f5-4d17-b15b-81356ac19387 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:46.395102 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8d70a525-39f5-4d17-b15b-81356ac19387 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043639 Aug 30 14:53:46.395682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 633/1255] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:46 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:47.407798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b2fb5fc7-054d-4edd-b13d-1d40c41faae4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:47.410004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b2fb5fc7-054d-4edd-b13d-1d40c41faae4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:47.416265 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2fb5fc7-054d-4edd-b13d-1d40c41faae4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:47.416748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2fb5fc7-054d-4edd-b13d-1d40c41faae4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:47.417187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2fb5fc7-054d-4edd-b13d-1d40c41faae4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:47.418461 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2fb5fc7-054d-4edd-b13d-1d40c41faae4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:47.418930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2fb5fc7-054d-4edd-b13d-1d40c41faae4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:47.419717 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2fb5fc7-054d-4edd-b13d-1d40c41faae4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:47.448551 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b2fb5fc7-054d-4edd-b13d-1d40c41faae4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044672 Aug 30 14:53:47.449674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 623/1256] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:47 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:48.461361 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c631ae13-b123-48b8-8df7-1b99e032cb4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:48.463549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c631ae13-b123-48b8-8df7-1b99e032cb4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:48.470431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c631ae13-b123-48b8-8df7-1b99e032cb4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:48.470913 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c631ae13-b123-48b8-8df7-1b99e032cb4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:48.471377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c631ae13-b123-48b8-8df7-1b99e032cb4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:48.472068 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c631ae13-b123-48b8-8df7-1b99e032cb4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:48.472508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c631ae13-b123-48b8-8df7-1b99e032cb4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:48.472924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c631ae13-b123-48b8-8df7-1b99e032cb4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:48.503945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c631ae13-b123-48b8-8df7-1b99e032cb4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046527 Aug 30 14:53:48.504487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 634/1257] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:48 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:49.517043 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dcb647e5-3d7f-4d55-ab1c-330d4e7c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:49.519195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dcb647e5-3d7f-4d55-ab1c-330d4e7c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:49.525979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcb647e5-3d7f-4d55-ab1c-330d4e7c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:49.526459 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcb647e5-3d7f-4d55-ab1c-330d4e7c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:49.526905 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcb647e5-3d7f-4d55-ab1c-330d4e7c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:49.527628 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcb647e5-3d7f-4d55-ab1c-330d4e7c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:49.528069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcb647e5-3d7f-4d55-ab1c-330d4e7c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:49.528493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcb647e5-3d7f-4d55-ab1c-330d4e7c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:49.557578 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dcb647e5-3d7f-4d55-ab1c-330d4e7c9840 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 Aug 30 14:53:49.558630 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 624/1258] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:49 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:50.570149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-28cdd270-4d9f-4924-9cad-aa156f853a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:50.572409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-28cdd270-4d9f-4924-9cad-aa156f853a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:50.579647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-28cdd270-4d9f-4924-9cad-aa156f853a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:50.580136 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-28cdd270-4d9f-4924-9cad-aa156f853a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:50.580570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-28cdd270-4d9f-4924-9cad-aa156f853a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:50.581302 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-28cdd270-4d9f-4924-9cad-aa156f853a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:50.581778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-28cdd270-4d9f-4924-9cad-aa156f853a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:50.582201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-28cdd270-4d9f-4924-9cad-aa156f853a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:50.612448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-28cdd270-4d9f-4924-9cad-aa156f853a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046403 Aug 30 14:53:50.612997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 635/1259] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:50 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:51.633699 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-329e24de-5804-4276-97ea-48b8e75a8735 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:51.635864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-329e24de-5804-4276-97ea-48b8e75a8735 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:51.642775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-329e24de-5804-4276-97ea-48b8e75a8735 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:51.643424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-329e24de-5804-4276-97ea-48b8e75a8735 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:51.643865 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-329e24de-5804-4276-97ea-48b8e75a8735 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:51.644550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-329e24de-5804-4276-97ea-48b8e75a8735 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:51.644991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-329e24de-5804-4276-97ea-48b8e75a8735 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:51.645402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-329e24de-5804-4276-97ea-48b8e75a8735 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:51.675481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-329e24de-5804-4276-97ea-48b8e75a8735 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045586 Aug 30 14:53:51.676034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 625/1260] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:51 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:52.687492 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-baaf285b-033b-4bfd-adb3-37e225acbac3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:52.689630 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-baaf285b-033b-4bfd-adb3-37e225acbac3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:52.695965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baaf285b-033b-4bfd-adb3-37e225acbac3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:52.696448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baaf285b-033b-4bfd-adb3-37e225acbac3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:52.696887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baaf285b-033b-4bfd-adb3-37e225acbac3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:52.697587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baaf285b-033b-4bfd-adb3-37e225acbac3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:52.698058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baaf285b-033b-4bfd-adb3-37e225acbac3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:52.698453 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baaf285b-033b-4bfd-adb3-37e225acbac3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:52.728629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-baaf285b-033b-4bfd-adb3-37e225acbac3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Aug 30 14:53:52.729181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 636/1261] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:52 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:53.740610 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ac7e61b0-1acc-4bda-ad76-3eb43411a901 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:53.742736 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ac7e61b0-1acc-4bda-ad76-3eb43411a901 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:53.749557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac7e61b0-1acc-4bda-ad76-3eb43411a901 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:53.750113 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac7e61b0-1acc-4bda-ad76-3eb43411a901 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:53.750546 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac7e61b0-1acc-4bda-ad76-3eb43411a901 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:53.751249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac7e61b0-1acc-4bda-ad76-3eb43411a901 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:53.751695 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac7e61b0-1acc-4bda-ad76-3eb43411a901 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:53.752174 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac7e61b0-1acc-4bda-ad76-3eb43411a901 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:53.782105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ac7e61b0-1acc-4bda-ad76-3eb43411a901 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045396 Aug 30 14:53:53.782645 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 626/1262] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:53 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:54.795481 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a31aa768-2875-413a-848a-5787b670c5a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:54.798236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a31aa768-2875-413a-848a-5787b670c5a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:54.805549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a31aa768-2875-413a-848a-5787b670c5a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:54.806036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a31aa768-2875-413a-848a-5787b670c5a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:54.806469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a31aa768-2875-413a-848a-5787b670c5a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:54.807163 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a31aa768-2875-413a-848a-5787b670c5a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:54.807635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a31aa768-2875-413a-848a-5787b670c5a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:54.808055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a31aa768-2875-413a-848a-5787b670c5a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:54.840235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a31aa768-2875-413a-848a-5787b670c5a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049848 Aug 30 14:53:54.840799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 637/1263] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:54 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:55.854035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-35cba110-a0de-4fa8-abfe-8826f94b6db4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:55.856436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-35cba110-a0de-4fa8-abfe-8826f94b6db4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:55.862785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35cba110-a0de-4fa8-abfe-8826f94b6db4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:55.863335 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35cba110-a0de-4fa8-abfe-8826f94b6db4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:55.863775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35cba110-a0de-4fa8-abfe-8826f94b6db4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:55.864491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35cba110-a0de-4fa8-abfe-8826f94b6db4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:55.864947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35cba110-a0de-4fa8-abfe-8826f94b6db4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:55.865368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35cba110-a0de-4fa8-abfe-8826f94b6db4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:55.895157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-35cba110-a0de-4fa8-abfe-8826f94b6db4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046823 Aug 30 14:53:55.895738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 627/1264] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:55 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:56.907083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1d011bf4-b70e-4309-bd3e-3461215877c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:56.909456 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1d011bf4-b70e-4309-bd3e-3461215877c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:56.917158 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1d011bf4-b70e-4309-bd3e-3461215877c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:56.917636 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1d011bf4-b70e-4309-bd3e-3461215877c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:56.918064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1d011bf4-b70e-4309-bd3e-3461215877c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:56.918760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1d011bf4-b70e-4309-bd3e-3461215877c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:56.919239 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1d011bf4-b70e-4309-bd3e-3461215877c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:56.919651 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1d011bf4-b70e-4309-bd3e-3461215877c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:56.948995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1d011bf4-b70e-4309-bd3e-3461215877c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045815 Aug 30 14:53:56.949552 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 638/1265] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:56 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:57.960620 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a5e989c9-82e4-4b8c-91f0-e2dcf79b2c31 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:57.962899 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a5e989c9-82e4-4b8c-91f0-e2dcf79b2c31 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:57.970792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5e989c9-82e4-4b8c-91f0-e2dcf79b2c31 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:57.971372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5e989c9-82e4-4b8c-91f0-e2dcf79b2c31 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:57.971929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5e989c9-82e4-4b8c-91f0-e2dcf79b2c31 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:57.972693 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5e989c9-82e4-4b8c-91f0-e2dcf79b2c31 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:57.973211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5e989c9-82e4-4b8c-91f0-e2dcf79b2c31 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:57.973636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5e989c9-82e4-4b8c-91f0-e2dcf79b2c31 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:58.002587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a5e989c9-82e4-4b8c-91f0-e2dcf79b2c31 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046002 Aug 30 14:53:58.003122 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 628/1266] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:57 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:53:59.014775 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a474ad33-2012-4549-8a97-c6eb5a02a7c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:53:59.017125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a474ad33-2012-4549-8a97-c6eb5a02a7c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:53:59.025212 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a474ad33-2012-4549-8a97-c6eb5a02a7c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:59.025696 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a474ad33-2012-4549-8a97-c6eb5a02a7c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:59.026124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a474ad33-2012-4549-8a97-c6eb5a02a7c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:59.026812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a474ad33-2012-4549-8a97-c6eb5a02a7c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:53:59.027276 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a474ad33-2012-4549-8a97-c6eb5a02a7c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:53:59.027696 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a474ad33-2012-4549-8a97-c6eb5a02a7c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:53:59.032817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=90 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:53:59.059407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a474ad33-2012-4549-8a97-c6eb5a02a7c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048828 Aug 30 14:53:59.059948 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 639/1267] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:53:59 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:00.071619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7a5f2c52-35e4-43fb-8042-4f3b9bfdc8fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:00.073995 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7a5f2c52-35e4-43fb-8042-4f3b9bfdc8fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:00.081416 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a5f2c52-35e4-43fb-8042-4f3b9bfdc8fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:00.081895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a5f2c52-35e4-43fb-8042-4f3b9bfdc8fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:00.082330 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a5f2c52-35e4-43fb-8042-4f3b9bfdc8fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:00.083022 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a5f2c52-35e4-43fb-8042-4f3b9bfdc8fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:00.083496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a5f2c52-35e4-43fb-8042-4f3b9bfdc8fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:00.083971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a5f2c52-35e4-43fb-8042-4f3b9bfdc8fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:00.113153 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7a5f2c52-35e4-43fb-8042-4f3b9bfdc8fc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045687 Aug 30 14:54:00.113706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 629/1268] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:54:00 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:01.125704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b346de27-86db-4c6b-bb32-6ba8ed924f83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:01.127992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b346de27-86db-4c6b-bb32-6ba8ed924f83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:01.134404 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b346de27-86db-4c6b-bb32-6ba8ed924f83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:01.134886 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b346de27-86db-4c6b-bb32-6ba8ed924f83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:01.135339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b346de27-86db-4c6b-bb32-6ba8ed924f83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:01.136035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b346de27-86db-4c6b-bb32-6ba8ed924f83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:01.136480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b346de27-86db-4c6b-bb32-6ba8ed924f83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:01.136894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b346de27-86db-4c6b-bb32-6ba8ed924f83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:01.167436 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b346de27-86db-4c6b-bb32-6ba8ed924f83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046168 Aug 30 14:54:01.167982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 640/1269] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:54:01 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:02.180843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-85ca7fdb-8487-42e0-9059-3545286a6338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:02.183122 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-85ca7fdb-8487-42e0-9059-3545286a6338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:02.189602 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85ca7fdb-8487-42e0-9059-3545286a6338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:02.190042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85ca7fdb-8487-42e0-9059-3545286a6338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:02.190477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85ca7fdb-8487-42e0-9059-3545286a6338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:02.191175 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85ca7fdb-8487-42e0-9059-3545286a6338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:02.191712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85ca7fdb-8487-42e0-9059-3545286a6338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:02.192405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-85ca7fdb-8487-42e0-9059-3545286a6338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:02.227527 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-85ca7fdb-8487-42e0-9059-3545286a6338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050564 Aug 30 14:54:02.228095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 630/1270] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:54:02 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:03.240097 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8d55f9b6-353f-4149-a563-96e9cfd10d69 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:03.243794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8d55f9b6-353f-4149-a563-96e9cfd10d69 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:03.245745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 14:54:03.245874 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 14:54:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments (ip 10.222.0.30) !!! Aug 30 14:54:03.252831 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d55f9b6-353f-4149-a563-96e9cfd10d69 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:03.253327 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d55f9b6-353f-4149-a563-96e9cfd10d69 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:03.253758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d55f9b6-353f-4149-a563-96e9cfd10d69 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:03.254453 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d55f9b6-353f-4149-a563-96e9cfd10d69 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:03.254898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d55f9b6-353f-4149-a563-96e9cfd10d69 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:03.255336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d55f9b6-353f-4149-a563-96e9cfd10d69 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:03.286766 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8d55f9b6-353f-4149-a563-96e9cfd10d69 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050494 Aug 30 14:54:03.287437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 641/1271] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:54:03 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:04.298638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-38d38a07-f4ed-4a6b-aef2-24565f619a89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:04.300970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-38d38a07-f4ed-4a6b-aef2-24565f619a89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:04.308440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38d38a07-f4ed-4a6b-aef2-24565f619a89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:04.308918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38d38a07-f4ed-4a6b-aef2-24565f619a89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:04.309370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38d38a07-f4ed-4a6b-aef2-24565f619a89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:04.310061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38d38a07-f4ed-4a6b-aef2-24565f619a89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:04.310505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38d38a07-f4ed-4a6b-aef2-24565f619a89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:04.311462 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-38d38a07-f4ed-4a6b-aef2-24565f619a89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:04.341359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-38d38a07-f4ed-4a6b-aef2-24565f619a89 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047374 Aug 30 14:54:04.341915 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 631/1272] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:54:04 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:05.353363 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b857b77b-54b4-4bd2-ad74-ee1c8e09defc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:05.355758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b857b77b-54b4-4bd2-ad74-ee1c8e09defc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:05.362904 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b857b77b-54b4-4bd2-ad74-ee1c8e09defc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:05.363438 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b857b77b-54b4-4bd2-ad74-ee1c8e09defc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:05.363877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b857b77b-54b4-4bd2-ad74-ee1c8e09defc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:05.364575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b857b77b-54b4-4bd2-ad74-ee1c8e09defc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:05.365029 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b857b77b-54b4-4bd2-ad74-ee1c8e09defc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:05.365454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b857b77b-54b4-4bd2-ad74-ee1c8e09defc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:05.396569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b857b77b-54b4-4bd2-ad74-ee1c8e09defc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047086 Aug 30 14:54:05.400896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 642/1273] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:54:05 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:06.408918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-69ea5ca5-10a6-4242-a4a6-7d2c22257d93 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:06.412600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-69ea5ca5-10a6-4242-a4a6-7d2c22257d93 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:06.419131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69ea5ca5-10a6-4242-a4a6-7d2c22257d93 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:06.419642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69ea5ca5-10a6-4242-a4a6-7d2c22257d93 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:06.420077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69ea5ca5-10a6-4242-a4a6-7d2c22257d93 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:06.420909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69ea5ca5-10a6-4242-a4a6-7d2c22257d93 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:06.421361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69ea5ca5-10a6-4242-a4a6-7d2c22257d93 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:06.421782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69ea5ca5-10a6-4242-a4a6-7d2c22257d93 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:06.450985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-69ea5ca5-10a6-4242-a4a6-7d2c22257d93 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046698 Aug 30 14:54:06.452121 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 632/1274] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:54:06 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:07.463673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f059c522-2172-4251-8dd4-395bfbf15a00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:07.465982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f059c522-2172-4251-8dd4-395bfbf15a00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:07.472743 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f059c522-2172-4251-8dd4-395bfbf15a00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:07.473163 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f059c522-2172-4251-8dd4-395bfbf15a00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:07.473606 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f059c522-2172-4251-8dd4-395bfbf15a00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:07.474218 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f059c522-2172-4251-8dd4-395bfbf15a00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:07.474675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f059c522-2172-4251-8dd4-395bfbf15a00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:07.475328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f059c522-2172-4251-8dd4-395bfbf15a00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:07.505210 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f059c522-2172-4251-8dd4-395bfbf15a00 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045420 Aug 30 14:54:07.505674 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 643/1275] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:54:07 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:08.517107 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3ee85e3d-66ad-49ac-ae38-f1c51e29bd3f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:08.519295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3ee85e3d-66ad-49ac-ae38-f1c51e29bd3f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:08.538048 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ee85e3d-66ad-49ac-ae38-f1c51e29bd3f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:08.538536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ee85e3d-66ad-49ac-ae38-f1c51e29bd3f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:08.539089 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ee85e3d-66ad-49ac-ae38-f1c51e29bd3f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:08.539702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ee85e3d-66ad-49ac-ae38-f1c51e29bd3f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:08.540150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ee85e3d-66ad-49ac-ae38-f1c51e29bd3f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:08.540571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ee85e3d-66ad-49ac-ae38-f1c51e29bd3f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:08.573479 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3ee85e3d-66ad-49ac-ae38-f1c51e29bd3f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060626 Aug 30 14:54:08.574032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 633/1276] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 14:54:08 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:09.585489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-00f73ed2-af24-4f17-8c8e-881b6f108c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:09.588153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-00f73ed2-af24-4f17-8c8e-881b6f108c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:09.595777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00f73ed2-af24-4f17-8c8e-881b6f108c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:09.596267 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00f73ed2-af24-4f17-8c8e-881b6f108c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:09.596879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00f73ed2-af24-4f17-8c8e-881b6f108c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:09.597578 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00f73ed2-af24-4f17-8c8e-881b6f108c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:09.598039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00f73ed2-af24-4f17-8c8e-881b6f108c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:09.598655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00f73ed2-af24-4f17-8c8e-881b6f108c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:09.708293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-00f73ed2-af24-4f17-8c8e-881b6f108c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "POST /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/action" status: 200 len: 76692 microversion: 2.1 time: 0.126473 Aug 30 14:54:09.708856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 644/1277] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 14:54:09 2022] POST /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52/action => generated 76692 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 14:54:11.711338 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e3d63beb-9484-47e6-a752-18f522fc3f09 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:11.711866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e3d63beb-9484-47e6-a752-18f522fc3f09 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:11.714163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=28 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:11.720245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d63beb-9484-47e6-a752-18f522fc3f09 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:11.720729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d63beb-9484-47e6-a752-18f522fc3f09 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:11.721163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d63beb-9484-47e6-a752-18f522fc3f09 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:11.721857 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d63beb-9484-47e6-a752-18f522fc3f09 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:11.722306 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d63beb-9484-47e6-a752-18f522fc3f09 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:11.722734 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d63beb-9484-47e6-a752-18f522fc3f09 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:11.726863 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=84 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:11.748896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e3d63beb-9484-47e6-a752-18f522fc3f09 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:54:11.825975 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e3d63beb-9484-47e6-a752-18f522fc3f09 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "DELETE /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 204 len: 0 microversion: 2.1 time: 0.118229 Aug 30 14:54:11.827448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 634/1278] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 14:54:11 2022] DELETE /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:54:11.836971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-aae759c6-2c5d-449d-b679-482cfa254df5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:11.837679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-aae759c6-2c5d-449d-b679-482cfa254df5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:11.844642 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aae759c6-2c5d-449d-b679-482cfa254df5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:11.845124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aae759c6-2c5d-449d-b679-482cfa254df5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:11.845765 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aae759c6-2c5d-449d-b679-482cfa254df5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:11.846593 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aae759c6-2c5d-449d-b679-482cfa254df5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:11.847051 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aae759c6-2c5d-449d-b679-482cfa254df5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:11.847502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aae759c6-2c5d-449d-b679-482cfa254df5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:11.976051 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-aae759c6-2c5d-449d-b679-482cfa254df5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:11.984203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-aae759c6-2c5d-449d-b679-482cfa254df5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 200 len: 1671 microversion: 2.1 time: 0.151871 Aug 30 14:54:11.984761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 645/1279] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:11 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:13.008424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-edc6c2d1-1c69-448a-9a3a-e608eefc88a8 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:13.009123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-edc6c2d1-1c69-448a-9a3a-e608eefc88a8 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:13.015754 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-edc6c2d1-1c69-448a-9a3a-e608eefc88a8 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:13.016234 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-edc6c2d1-1c69-448a-9a3a-e608eefc88a8 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:13.016664 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-edc6c2d1-1c69-448a-9a3a-e608eefc88a8 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:13.017345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-edc6c2d1-1c69-448a-9a3a-e608eefc88a8 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:13.017784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-edc6c2d1-1c69-448a-9a3a-e608eefc88a8 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:13.018197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-edc6c2d1-1c69-448a-9a3a-e608eefc88a8 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:13.184994 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-edc6c2d1-1c69-448a-9a3a-e608eefc88a8 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:13.193343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-edc6c2d1-1c69-448a-9a3a-e608eefc88a8 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 200 len: 1604 microversion: 2.1 time: 0.191159 Aug 30 14:54:13.193990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 635/1280] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:13 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 1604 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:13.609977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-aa09ba9c-ad4a-416f-b1c3-1438d8d28785 req-c0b34393-855e-4de0-9b87-7ab919f7d2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17fcd66f-fa4d-4b53-a76c-6d10cba8674a", "name": "network-vif-deleted", "tag": "bf364e8d-8643-4832-8c3f-5107f56efd6b"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:54:13.615772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=30 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:54:13.622686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-aa09ba9c-ad4a-416f-b1c3-1438d8d28785 req-c0b34393-855e-4de0-9b87-7ab919f7d2f0 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:13.623840 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-aa09ba9c-ad4a-416f-b1c3-1438d8d28785 req-c0b34393-855e-4de0-9b87-7ab919f7d2f0 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:13.624564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-aa09ba9c-ad4a-416f-b1c3-1438d8d28785 req-c0b34393-855e-4de0-9b87-7ab919f7d2f0 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:13.636328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-aa09ba9c-ad4a-416f-b1c3-1438d8d28785 req-c0b34393-855e-4de0-9b87-7ab919f7d2f0 service nova] Creating event network-vif-deleted:bf364e8d-8643-4832-8c3f-5107f56efd6b for instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a on hv-cinder-82880 Aug 30 14:54:13.642721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-aa09ba9c-ad4a-416f-b1c3-1438d8d28785 req-c0b34393-855e-4de0-9b87-7ab919f7d2f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105496 Aug 30 14:54:13.646564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 646/1281] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:54:14.218488 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1428601a-8ba8-4010-b569-1b7e81db1486 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:14.223253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1428601a-8ba8-4010-b569-1b7e81db1486 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:14.230238 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1428601a-8ba8-4010-b569-1b7e81db1486 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:14.230809 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1428601a-8ba8-4010-b569-1b7e81db1486 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:14.231269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1428601a-8ba8-4010-b569-1b7e81db1486 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:14.232088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1428601a-8ba8-4010-b569-1b7e81db1486 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:14.233305 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1428601a-8ba8-4010-b569-1b7e81db1486 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:14.234074 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1428601a-8ba8-4010-b569-1b7e81db1486 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:14.276579 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1428601a-8ba8-4010-b569-1b7e81db1486 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:14.277066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1428601a-8ba8-4010-b569-1b7e81db1486 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:14.277504 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1428601a-8ba8-4010-b569-1b7e81db1486 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:14.277958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-1428601a-8ba8-4010-b569-1b7e81db1486 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lazy-loading 'fault' on Instance uuid 17fcd66f-fa4d-4b53-a76c-6d10cba8674a {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 14:54:14.325367 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1428601a-8ba8-4010-b569-1b7e81db1486 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9bafc5ff4e43719f37e62cad946cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04efb141e084405992bfc0418a74da2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:54:14.332864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1428601a-8ba8-4010-b569-1b7e81db1486 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 200 len: 1327 microversion: 2.1 time: 0.121166 Aug 30 14:54:14.333439 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 636/1282] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:14 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 1327 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:54:15.355201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-825fd07b-d73b-41c1-88e6-31e25a8ac695 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:15.355928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-825fd07b-d73b-41c1-88e6-31e25a8ac695 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:54:15.362111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-825fd07b-d73b-41c1-88e6-31e25a8ac695 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:15.362598 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-825fd07b-d73b-41c1-88e6-31e25a8ac695 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:15.363032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-825fd07b-d73b-41c1-88e6-31e25a8ac695 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:15.363755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-825fd07b-d73b-41c1-88e6-31e25a8ac695 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:54:15.364203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-825fd07b-d73b-41c1-88e6-31e25a8ac695 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:54:15.364626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-825fd07b-d73b-41c1-88e6-31e25a8ac695 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:54:15.378924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-825fd07b-d73b-41c1-88e6-31e25a8ac695 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] HTTP exception thrown: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-825fd07b-d73b-41c1-88e6-31e25a8ac695 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Request method failure captured: Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a HTTP/1.1 Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHXgeukw0ZNoeficrJEf5lm6v5wj-1PFcFAuJEVMG7EHf6PXGtj7rdqQW2W_0AJCo9VQHgduruYwxwCrpZ10VB9ejqPXjJYMY10nBr1H3zK66KAO8Jy47XLqCblx9Q6gEvo1HZaGbtdLUD5lU6Pc3W6-xhQLr_9vp1ZGNC261GauT4 Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: 04efb141e084405992bfc0418a74da2a Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-AttachVolumeTestJSON-105252644 Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 14:54:15.380557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 14:54:15.382179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/04efb141e084405992bfc0418a74da2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_04efb141e084405992bfc0418a74da2a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/04efb141e084405992bfc0418a74da2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/04efb141e084405992bfc0418a74da2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 14:54:15.382179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-AttachVolumeTestJSON-105252644 Aug 30 14:54:15.382179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: 04efb141e084405992bfc0418a74da2a Aug 30 14:54:15.382179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-AttachVolumeTestJSON-105252644 Aug 30 14:54:15.382179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-AttachVolumeTestJSON-105252644-project Aug 30 14:54:15.382179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 14:54:15.382179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 14:54:15.382179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: ca9bafc5ff4e43719f37e62cad946cf7 Aug 30 14:54:15.382179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-AttachVolumeTestJSON-105252644-project Aug 30 14:54:15.382179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 14:54:15.382179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. Aug 30 14:54:15.382179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': '17fcd66f-fa4d-4b53-a76c-6d10cba8674a'} Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 14:54:15.383109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. Aug 30 14:54:15.384704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 14:54:15.386086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-825fd07b-d73b-41c1-88e6-31e25a8ac695 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Returning 404 to user: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 14:54:15.386086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-825fd07b-d73b-41c1-88e6-31e25a8ac695 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 404 len: 111 microversion: 2.1 time: 0.031415 Aug 30 14:54:15.386086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 647/1283] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:54:15 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 14:54:15.391197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-03b83ce2-cb6b-4f50-a8c4-9cbfead3b0d5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '.version_select at 0x7f5cbab3b430>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:54:15.395485 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR oslo.messaging._drivers.impl_rabbit [None req-03b83ce2-cb6b-4f50-a8c4-9cbfead3b0d5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [4f00d35e-562c-4bee-859b-48780596ec99] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 14:54:16.403158 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [None req-03b83ce2-cb6b-4f50-a8c4-9cbfead3b0d5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [4f00d35e-562c-4bee-859b-48780596ec99] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 54594. Aug 30 14:54:16.423005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-03b83ce2-cb6b-4f50-a8c4-9cbfead3b0d5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-422728477" status: 202 len: 0 microversion: 2.1 time: 1.036105 Aug 30 14:54:16.423614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 637/1284] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 14:54:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-422728477 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 14:58:18.215664 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34884703-4033-4b27-b74a-ef5661add272] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 14:58:18.216165 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 14:58:18.216285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 14:58:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 (ip 10.222.0.30) !!! Aug 30 14:58:18.217326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=3 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:18.218257 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=43 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:18.219300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 14:58:18.219814 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 14:58:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 (ip 10.222.0.30) !!! Aug 30 14:58:18.220596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 14:58:18.220716 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 14:58:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 (ip 10.222.0.30) !!! Aug 30 14:58:18.227186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a0a70477-af34-489e-9f78-d0c6576c7e32 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:18.227717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a0a70477-af34-489e-9f78-d0c6576c7e32 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:18.243381 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0a70477-af34-489e-9f78-d0c6576c7e32 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:18.243908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0a70477-af34-489e-9f78-d0c6576c7e32 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:18.244291 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0a70477-af34-489e-9f78-d0c6576c7e32 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:18.245187 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0a70477-af34-489e-9f78-d0c6576c7e32 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:18.245643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0a70477-af34-489e-9f78-d0c6576c7e32 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:18.246062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0a70477-af34-489e-9f78-d0c6576c7e32 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:18.274697 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a0a70477-af34-489e-9f78-d0c6576c7e32 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Going to try to terminate instance {{(pid=127089) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:58:18.352210 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a0a70477-af34-489e-9f78-d0c6576c7e32 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "DELETE /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 204 len: 0 microversion: 2.1 time: 0.138464 Aug 30 14:58:18.352927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 648/1285] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 14:58:18 2022] DELETE /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 14:58:18.359747 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b2720b3-8822-4ca1-8e33-a4e896f2d5ee] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 14:58:18.360312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:18.361177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:18.362250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 14:58:18.362390 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 14:58:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 (ip 10.222.0.30) !!! Aug 30 14:58:18.363770 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 14:58:18.363930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 14:58:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 (ip 10.222.0.30) !!! Aug 30 14:58:18.365126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 14:58:18.365260 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 14:58:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 (ip 10.222.0.30) !!! Aug 30 14:58:18.371874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0dac5572-c241-439a-9e97-cc5aae743767 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:18.372485 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0dac5572-c241-439a-9e97-cc5aae743767 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:18.386427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dac5572-c241-439a-9e97-cc5aae743767 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:18.386913 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dac5572-c241-439a-9e97-cc5aae743767 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:18.387380 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dac5572-c241-439a-9e97-cc5aae743767 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:18.388082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dac5572-c241-439a-9e97-cc5aae743767 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:18.388537 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dac5572-c241-439a-9e97-cc5aae743767 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:18.388965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dac5572-c241-439a-9e97-cc5aae743767 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:18.517434 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0dac5572-c241-439a-9e97-cc5aae743767 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:18.525510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0dac5572-c241-439a-9e97-cc5aae743767 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.167662 Aug 30 14:58:18.526073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 638/1286] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:18 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:19.547584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6e37b4e9-5c1b-4acf-a227-28b8653764ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:19.548219 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6e37b4e9-5c1b-4acf-a227-28b8653764ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:19.556952 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e37b4e9-5c1b-4acf-a227-28b8653764ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:19.557440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e37b4e9-5c1b-4acf-a227-28b8653764ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:19.557875 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e37b4e9-5c1b-4acf-a227-28b8653764ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:19.558576 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e37b4e9-5c1b-4acf-a227-28b8653764ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:19.559028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e37b4e9-5c1b-4acf-a227-28b8653764ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:19.559480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6e37b4e9-5c1b-4acf-a227-28b8653764ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:19.565014 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] [34884703-4033-4b27-b74a-ef5661add272] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 56968. Aug 30 14:58:19.745304 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6e37b4e9-5c1b-4acf-a227-28b8653764ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:19.753415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6e37b4e9-5c1b-4acf-a227-28b8653764ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.210247 Aug 30 14:58:19.753970 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 649/1287] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:19 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:20.775614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2e294fb3-3bdb-493c-a45f-7b0aa85ac6c0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:20.776209 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2e294fb3-3bdb-493c-a45f-7b0aa85ac6c0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:20.783821 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e294fb3-3bdb-493c-a45f-7b0aa85ac6c0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:20.784293 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e294fb3-3bdb-493c-a45f-7b0aa85ac6c0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:20.784719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e294fb3-3bdb-493c-a45f-7b0aa85ac6c0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:20.785435 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e294fb3-3bdb-493c-a45f-7b0aa85ac6c0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:20.785877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e294fb3-3bdb-493c-a45f-7b0aa85ac6c0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:20.786292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e294fb3-3bdb-493c-a45f-7b0aa85ac6c0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:20.791672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b2720b3-8822-4ca1-8e33-a4e896f2d5ee] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 56984. Aug 30 14:58:20.921174 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2e294fb3-3bdb-493c-a45f-7b0aa85ac6c0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:20.929500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2e294fb3-3bdb-493c-a45f-7b0aa85ac6c0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.158399 Aug 30 14:58:20.930039 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 639/1288] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:20 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:21.949964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d5c3fedb-3a98-48fd-b981-660b8580ebb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:21.950566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d5c3fedb-3a98-48fd-b981-660b8580ebb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:21.956819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5c3fedb-3a98-48fd-b981-660b8580ebb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:21.957289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5c3fedb-3a98-48fd-b981-660b8580ebb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:21.957715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5c3fedb-3a98-48fd-b981-660b8580ebb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:21.958395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5c3fedb-3a98-48fd-b981-660b8580ebb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:21.958835 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5c3fedb-3a98-48fd-b981-660b8580ebb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:21.959854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5c3fedb-3a98-48fd-b981-660b8580ebb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:22.089468 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d5c3fedb-3a98-48fd-b981-660b8580ebb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:22.102709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d5c3fedb-3a98-48fd-b981-660b8580ebb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156535 Aug 30 14:58:22.103518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 650/1289] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:21 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:23.123560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-caf5867d-5011-4252-82b7-243c4f50c683 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:23.124072 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-caf5867d-5011-4252-82b7-243c4f50c683 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:23.130349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-caf5867d-5011-4252-82b7-243c4f50c683 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:23.130816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-caf5867d-5011-4252-82b7-243c4f50c683 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:23.131350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-caf5867d-5011-4252-82b7-243c4f50c683 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:23.132156 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-caf5867d-5011-4252-82b7-243c4f50c683 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:23.132626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-caf5867d-5011-4252-82b7-243c4f50c683 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:23.133040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-caf5867d-5011-4252-82b7-243c4f50c683 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:23.262334 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-caf5867d-5011-4252-82b7-243c4f50c683 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:23.270400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-caf5867d-5011-4252-82b7-243c4f50c683 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150775 Aug 30 14:58:23.270957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 640/1290] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:23 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:24.291308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ace70a20-5eee-4fe8-ba20-202766328361 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:24.291946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ace70a20-5eee-4fe8-ba20-202766328361 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:24.298480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ace70a20-5eee-4fe8-ba20-202766328361 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:24.298956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ace70a20-5eee-4fe8-ba20-202766328361 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:24.299432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ace70a20-5eee-4fe8-ba20-202766328361 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:24.300110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ace70a20-5eee-4fe8-ba20-202766328361 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:24.300553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ace70a20-5eee-4fe8-ba20-202766328361 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:24.300963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ace70a20-5eee-4fe8-ba20-202766328361 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:24.431280 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ace70a20-5eee-4fe8-ba20-202766328361 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:24.439363 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ace70a20-5eee-4fe8-ba20-202766328361 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151968 Aug 30 14:58:24.439923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 651/1291] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:24 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:25.461725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b5a1990a-7498-4508-9c6f-fe30a8774f4f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:25.462320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b5a1990a-7498-4508-9c6f-fe30a8774f4f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:25.468810 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5a1990a-7498-4508-9c6f-fe30a8774f4f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:25.469292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5a1990a-7498-4508-9c6f-fe30a8774f4f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:25.469728 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5a1990a-7498-4508-9c6f-fe30a8774f4f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:25.470417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5a1990a-7498-4508-9c6f-fe30a8774f4f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:25.470870 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5a1990a-7498-4508-9c6f-fe30a8774f4f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:25.471320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5a1990a-7498-4508-9c6f-fe30a8774f4f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:25.604062 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b5a1990a-7498-4508-9c6f-fe30a8774f4f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:25.612349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b5a1990a-7498-4508-9c6f-fe30a8774f4f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.155423 Aug 30 14:58:25.612913 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 641/1292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:25 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:26.634212 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bd7db855-1615-497a-8d17-b49114026987 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:26.634747 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bd7db855-1615-497a-8d17-b49114026987 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:26.641142 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd7db855-1615-497a-8d17-b49114026987 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:26.641619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd7db855-1615-497a-8d17-b49114026987 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:26.642051 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd7db855-1615-497a-8d17-b49114026987 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:26.642736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd7db855-1615-497a-8d17-b49114026987 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:26.643185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd7db855-1615-497a-8d17-b49114026987 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:26.643629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd7db855-1615-497a-8d17-b49114026987 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:26.779796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bd7db855-1615-497a-8d17-b49114026987 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:26.789181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bd7db855-1615-497a-8d17-b49114026987 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.159273 Aug 30 14:58:26.789757 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 652/1293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:26 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:27.809837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a8b11e16-9ee2-4ded-afe5-7050638d9717 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:27.810446 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a8b11e16-9ee2-4ded-afe5-7050638d9717 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:27.817031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8b11e16-9ee2-4ded-afe5-7050638d9717 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:27.817514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8b11e16-9ee2-4ded-afe5-7050638d9717 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:27.817944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8b11e16-9ee2-4ded-afe5-7050638d9717 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:27.819148 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8b11e16-9ee2-4ded-afe5-7050638d9717 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:27.819824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8b11e16-9ee2-4ded-afe5-7050638d9717 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:27.820308 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8b11e16-9ee2-4ded-afe5-7050638d9717 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:27.962458 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a8b11e16-9ee2-4ded-afe5-7050638d9717 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:27.970546 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a8b11e16-9ee2-4ded-afe5-7050638d9717 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.164531 Aug 30 14:58:27.971108 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 642/1294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:27 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:28.991423 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5cd2c5b6-ffbd-4991-a4ff-3c48e147aa34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:28.992035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5cd2c5b6-ffbd-4991-a4ff-3c48e147aa34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:28.998404 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cd2c5b6-ffbd-4991-a4ff-3c48e147aa34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:28.998878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cd2c5b6-ffbd-4991-a4ff-3c48e147aa34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:28.999337 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cd2c5b6-ffbd-4991-a4ff-3c48e147aa34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:29.000017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cd2c5b6-ffbd-4991-a4ff-3c48e147aa34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:29.000463 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cd2c5b6-ffbd-4991-a4ff-3c48e147aa34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:29.000879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5cd2c5b6-ffbd-4991-a4ff-3c48e147aa34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:29.128629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5cd2c5b6-ffbd-4991-a4ff-3c48e147aa34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:29.137427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5cd2c5b6-ffbd-4991-a4ff-3c48e147aa34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150079 Aug 30 14:58:29.138226 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 653/1295] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:28 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:30.159071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b41c9111-6846-4332-962f-7ec9b0141e9a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:30.159674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b41c9111-6846-4332-962f-7ec9b0141e9a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:30.166729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b41c9111-6846-4332-962f-7ec9b0141e9a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:30.167228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b41c9111-6846-4332-962f-7ec9b0141e9a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:30.167665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b41c9111-6846-4332-962f-7ec9b0141e9a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:30.168348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b41c9111-6846-4332-962f-7ec9b0141e9a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:30.168796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b41c9111-6846-4332-962f-7ec9b0141e9a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:30.169215 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b41c9111-6846-4332-962f-7ec9b0141e9a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:30.295573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b41c9111-6846-4332-962f-7ec9b0141e9a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:30.304168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b41c9111-6846-4332-962f-7ec9b0141e9a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149035 Aug 30 14:58:30.304726 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 643/1296] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:30 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:58:31.325785 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-52c644f0-70e1-403d-a354-41e3286df016 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:31.326433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-52c644f0-70e1-403d-a354-41e3286df016 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:31.332735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52c644f0-70e1-403d-a354-41e3286df016 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:31.333212 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52c644f0-70e1-403d-a354-41e3286df016 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:31.333646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52c644f0-70e1-403d-a354-41e3286df016 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:31.334363 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52c644f0-70e1-403d-a354-41e3286df016 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:31.334898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52c644f0-70e1-403d-a354-41e3286df016 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:31.335189 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52c644f0-70e1-403d-a354-41e3286df016 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:31.470036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-52c644f0-70e1-403d-a354-41e3286df016 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:31.478220 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-52c644f0-70e1-403d-a354-41e3286df016 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156403 Aug 30 14:58:31.478787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 654/1297] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:31 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:58:32.499777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-02da84f3-c7c5-4903-89d6-9483a13f3dba tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:32.500388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-02da84f3-c7c5-4903-89d6-9483a13f3dba tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:32.506685 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02da84f3-c7c5-4903-89d6-9483a13f3dba tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:32.507254 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02da84f3-c7c5-4903-89d6-9483a13f3dba tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:32.507684 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02da84f3-c7c5-4903-89d6-9483a13f3dba tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:32.508372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02da84f3-c7c5-4903-89d6-9483a13f3dba tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:32.508813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02da84f3-c7c5-4903-89d6-9483a13f3dba tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:32.509227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02da84f3-c7c5-4903-89d6-9483a13f3dba tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:32.512799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b5dfb0f5-c8d5-49e2-a5b5-ae9e31632c4e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:32.513366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b5dfb0f5-c8d5-49e2-a5b5-ae9e31632c4e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:32.519667 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5dfb0f5-c8d5-49e2-a5b5-ae9e31632c4e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:32.520151 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5dfb0f5-c8d5-49e2-a5b5-ae9e31632c4e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:32.520582 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5dfb0f5-c8d5-49e2-a5b5-ae9e31632c4e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:32.521266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5dfb0f5-c8d5-49e2-a5b5-ae9e31632c4e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:32.522218 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5dfb0f5-c8d5-49e2-a5b5-ae9e31632c4e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:32.522637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5dfb0f5-c8d5-49e2-a5b5-ae9e31632c4e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:32.549261 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b5dfb0f5-c8d5-49e2-a5b5-ae9e31632c4e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Going to try to terminate instance {{(pid=127089) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 14:58:32.629794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b5dfb0f5-c8d5-49e2-a5b5-ae9e31632c4e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "DELETE /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 204 len: 0 microversion: 2.20 time: 0.120290 Aug 30 14:58:32.630401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 655/1298] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 14:58:32 2022] DELETE /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 14:58:32.639879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0bd4d81a-0722-4ded-b9bd-945fc03d6db3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:32.640579 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0bd4d81a-0722-4ded-b9bd-945fc03d6db3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:32.646376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0bd4d81a-0722-4ded-b9bd-945fc03d6db3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:32.647076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-02da84f3-c7c5-4903-89d6-9483a13f3dba tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:32.647591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0bd4d81a-0722-4ded-b9bd-945fc03d6db3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:32.648223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0bd4d81a-0722-4ded-b9bd-945fc03d6db3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:32.648914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0bd4d81a-0722-4ded-b9bd-945fc03d6db3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:32.649362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0bd4d81a-0722-4ded-b9bd-945fc03d6db3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:32.649778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0bd4d81a-0722-4ded-b9bd-945fc03d6db3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:32.655379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-02da84f3-c7c5-4903-89d6-9483a13f3dba tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.159425 Aug 30 14:58:32.655947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 644/1299] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:32 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:32.777493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0bd4d81a-0722-4ded-b9bd-945fc03d6db3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:32.785929 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0bd4d81a-0722-4ded-b9bd-945fc03d6db3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:32.787554 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0bd4d81a-0722-4ded-b9bd-945fc03d6db3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:32.788908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0bd4d81a-0722-4ded-b9bd-945fc03d6db3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1799 microversion: 2.20 time: 0.153545 Aug 30 14:58:32.789464 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 656/1300] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:32 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1799 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:58:33.677034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-faffa218-9b59-4ad5-b82c-87d124a2a821 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:33.677648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-faffa218-9b59-4ad5-b82c-87d124a2a821 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:33.684921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faffa218-9b59-4ad5-b82c-87d124a2a821 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:33.685405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faffa218-9b59-4ad5-b82c-87d124a2a821 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:33.685838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faffa218-9b59-4ad5-b82c-87d124a2a821 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:33.686594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faffa218-9b59-4ad5-b82c-87d124a2a821 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:33.687055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faffa218-9b59-4ad5-b82c-87d124a2a821 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:33.687572 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faffa218-9b59-4ad5-b82c-87d124a2a821 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:33.812025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f755a95b-c721-4f7a-a4cf-bde546533f74 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:33.812733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f755a95b-c721-4f7a-a4cf-bde546533f74 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:33.819093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f755a95b-c721-4f7a-a4cf-bde546533f74 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:33.819687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f755a95b-c721-4f7a-a4cf-bde546533f74 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:33.820393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f755a95b-c721-4f7a-a4cf-bde546533f74 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:33.821101 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f755a95b-c721-4f7a-a4cf-bde546533f74 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:33.821656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f755a95b-c721-4f7a-a4cf-bde546533f74 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:33.821984 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f755a95b-c721-4f7a-a4cf-bde546533f74 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:33.902935 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-faffa218-9b59-4ad5-b82c-87d124a2a821 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:33.911307 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-faffa218-9b59-4ad5-b82c-87d124a2a821 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.238103 Aug 30 14:58:33.924005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 645/1301] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:33 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:33.960405 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f755a95b-c721-4f7a-a4cf-bde546533f74 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:33.969144 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f755a95b-c721-4f7a-a4cf-bde546533f74 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:33.970693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f755a95b-c721-4f7a-a4cf-bde546533f74 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:33.972111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f755a95b-c721-4f7a-a4cf-bde546533f74 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1799 microversion: 2.20 time: 0.164018 Aug 30 14:58:33.972928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 657/1302] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:33 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1799 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:58:34.291095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-e4363fc1-bde4-46be-972a-833ff9ece803 req-a34fd46c-f6f2-410e-97c2-59016a522cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df823286-f7fd-4dbf-acb5-7cd297f48da0", "name": "network-vif-deleted", "tag": "356c248c-dbd2-4ea8-93cc-dd834560932d"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 14:58:34.302583 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-e4363fc1-bde4-46be-972a-833ff9ece803 req-a34fd46c-f6f2-410e-97c2-59016a522cce service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:34.303750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-e4363fc1-bde4-46be-972a-833ff9ece803 req-a34fd46c-f6f2-410e-97c2-59016a522cce service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:34.304958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-e4363fc1-bde4-46be-972a-833ff9ece803 req-a34fd46c-f6f2-410e-97c2-59016a522cce service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:34.321002 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-e4363fc1-bde4-46be-972a-833ff9ece803 req-a34fd46c-f6f2-410e-97c2-59016a522cce service nova] Creating event network-vif-deleted:356c248c-dbd2-4ea8-93cc-dd834560932d for instance df823286-f7fd-4dbf-acb5-7cd297f48da0 on hv-cinder-82880 Aug 30 14:58:34.327981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-e4363fc1-bde4-46be-972a-833ff9ece803 req-a34fd46c-f6f2-410e-97c2-59016a522cce service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042009 Aug 30 14:58:34.328880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 646/1303] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 14:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 14:58:34.933552 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1c223c12-9032-4428-9ddd-5fb59da0b8df tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:34.934183 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1c223c12-9032-4428-9ddd-5fb59da0b8df tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:34.940837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1c223c12-9032-4428-9ddd-5fb59da0b8df tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:34.941325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1c223c12-9032-4428-9ddd-5fb59da0b8df tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:34.941756 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1c223c12-9032-4428-9ddd-5fb59da0b8df tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:34.942459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1c223c12-9032-4428-9ddd-5fb59da0b8df tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:34.942914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1c223c12-9032-4428-9ddd-5fb59da0b8df tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:34.944001 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1c223c12-9032-4428-9ddd-5fb59da0b8df tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:35.002881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a2730a9a-7e70-4ba9-9e95-38349df3d463 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:35.003726 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a2730a9a-7e70-4ba9-9e95-38349df3d463 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:35.016606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2730a9a-7e70-4ba9-9e95-38349df3d463 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:35.017186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2730a9a-7e70-4ba9-9e95-38349df3d463 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:35.017743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2730a9a-7e70-4ba9-9e95-38349df3d463 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:35.018521 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2730a9a-7e70-4ba9-9e95-38349df3d463 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:35.018977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2730a9a-7e70-4ba9-9e95-38349df3d463 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:35.019519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2730a9a-7e70-4ba9-9e95-38349df3d463 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:35.087239 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1c223c12-9032-4428-9ddd-5fb59da0b8df tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:35.089182 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a2730a9a-7e70-4ba9-9e95-38349df3d463 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:35.096565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1c223c12-9032-4428-9ddd-5fb59da0b8df tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.166884 Aug 30 14:58:35.097398 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 658/1304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:34 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:35.097968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a2730a9a-7e70-4ba9-9e95-38349df3d463 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:35.099501 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a2730a9a-7e70-4ba9-9e95-38349df3d463 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:35.101835 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a2730a9a-7e70-4ba9-9e95-38349df3d463 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.107722 Aug 30 14:58:35.102383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 647/1305] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:34 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:58:36.118560 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e35f0f1d-d5fb-496e-baaf-be04b0f03986 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:36.119200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e35f0f1d-d5fb-496e-baaf-be04b0f03986 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:36.124326 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f4ecc70f-a393-450f-a76a-e5e8d75f2c5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:36.124931 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f4ecc70f-a393-450f-a76a-e5e8d75f2c5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:36.125742 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e35f0f1d-d5fb-496e-baaf-be04b0f03986 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:36.126232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e35f0f1d-d5fb-496e-baaf-be04b0f03986 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:36.126666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e35f0f1d-d5fb-496e-baaf-be04b0f03986 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:36.127391 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e35f0f1d-d5fb-496e-baaf-be04b0f03986 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:36.127837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e35f0f1d-d5fb-496e-baaf-be04b0f03986 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:36.128251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e35f0f1d-d5fb-496e-baaf-be04b0f03986 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:36.131654 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4ecc70f-a393-450f-a76a-e5e8d75f2c5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:36.132416 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4ecc70f-a393-450f-a76a-e5e8d75f2c5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:36.132975 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4ecc70f-a393-450f-a76a-e5e8d75f2c5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:36.133656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4ecc70f-a393-450f-a76a-e5e8d75f2c5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:36.134099 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4ecc70f-a393-450f-a76a-e5e8d75f2c5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:36.134538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4ecc70f-a393-450f-a76a-e5e8d75f2c5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:36.196368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f4ecc70f-a393-450f-a76a-e5e8d75f2c5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:36.206146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f4ecc70f-a393-450f-a76a-e5e8d75f2c5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:36.207916 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f4ecc70f-a393-450f-a76a-e5e8d75f2c5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:36.210945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f4ecc70f-a393-450f-a76a-e5e8d75f2c5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088934 Aug 30 14:58:36.212231 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 648/1306] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:36 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:36.275114 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e35f0f1d-d5fb-496e-baaf-be04b0f03986 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:36.283297 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e35f0f1d-d5fb-496e-baaf-be04b0f03986 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.168656 Aug 30 14:58:36.283872 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 659/1307] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:36 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:37.233968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6f332a05-b88f-460a-9a8a-afc3ae4de298 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:37.234592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6f332a05-b88f-460a-9a8a-afc3ae4de298 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:37.241604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f332a05-b88f-460a-9a8a-afc3ae4de298 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:37.242075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f332a05-b88f-460a-9a8a-afc3ae4de298 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:37.242503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f332a05-b88f-460a-9a8a-afc3ae4de298 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:37.243177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f332a05-b88f-460a-9a8a-afc3ae4de298 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:37.243642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f332a05-b88f-460a-9a8a-afc3ae4de298 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:37.244056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f332a05-b88f-460a-9a8a-afc3ae4de298 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:37.304729 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b42464ce-5044-459b-bbb0-bed92e74c3a2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:37.305478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b42464ce-5044-459b-bbb0-bed92e74c3a2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:37.305675 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6f332a05-b88f-460a-9a8a-afc3ae4de298 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:37.311878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b42464ce-5044-459b-bbb0-bed92e74c3a2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:37.312352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b42464ce-5044-459b-bbb0-bed92e74c3a2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:37.312781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b42464ce-5044-459b-bbb0-bed92e74c3a2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:37.313469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b42464ce-5044-459b-bbb0-bed92e74c3a2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:37.313912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b42464ce-5044-459b-bbb0-bed92e74c3a2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:37.314230 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6f332a05-b88f-460a-9a8a-afc3ae4de298 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:37.314384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b42464ce-5044-459b-bbb0-bed92e74c3a2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:37.315742 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6f332a05-b88f-460a-9a8a-afc3ae4de298 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:37.316895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6f332a05-b88f-460a-9a8a-afc3ae4de298 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086813 Aug 30 14:58:37.317454 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 649/1308] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:37 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:37.662706 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b42464ce-5044-459b-bbb0-bed92e74c3a2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:37.670670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b42464ce-5044-459b-bbb0-bed92e74c3a2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.370399 Aug 30 14:58:37.671244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 660/1309] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:37 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:58:38.340984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d6d193c1-b4ab-4ca4-a49d-f583026bf374 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:38.341627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d6d193c1-b4ab-4ca4-a49d-f583026bf374 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:38.348143 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d6d193c1-b4ab-4ca4-a49d-f583026bf374 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:38.348618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d6d193c1-b4ab-4ca4-a49d-f583026bf374 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:38.349047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d6d193c1-b4ab-4ca4-a49d-f583026bf374 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:38.350290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d6d193c1-b4ab-4ca4-a49d-f583026bf374 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:38.350932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d6d193c1-b4ab-4ca4-a49d-f583026bf374 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:38.351391 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d6d193c1-b4ab-4ca4-a49d-f583026bf374 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:38.410559 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d6d193c1-b4ab-4ca4-a49d-f583026bf374 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:38.419680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d6d193c1-b4ab-4ca4-a49d-f583026bf374 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:38.421122 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d6d193c1-b4ab-4ca4-a49d-f583026bf374 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:38.422258 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d6d193c1-b4ab-4ca4-a49d-f583026bf374 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085191 Aug 30 14:58:38.422841 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 650/1310] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:38 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:38.692615 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d29db8d7-e4cd-4618-abd4-5dc2ff76cb72 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:38.693753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d29db8d7-e4cd-4618-abd4-5dc2ff76cb72 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:38.700393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d29db8d7-e4cd-4618-abd4-5dc2ff76cb72 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:38.700869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d29db8d7-e4cd-4618-abd4-5dc2ff76cb72 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:38.701292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d29db8d7-e4cd-4618-abd4-5dc2ff76cb72 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:38.701968 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d29db8d7-e4cd-4618-abd4-5dc2ff76cb72 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:38.702409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d29db8d7-e4cd-4618-abd4-5dc2ff76cb72 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:38.702824 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d29db8d7-e4cd-4618-abd4-5dc2ff76cb72 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:38.706800 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:38.830282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d29db8d7-e4cd-4618-abd4-5dc2ff76cb72 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:38.838603 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d29db8d7-e4cd-4618-abd4-5dc2ff76cb72 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149971 Aug 30 14:58:38.839164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 661/1311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:38 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:39.446241 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a1bf279b-1667-44bb-9677-c6f36df78e63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:39.446807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a1bf279b-1667-44bb-9677-c6f36df78e63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:39.453154 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1bf279b-1667-44bb-9677-c6f36df78e63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:39.453624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1bf279b-1667-44bb-9677-c6f36df78e63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:39.454048 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1bf279b-1667-44bb-9677-c6f36df78e63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:39.454718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1bf279b-1667-44bb-9677-c6f36df78e63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:39.455160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1bf279b-1667-44bb-9677-c6f36df78e63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:39.455598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1bf279b-1667-44bb-9677-c6f36df78e63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:39.518630 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a1bf279b-1667-44bb-9677-c6f36df78e63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:39.527834 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a1bf279b-1667-44bb-9677-c6f36df78e63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:39.529283 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a1bf279b-1667-44bb-9677-c6f36df78e63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:39.530437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a1bf279b-1667-44bb-9677-c6f36df78e63 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089203 Aug 30 14:58:39.530984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 651/1312] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:39 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:39.860097 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-971a9984-033a-4578-86ef-448d272abcb5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:39.860715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-971a9984-033a-4578-86ef-448d272abcb5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:39.867865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-971a9984-033a-4578-86ef-448d272abcb5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:39.868346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-971a9984-033a-4578-86ef-448d272abcb5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:39.868784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-971a9984-033a-4578-86ef-448d272abcb5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:39.869476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-971a9984-033a-4578-86ef-448d272abcb5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:39.869929 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-971a9984-033a-4578-86ef-448d272abcb5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:39.870355 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-971a9984-033a-4578-86ef-448d272abcb5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:39.999064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-971a9984-033a-4578-86ef-448d272abcb5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:40.007502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-971a9984-033a-4578-86ef-448d272abcb5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151323 Aug 30 14:58:40.008067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 662/1313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:39 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:40.553724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-384b8203-4d1d-4231-afe9-410b3bac9d70 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:40.554246 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-384b8203-4d1d-4231-afe9-410b3bac9d70 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:40.561048 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-384b8203-4d1d-4231-afe9-410b3bac9d70 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:40.561524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-384b8203-4d1d-4231-afe9-410b3bac9d70 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:40.561954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-384b8203-4d1d-4231-afe9-410b3bac9d70 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:40.562637 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-384b8203-4d1d-4231-afe9-410b3bac9d70 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:40.563079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-384b8203-4d1d-4231-afe9-410b3bac9d70 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:40.563518 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-384b8203-4d1d-4231-afe9-410b3bac9d70 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:40.629677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-384b8203-4d1d-4231-afe9-410b3bac9d70 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:40.638708 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-384b8203-4d1d-4231-afe9-410b3bac9d70 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:40.640184 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-384b8203-4d1d-4231-afe9-410b3bac9d70 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:40.641312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-384b8203-4d1d-4231-afe9-410b3bac9d70 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.092048 Aug 30 14:58:40.641857 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 652/1314] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:40 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:41.028562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a6b801ba-10b1-4fdd-ae5c-95d564a71462 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:41.029186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a6b801ba-10b1-4fdd-ae5c-95d564a71462 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:41.035495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a6b801ba-10b1-4fdd-ae5c-95d564a71462 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:41.035979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a6b801ba-10b1-4fdd-ae5c-95d564a71462 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:41.036411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a6b801ba-10b1-4fdd-ae5c-95d564a71462 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:41.037102 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a6b801ba-10b1-4fdd-ae5c-95d564a71462 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:41.037551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a6b801ba-10b1-4fdd-ae5c-95d564a71462 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:41.037973 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a6b801ba-10b1-4fdd-ae5c-95d564a71462 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:41.163625 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a6b801ba-10b1-4fdd-ae5c-95d564a71462 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:41.171787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a6b801ba-10b1-4fdd-ae5c-95d564a71462 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147172 Aug 30 14:58:41.172350 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 663/1315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:41 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:41.664939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-831ee6ef-5be8-42e7-ac24-7e31cb8a8071 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:41.665548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-831ee6ef-5be8-42e7-ac24-7e31cb8a8071 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:41.671889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-831ee6ef-5be8-42e7-ac24-7e31cb8a8071 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:41.672364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-831ee6ef-5be8-42e7-ac24-7e31cb8a8071 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:41.672794 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-831ee6ef-5be8-42e7-ac24-7e31cb8a8071 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:41.673472 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-831ee6ef-5be8-42e7-ac24-7e31cb8a8071 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:41.673919 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-831ee6ef-5be8-42e7-ac24-7e31cb8a8071 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:41.674343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-831ee6ef-5be8-42e7-ac24-7e31cb8a8071 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:41.734716 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-831ee6ef-5be8-42e7-ac24-7e31cb8a8071 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:41.743951 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-831ee6ef-5be8-42e7-ac24-7e31cb8a8071 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:41.745453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-831ee6ef-5be8-42e7-ac24-7e31cb8a8071 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:41.746604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-831ee6ef-5be8-42e7-ac24-7e31cb8a8071 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086217 Aug 30 14:58:41.747151 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 653/1316] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:41 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:58:42.193608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-dff18a7d-a91b-4765-8f2b-8ac55781fadf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:42.194330 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-dff18a7d-a91b-4765-8f2b-8ac55781fadf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:42.200995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dff18a7d-a91b-4765-8f2b-8ac55781fadf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:42.201479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dff18a7d-a91b-4765-8f2b-8ac55781fadf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:42.201913 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dff18a7d-a91b-4765-8f2b-8ac55781fadf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:42.202603 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dff18a7d-a91b-4765-8f2b-8ac55781fadf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:42.203084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dff18a7d-a91b-4765-8f2b-8ac55781fadf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:42.203541 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dff18a7d-a91b-4765-8f2b-8ac55781fadf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:42.332353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-dff18a7d-a91b-4765-8f2b-8ac55781fadf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:42.341173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-dff18a7d-a91b-4765-8f2b-8ac55781fadf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151996 Aug 30 14:58:42.341737 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 664/1317] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:42 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:42.769459 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c0d1a0fd-ebdd-4e98-a156-1617d7a000ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:42.770069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c0d1a0fd-ebdd-4e98-a156-1617d7a000ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:42.776535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0d1a0fd-ebdd-4e98-a156-1617d7a000ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:42.777011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0d1a0fd-ebdd-4e98-a156-1617d7a000ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:42.777440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0d1a0fd-ebdd-4e98-a156-1617d7a000ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:42.778122 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0d1a0fd-ebdd-4e98-a156-1617d7a000ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:42.778568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0d1a0fd-ebdd-4e98-a156-1617d7a000ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:42.778984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0d1a0fd-ebdd-4e98-a156-1617d7a000ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:42.839294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0d1a0fd-ebdd-4e98-a156-1617d7a000ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:42.847987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0d1a0fd-ebdd-4e98-a156-1617d7a000ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:42.849870 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0d1a0fd-ebdd-4e98-a156-1617d7a000ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:42.851018 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c0d1a0fd-ebdd-4e98-a156-1617d7a000ee tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085522 Aug 30 14:58:42.851597 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 654/1318] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:42 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:43.361925 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e8074be1-360e-4b81-bf1f-2d634cabbed6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:43.362516 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e8074be1-360e-4b81-bf1f-2d634cabbed6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:43.369258 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e8074be1-360e-4b81-bf1f-2d634cabbed6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:43.369734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e8074be1-360e-4b81-bf1f-2d634cabbed6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:43.370161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e8074be1-360e-4b81-bf1f-2d634cabbed6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:43.370842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e8074be1-360e-4b81-bf1f-2d634cabbed6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:43.371313 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e8074be1-360e-4b81-bf1f-2d634cabbed6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:43.371740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e8074be1-360e-4b81-bf1f-2d634cabbed6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:43.499729 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e8074be1-360e-4b81-bf1f-2d634cabbed6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:43.507888 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e8074be1-360e-4b81-bf1f-2d634cabbed6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149822 Aug 30 14:58:43.508455 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 665/1319] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:43 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:43.874657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7face811-4bda-4c0c-8a89-4bfcf380da82 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:43.875294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7face811-4bda-4c0c-8a89-4bfcf380da82 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:43.882288 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7face811-4bda-4c0c-8a89-4bfcf380da82 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:43.882764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7face811-4bda-4c0c-8a89-4bfcf380da82 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:43.883195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7face811-4bda-4c0c-8a89-4bfcf380da82 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:43.883912 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7face811-4bda-4c0c-8a89-4bfcf380da82 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:43.884359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7face811-4bda-4c0c-8a89-4bfcf380da82 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:43.884782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7face811-4bda-4c0c-8a89-4bfcf380da82 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:43.888845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:43.948241 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7face811-4bda-4c0c-8a89-4bfcf380da82 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:43.957009 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7face811-4bda-4c0c-8a89-4bfcf380da82 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:43.958466 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7face811-4bda-4c0c-8a89-4bfcf380da82 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:43.960329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7face811-4bda-4c0c-8a89-4bfcf380da82 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089606 Aug 30 14:58:43.960886 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 655/1320] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:43 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:44.528563 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b6c1dc44-0073-400c-b37f-fbdd07bba6ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:44.529091 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b6c1dc44-0073-400c-b37f-fbdd07bba6ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:44.535432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6c1dc44-0073-400c-b37f-fbdd07bba6ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:44.535908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6c1dc44-0073-400c-b37f-fbdd07bba6ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:44.536338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6c1dc44-0073-400c-b37f-fbdd07bba6ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:44.537528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6c1dc44-0073-400c-b37f-fbdd07bba6ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:44.537969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6c1dc44-0073-400c-b37f-fbdd07bba6ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:44.538387 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6c1dc44-0073-400c-b37f-fbdd07bba6ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:44.667849 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b6c1dc44-0073-400c-b37f-fbdd07bba6ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:44.675805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b6c1dc44-0073-400c-b37f-fbdd07bba6ff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151225 Aug 30 14:58:44.676356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 666/1321] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:44 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:44.982304 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0a328cd3-19c9-4914-81f5-8f97dc9f246d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:44.982911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0a328cd3-19c9-4914-81f5-8f97dc9f246d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:44.989260 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a328cd3-19c9-4914-81f5-8f97dc9f246d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:44.989729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a328cd3-19c9-4914-81f5-8f97dc9f246d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:44.990666 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a328cd3-19c9-4914-81f5-8f97dc9f246d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:44.991396 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a328cd3-19c9-4914-81f5-8f97dc9f246d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:44.991843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a328cd3-19c9-4914-81f5-8f97dc9f246d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:44.992258 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a328cd3-19c9-4914-81f5-8f97dc9f246d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:45.051702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0a328cd3-19c9-4914-81f5-8f97dc9f246d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:45.060657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0a328cd3-19c9-4914-81f5-8f97dc9f246d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:45.062075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0a328cd3-19c9-4914-81f5-8f97dc9f246d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:45.063202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0a328cd3-19c9-4914-81f5-8f97dc9f246d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084776 Aug 30 14:58:45.063780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 656/1322] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:44 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:45.696736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8442104e-5d56-4637-832f-9286e8774b4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:45.697352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8442104e-5d56-4637-832f-9286e8774b4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:45.703942 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8442104e-5d56-4637-832f-9286e8774b4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:45.704427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8442104e-5d56-4637-832f-9286e8774b4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:45.704864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8442104e-5d56-4637-832f-9286e8774b4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:45.705670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8442104e-5d56-4637-832f-9286e8774b4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:45.706150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8442104e-5d56-4637-832f-9286e8774b4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:45.706574 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8442104e-5d56-4637-832f-9286e8774b4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:45.834567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8442104e-5d56-4637-832f-9286e8774b4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:45.843198 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8442104e-5d56-4637-832f-9286e8774b4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150598 Aug 30 14:58:45.843843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 667/1323] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:45 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:46.087149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-98cd90a8-a91b-4bc5-b518-d2fc6c62fc15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:46.087791 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-98cd90a8-a91b-4bc5-b518-d2fc6c62fc15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:46.094055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98cd90a8-a91b-4bc5-b518-d2fc6c62fc15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:46.094528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98cd90a8-a91b-4bc5-b518-d2fc6c62fc15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:46.094953 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98cd90a8-a91b-4bc5-b518-d2fc6c62fc15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:46.095656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98cd90a8-a91b-4bc5-b518-d2fc6c62fc15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:46.096101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98cd90a8-a91b-4bc5-b518-d2fc6c62fc15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:46.096516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-98cd90a8-a91b-4bc5-b518-d2fc6c62fc15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:46.157929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-98cd90a8-a91b-4bc5-b518-d2fc6c62fc15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:46.166924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-98cd90a8-a91b-4bc5-b518-d2fc6c62fc15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:46.168648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-98cd90a8-a91b-4bc5-b518-d2fc6c62fc15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:46.169787 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-98cd90a8-a91b-4bc5-b518-d2fc6c62fc15 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087818 Aug 30 14:58:46.170333 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 657/1324] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:46 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:46.867393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fcf66ae9-9c0a-4b8e-a80e-c4be63b8c752 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:46.868011 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fcf66ae9-9c0a-4b8e-a80e-c4be63b8c752 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:46.874342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fcf66ae9-9c0a-4b8e-a80e-c4be63b8c752 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:46.874812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fcf66ae9-9c0a-4b8e-a80e-c4be63b8c752 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:46.875289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fcf66ae9-9c0a-4b8e-a80e-c4be63b8c752 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:46.875978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fcf66ae9-9c0a-4b8e-a80e-c4be63b8c752 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:46.876421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fcf66ae9-9c0a-4b8e-a80e-c4be63b8c752 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:46.876833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fcf66ae9-9c0a-4b8e-a80e-c4be63b8c752 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:47.003025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fcf66ae9-9c0a-4b8e-a80e-c4be63b8c752 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:47.011303 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fcf66ae9-9c0a-4b8e-a80e-c4be63b8c752 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148728 Aug 30 14:58:47.011866 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 668/1325] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:46 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:47.192487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-acf6479d-929b-48b9-b9c1-40072ea3b3bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:47.193323 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-acf6479d-929b-48b9-b9c1-40072ea3b3bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:47.200436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acf6479d-929b-48b9-b9c1-40072ea3b3bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:47.200947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acf6479d-929b-48b9-b9c1-40072ea3b3bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:47.201377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acf6479d-929b-48b9-b9c1-40072ea3b3bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:47.202064 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acf6479d-929b-48b9-b9c1-40072ea3b3bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:47.202507 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acf6479d-929b-48b9-b9c1-40072ea3b3bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:47.202922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-acf6479d-929b-48b9-b9c1-40072ea3b3bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:47.265453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-acf6479d-929b-48b9-b9c1-40072ea3b3bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:47.274516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-acf6479d-929b-48b9-b9c1-40072ea3b3bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:47.275985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-acf6479d-929b-48b9-b9c1-40072ea3b3bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:47.277116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-acf6479d-929b-48b9-b9c1-40072ea3b3bd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088543 Aug 30 14:58:47.277661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 658/1326] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:47 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:48.032795 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cae35d2e-a402-4965-a11c-7eec3d6f28de tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:48.033412 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cae35d2e-a402-4965-a11c-7eec3d6f28de tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:48.039866 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cae35d2e-a402-4965-a11c-7eec3d6f28de tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:48.040344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cae35d2e-a402-4965-a11c-7eec3d6f28de tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:48.040784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cae35d2e-a402-4965-a11c-7eec3d6f28de tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:48.041474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cae35d2e-a402-4965-a11c-7eec3d6f28de tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:48.041927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cae35d2e-a402-4965-a11c-7eec3d6f28de tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:48.042355 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cae35d2e-a402-4965-a11c-7eec3d6f28de tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:48.172946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cae35d2e-a402-4965-a11c-7eec3d6f28de tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:48.181641 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cae35d2e-a402-4965-a11c-7eec3d6f28de tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152740 Aug 30 14:58:48.182201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 669/1327] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:48 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:48.300411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-16403e6e-5a51-4e0e-9791-af117a519a44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:48.300935 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-16403e6e-5a51-4e0e-9791-af117a519a44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:48.308116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16403e6e-5a51-4e0e-9791-af117a519a44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:48.308599 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16403e6e-5a51-4e0e-9791-af117a519a44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:48.309034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16403e6e-5a51-4e0e-9791-af117a519a44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:48.309724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16403e6e-5a51-4e0e-9791-af117a519a44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:48.310205 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16403e6e-5a51-4e0e-9791-af117a519a44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:48.310629 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16403e6e-5a51-4e0e-9791-af117a519a44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:48.372776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-16403e6e-5a51-4e0e-9791-af117a519a44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:48.381447 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-16403e6e-5a51-4e0e-9791-af117a519a44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:48.382935 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-16403e6e-5a51-4e0e-9791-af117a519a44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:48.384117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-16403e6e-5a51-4e0e-9791-af117a519a44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087783 Aug 30 14:58:48.384677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 659/1328] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:48 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:58:49.203539 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-80baefc8-5bfa-4238-acd0-47a3460b9687 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:49.204152 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-80baefc8-5bfa-4238-acd0-47a3460b9687 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:49.206506 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:49.213092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-80baefc8-5bfa-4238-acd0-47a3460b9687 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:49.213092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-80baefc8-5bfa-4238-acd0-47a3460b9687 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:49.213421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-80baefc8-5bfa-4238-acd0-47a3460b9687 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:49.214118 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-80baefc8-5bfa-4238-acd0-47a3460b9687 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:49.214563 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-80baefc8-5bfa-4238-acd0-47a3460b9687 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:49.214981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-80baefc8-5bfa-4238-acd0-47a3460b9687 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:49.342068 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-80baefc8-5bfa-4238-acd0-47a3460b9687 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:49.350125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-80baefc8-5bfa-4238-acd0-47a3460b9687 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150604 Aug 30 14:58:49.350690 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 670/1329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:49 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:49.406315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9b04610b-1e70-47a8-b03a-5f377c6d6f49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:49.406917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9b04610b-1e70-47a8-b03a-5f377c6d6f49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:49.409177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=45 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:49.414604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b04610b-1e70-47a8-b03a-5f377c6d6f49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:49.415079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b04610b-1e70-47a8-b03a-5f377c6d6f49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:49.415536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b04610b-1e70-47a8-b03a-5f377c6d6f49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:49.416216 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b04610b-1e70-47a8-b03a-5f377c6d6f49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:49.416655 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b04610b-1e70-47a8-b03a-5f377c6d6f49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:49.417066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b04610b-1e70-47a8-b03a-5f377c6d6f49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:49.480970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b04610b-1e70-47a8-b03a-5f377c6d6f49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:49.489361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b04610b-1e70-47a8-b03a-5f377c6d6f49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:49.491371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b04610b-1e70-47a8-b03a-5f377c6d6f49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:49.492503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9b04610b-1e70-47a8-b03a-5f377c6d6f49 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090422 Aug 30 14:58:49.493057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 660/1330] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:49 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:50.371192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0b051176-d73c-42ae-a85e-4e98e25cb16b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:50.371817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0b051176-d73c-42ae-a85e-4e98e25cb16b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:50.378257 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b051176-d73c-42ae-a85e-4e98e25cb16b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:50.378733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b051176-d73c-42ae-a85e-4e98e25cb16b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:50.379160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b051176-d73c-42ae-a85e-4e98e25cb16b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:50.379879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b051176-d73c-42ae-a85e-4e98e25cb16b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:50.380340 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b051176-d73c-42ae-a85e-4e98e25cb16b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:50.381885 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b051176-d73c-42ae-a85e-4e98e25cb16b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:50.514106 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0b051176-d73c-42ae-a85e-4e98e25cb16b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:50.516007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-da06bc82-0744-4c3c-bda2-9a7046ad8ee4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:50.516708 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-da06bc82-0744-4c3c-bda2-9a7046ad8ee4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:50.522996 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0b051176-d73c-42ae-a85e-4e98e25cb16b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.155640 Aug 30 14:58:50.523602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 671/1331] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:50 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:50.524150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da06bc82-0744-4c3c-bda2-9a7046ad8ee4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:50.524628 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da06bc82-0744-4c3c-bda2-9a7046ad8ee4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:50.525056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da06bc82-0744-4c3c-bda2-9a7046ad8ee4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:50.525741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da06bc82-0744-4c3c-bda2-9a7046ad8ee4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:50.526193 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da06bc82-0744-4c3c-bda2-9a7046ad8ee4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:50.526607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da06bc82-0744-4c3c-bda2-9a7046ad8ee4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:50.592423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-da06bc82-0744-4c3c-bda2-9a7046ad8ee4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:50.600931 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-da06bc82-0744-4c3c-bda2-9a7046ad8ee4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:50.602348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-da06bc82-0744-4c3c-bda2-9a7046ad8ee4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:50.603517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-da06bc82-0744-4c3c-bda2-9a7046ad8ee4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091404 Aug 30 14:58:50.604098 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 661/1332] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:50 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:51.543939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-18bd1ff8-b220-4879-a602-8869a629211e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:51.544479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-18bd1ff8-b220-4879-a602-8869a629211e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:51.550847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-18bd1ff8-b220-4879-a602-8869a629211e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:51.551360 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-18bd1ff8-b220-4879-a602-8869a629211e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:51.551817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-18bd1ff8-b220-4879-a602-8869a629211e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:51.552557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-18bd1ff8-b220-4879-a602-8869a629211e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:51.553004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-18bd1ff8-b220-4879-a602-8869a629211e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:51.553422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-18bd1ff8-b220-4879-a602-8869a629211e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:51.626121 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-47db69de-d443-4b54-ad18-0f9ac2c39648 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:51.626726 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-47db69de-d443-4b54-ad18-0f9ac2c39648 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:51.633060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47db69de-d443-4b54-ad18-0f9ac2c39648 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:51.633538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47db69de-d443-4b54-ad18-0f9ac2c39648 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:51.633966 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47db69de-d443-4b54-ad18-0f9ac2c39648 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:51.634647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47db69de-d443-4b54-ad18-0f9ac2c39648 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:51.635093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47db69de-d443-4b54-ad18-0f9ac2c39648 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:51.635534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-47db69de-d443-4b54-ad18-0f9ac2c39648 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:51.682777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-18bd1ff8-b220-4879-a602-8869a629211e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:51.690921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-18bd1ff8-b220-4879-a602-8869a629211e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150917 Aug 30 14:58:51.691509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 672/1333] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:51 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:51.697183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-47db69de-d443-4b54-ad18-0f9ac2c39648 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:51.705662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-47db69de-d443-4b54-ad18-0f9ac2c39648 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:51.707086 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-47db69de-d443-4b54-ad18-0f9ac2c39648 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:51.708243 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-47db69de-d443-4b54-ad18-0f9ac2c39648 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086218 Aug 30 14:58:51.709509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 662/1334] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:51 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:58:52.712425 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-044eb6a9-fb59-4bb4-9719-046331641c34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:52.713037 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-044eb6a9-fb59-4bb4-9719-046331641c34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:52.719424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-044eb6a9-fb59-4bb4-9719-046331641c34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:52.719904 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-044eb6a9-fb59-4bb4-9719-046331641c34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:52.720334 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-044eb6a9-fb59-4bb4-9719-046331641c34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:52.721018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-044eb6a9-fb59-4bb4-9719-046331641c34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:52.721466 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-044eb6a9-fb59-4bb4-9719-046331641c34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:52.721885 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-044eb6a9-fb59-4bb4-9719-046331641c34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:52.730836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d2ec6956-73ee-415d-99f0-b5e2f99c7027 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:52.731475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d2ec6956-73ee-415d-99f0-b5e2f99c7027 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:52.737751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2ec6956-73ee-415d-99f0-b5e2f99c7027 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:52.738222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2ec6956-73ee-415d-99f0-b5e2f99c7027 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:52.738646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2ec6956-73ee-415d-99f0-b5e2f99c7027 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:52.739356 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2ec6956-73ee-415d-99f0-b5e2f99c7027 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:52.740500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2ec6956-73ee-415d-99f0-b5e2f99c7027 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:52.740931 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2ec6956-73ee-415d-99f0-b5e2f99c7027 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:52.803142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d2ec6956-73ee-415d-99f0-b5e2f99c7027 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:52.812140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d2ec6956-73ee-415d-99f0-b5e2f99c7027 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:52.813611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d2ec6956-73ee-415d-99f0-b5e2f99c7027 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:52.814748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d2ec6956-73ee-415d-99f0-b5e2f99c7027 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087765 Aug 30 14:58:52.815327 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 663/1335] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:52 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:58:52.852446 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-044eb6a9-fb59-4bb4-9719-046331641c34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:52.860706 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-044eb6a9-fb59-4bb4-9719-046331641c34 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152212 Aug 30 14:58:52.861282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 673/1336] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:52 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:53.838111 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-70e2f766-6399-489c-886a-5c8b53df8336 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:53.838732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-70e2f766-6399-489c-886a-5c8b53df8336 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:53.845253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70e2f766-6399-489c-886a-5c8b53df8336 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:53.845744 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70e2f766-6399-489c-886a-5c8b53df8336 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:53.846176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70e2f766-6399-489c-886a-5c8b53df8336 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:53.846869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70e2f766-6399-489c-886a-5c8b53df8336 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:53.847344 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70e2f766-6399-489c-886a-5c8b53df8336 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:53.847768 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70e2f766-6399-489c-886a-5c8b53df8336 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:53.882100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-15db8338-7dc6-4518-bc61-18c94ea443eb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:53.882706 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-15db8338-7dc6-4518-bc61-18c94ea443eb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:53.889397 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-15db8338-7dc6-4518-bc61-18c94ea443eb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:53.889883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-15db8338-7dc6-4518-bc61-18c94ea443eb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:53.890317 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-15db8338-7dc6-4518-bc61-18c94ea443eb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:53.891013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-15db8338-7dc6-4518-bc61-18c94ea443eb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:53.891488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-15db8338-7dc6-4518-bc61-18c94ea443eb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:53.891906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-15db8338-7dc6-4518-bc61-18c94ea443eb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:53.911463 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-70e2f766-6399-489c-886a-5c8b53df8336 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:53.920890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-70e2f766-6399-489c-886a-5c8b53df8336 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:53.922324 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-70e2f766-6399-489c-886a-5c8b53df8336 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:53.923508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-70e2f766-6399-489c-886a-5c8b53df8336 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089760 Aug 30 14:58:53.924069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 664/1337] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:53 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:54.025908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-15db8338-7dc6-4518-bc61-18c94ea443eb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:54.034019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-15db8338-7dc6-4518-bc61-18c94ea443eb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.155762 Aug 30 14:58:54.034585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 674/1338] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:53 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:58:54.946375 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b0ec375f-afe7-4809-bb80-26e04abd3053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:54.946983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b0ec375f-afe7-4809-bb80-26e04abd3053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:54.953409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0ec375f-afe7-4809-bb80-26e04abd3053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:54.953890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0ec375f-afe7-4809-bb80-26e04abd3053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:54.954325 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0ec375f-afe7-4809-bb80-26e04abd3053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:54.955014 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0ec375f-afe7-4809-bb80-26e04abd3053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:54.955496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0ec375f-afe7-4809-bb80-26e04abd3053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:54.955923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0ec375f-afe7-4809-bb80-26e04abd3053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:55.016660 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b0ec375f-afe7-4809-bb80-26e04abd3053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:55.025519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b0ec375f-afe7-4809-bb80-26e04abd3053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:55.026949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b0ec375f-afe7-4809-bb80-26e04abd3053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:55.028144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b0ec375f-afe7-4809-bb80-26e04abd3053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086090 Aug 30 14:58:55.028705 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 665/1339] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:54 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:55.056497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-58d92ddc-292f-4a03-a35f-36554ebe69c1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:55.057101 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-58d92ddc-292f-4a03-a35f-36554ebe69c1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:55.063384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-58d92ddc-292f-4a03-a35f-36554ebe69c1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:55.063857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-58d92ddc-292f-4a03-a35f-36554ebe69c1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:55.064281 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-58d92ddc-292f-4a03-a35f-36554ebe69c1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:55.064958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-58d92ddc-292f-4a03-a35f-36554ebe69c1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:55.065413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-58d92ddc-292f-4a03-a35f-36554ebe69c1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:55.065812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-58d92ddc-292f-4a03-a35f-36554ebe69c1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:55.194102 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-58d92ddc-292f-4a03-a35f-36554ebe69c1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:55.202514 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-58d92ddc-292f-4a03-a35f-36554ebe69c1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150662 Aug 30 14:58:55.203077 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 675/1340] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:55 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:56.051035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2bf721b4-3dcb-4b59-a62a-7aa630fa3e8e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:56.051651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2bf721b4-3dcb-4b59-a62a-7aa630fa3e8e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:56.058444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bf721b4-3dcb-4b59-a62a-7aa630fa3e8e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:56.058920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bf721b4-3dcb-4b59-a62a-7aa630fa3e8e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:56.059404 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bf721b4-3dcb-4b59-a62a-7aa630fa3e8e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:56.060111 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bf721b4-3dcb-4b59-a62a-7aa630fa3e8e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:56.060565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bf721b4-3dcb-4b59-a62a-7aa630fa3e8e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:56.060980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bf721b4-3dcb-4b59-a62a-7aa630fa3e8e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:56.123943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2bf721b4-3dcb-4b59-a62a-7aa630fa3e8e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:56.133328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2bf721b4-3dcb-4b59-a62a-7aa630fa3e8e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:56.134756 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2bf721b4-3dcb-4b59-a62a-7aa630fa3e8e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:56.135937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2bf721b4-3dcb-4b59-a62a-7aa630fa3e8e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088767 Aug 30 14:58:56.136492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 666/1341] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:56 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:56.223733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a3a5c3e2-f01c-4449-b7a2-1760f876af16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:56.224346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a3a5c3e2-f01c-4449-b7a2-1760f876af16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:56.230820 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a3a5c3e2-f01c-4449-b7a2-1760f876af16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:56.231323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a3a5c3e2-f01c-4449-b7a2-1760f876af16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:56.231755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a3a5c3e2-f01c-4449-b7a2-1760f876af16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:56.232436 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a3a5c3e2-f01c-4449-b7a2-1760f876af16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:56.232883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a3a5c3e2-f01c-4449-b7a2-1760f876af16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:56.233296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a3a5c3e2-f01c-4449-b7a2-1760f876af16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:56.364037 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a3a5c3e2-f01c-4449-b7a2-1760f876af16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:56.372298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a3a5c3e2-f01c-4449-b7a2-1760f876af16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152489 Aug 30 14:58:56.372859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 676/1342] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:56 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:57.159134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3b6e9266-644b-4c39-938c-79f1b81e0e9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:57.159770 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3b6e9266-644b-4c39-938c-79f1b81e0e9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:57.166662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b6e9266-644b-4c39-938c-79f1b81e0e9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:57.167140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b6e9266-644b-4c39-938c-79f1b81e0e9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:57.167598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b6e9266-644b-4c39-938c-79f1b81e0e9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:57.168279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b6e9266-644b-4c39-938c-79f1b81e0e9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:57.168729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b6e9266-644b-4c39-938c-79f1b81e0e9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:57.169146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3b6e9266-644b-4c39-938c-79f1b81e0e9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:57.230284 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3b6e9266-644b-4c39-938c-79f1b81e0e9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:57.238798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3b6e9266-644b-4c39-938c-79f1b81e0e9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:57.240274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3b6e9266-644b-4c39-938c-79f1b81e0e9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:57.242096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3b6e9266-644b-4c39-938c-79f1b81e0e9a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086834 Aug 30 14:58:57.242695 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 667/1343] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:57 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:57.393892 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e15db980-df9f-4bfc-8c96-4e6e23c5998f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:57.394505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e15db980-df9f-4bfc-8c96-4e6e23c5998f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:57.400898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e15db980-df9f-4bfc-8c96-4e6e23c5998f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:57.401385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e15db980-df9f-4bfc-8c96-4e6e23c5998f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:57.401824 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e15db980-df9f-4bfc-8c96-4e6e23c5998f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:57.402507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e15db980-df9f-4bfc-8c96-4e6e23c5998f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:57.402957 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e15db980-df9f-4bfc-8c96-4e6e23c5998f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:57.403487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e15db980-df9f-4bfc-8c96-4e6e23c5998f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:57.530686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e15db980-df9f-4bfc-8c96-4e6e23c5998f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:57.534120 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:58:57.540697 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e15db980-df9f-4bfc-8c96-4e6e23c5998f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150719 Aug 30 14:58:57.541259 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 677/1344] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:57 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:58.268001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6f9c423b-e5d8-4a37-a489-acc94954689e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:58.268598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6f9c423b-e5d8-4a37-a489-acc94954689e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:58.275252 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f9c423b-e5d8-4a37-a489-acc94954689e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:58.275735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f9c423b-e5d8-4a37-a489-acc94954689e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:58.276166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f9c423b-e5d8-4a37-a489-acc94954689e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:58.276845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f9c423b-e5d8-4a37-a489-acc94954689e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:58.277289 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f9c423b-e5d8-4a37-a489-acc94954689e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:58.277705 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f9c423b-e5d8-4a37-a489-acc94954689e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:58.340070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6f9c423b-e5d8-4a37-a489-acc94954689e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:58.348546 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6f9c423b-e5d8-4a37-a489-acc94954689e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:58.349992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6f9c423b-e5d8-4a37-a489-acc94954689e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:58.351130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6f9c423b-e5d8-4a37-a489-acc94954689e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087072 Aug 30 14:58:58.351713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 668/1345] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:58 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:58.561743 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-aedefdb8-fe0b-4d01-a888-4a6ccfc20cd3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:58.562354 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-aedefdb8-fe0b-4d01-a888-4a6ccfc20cd3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:58.568656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aedefdb8-fe0b-4d01-a888-4a6ccfc20cd3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:58.569688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aedefdb8-fe0b-4d01-a888-4a6ccfc20cd3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:58.570137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aedefdb8-fe0b-4d01-a888-4a6ccfc20cd3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:58.571076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aedefdb8-fe0b-4d01-a888-4a6ccfc20cd3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:58.571552 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aedefdb8-fe0b-4d01-a888-4a6ccfc20cd3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:58.571972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aedefdb8-fe0b-4d01-a888-4a6ccfc20cd3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:58.701172 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-aedefdb8-fe0b-4d01-a888-4a6ccfc20cd3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:58.709258 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-aedefdb8-fe0b-4d01-a888-4a6ccfc20cd3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151666 Aug 30 14:58:58.709863 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 678/1346] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:58 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:58:59.372962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f9c6572b-37ff-4122-9f00-9485adbfbb03 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:59.373557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f9c6572b-37ff-4122-9f00-9485adbfbb03 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:59.379914 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9c6572b-37ff-4122-9f00-9485adbfbb03 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:59.380390 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9c6572b-37ff-4122-9f00-9485adbfbb03 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:59.380843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9c6572b-37ff-4122-9f00-9485adbfbb03 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:59.383360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9c6572b-37ff-4122-9f00-9485adbfbb03 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:59.383360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9c6572b-37ff-4122-9f00-9485adbfbb03 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:59.383360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9c6572b-37ff-4122-9f00-9485adbfbb03 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:59.442778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f9c6572b-37ff-4122-9f00-9485adbfbb03 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:59.452236 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f9c6572b-37ff-4122-9f00-9485adbfbb03 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:59.453750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f9c6572b-37ff-4122-9f00-9485adbfbb03 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:59.454882 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f9c6572b-37ff-4122-9f00-9485adbfbb03 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085901 Aug 30 14:58:59.455480 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 669/1347] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:58:59 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:58:59.730577 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ec271414-536f-4249-971b-a04c800cdf2d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:58:59.731100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ec271414-536f-4249-971b-a04c800cdf2d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:58:59.737421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec271414-536f-4249-971b-a04c800cdf2d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:59.737895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec271414-536f-4249-971b-a04c800cdf2d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:59.738353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec271414-536f-4249-971b-a04c800cdf2d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:59.739037 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec271414-536f-4249-971b-a04c800cdf2d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:58:59.739507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec271414-536f-4249-971b-a04c800cdf2d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:58:59.739922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec271414-536f-4249-971b-a04c800cdf2d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:58:59.871105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ec271414-536f-4249-971b-a04c800cdf2d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:58:59.879136 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ec271414-536f-4249-971b-a04c800cdf2d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152572 Aug 30 14:58:59.879723 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 679/1348] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:58:59 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:59:00.478447 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-77a58e4a-cac8-4e67-a1f3-05b8ae7cf823 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:00.479007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-77a58e4a-cac8-4e67-a1f3-05b8ae7cf823 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:00.485300 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77a58e4a-cac8-4e67-a1f3-05b8ae7cf823 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:00.485779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77a58e4a-cac8-4e67-a1f3-05b8ae7cf823 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:00.486211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77a58e4a-cac8-4e67-a1f3-05b8ae7cf823 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:00.486897 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77a58e4a-cac8-4e67-a1f3-05b8ae7cf823 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:00.487385 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77a58e4a-cac8-4e67-a1f3-05b8ae7cf823 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:00.487808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-77a58e4a-cac8-4e67-a1f3-05b8ae7cf823 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:00.548430 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-77a58e4a-cac8-4e67-a1f3-05b8ae7cf823 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:00.557744 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-77a58e4a-cac8-4e67-a1f3-05b8ae7cf823 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:00.559358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-77a58e4a-cac8-4e67-a1f3-05b8ae7cf823 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:00.560535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-77a58e4a-cac8-4e67-a1f3-05b8ae7cf823 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086488 Aug 30 14:59:00.561095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 670/1349] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:00 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:59:00.899825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a492916c-6386-443a-a983-5297958e2f3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:00.900438 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a492916c-6386-443a-a983-5297958e2f3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:00.906879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a492916c-6386-443a-a983-5297958e2f3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:00.907390 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a492916c-6386-443a-a983-5297958e2f3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:00.907824 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a492916c-6386-443a-a983-5297958e2f3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:00.908511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a492916c-6386-443a-a983-5297958e2f3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:00.909395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a492916c-6386-443a-a983-5297958e2f3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:00.909504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a492916c-6386-443a-a983-5297958e2f3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:01.037374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a492916c-6386-443a-a983-5297958e2f3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:01.046134 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a492916c-6386-443a-a983-5297958e2f3e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150228 Aug 30 14:59:01.046699 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 680/1350] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:00 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:01.583813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3a35ac07-b452-4a71-a8fc-427fcb3cddc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:01.584468 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3a35ac07-b452-4a71-a8fc-427fcb3cddc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:01.591524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a35ac07-b452-4a71-a8fc-427fcb3cddc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:01.591996 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a35ac07-b452-4a71-a8fc-427fcb3cddc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:01.592422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a35ac07-b452-4a71-a8fc-427fcb3cddc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:01.593102 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a35ac07-b452-4a71-a8fc-427fcb3cddc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:01.593545 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a35ac07-b452-4a71-a8fc-427fcb3cddc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:01.593959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a35ac07-b452-4a71-a8fc-427fcb3cddc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:01.654892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3a35ac07-b452-4a71-a8fc-427fcb3cddc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:01.658325 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:01.664793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3a35ac07-b452-4a71-a8fc-427fcb3cddc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:01.666243 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3a35ac07-b452-4a71-a8fc-427fcb3cddc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:01.667418 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3a35ac07-b452-4a71-a8fc-427fcb3cddc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087491 Aug 30 14:59:01.667981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 671/1351] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:01 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:02.067672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-40a27966-9a7f-4e15-a98e-9bb488bffedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:02.068284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-40a27966-9a7f-4e15-a98e-9bb488bffedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:02.075977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-40a27966-9a7f-4e15-a98e-9bb488bffedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:02.076446 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-40a27966-9a7f-4e15-a98e-9bb488bffedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:02.076869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-40a27966-9a7f-4e15-a98e-9bb488bffedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:02.077550 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-40a27966-9a7f-4e15-a98e-9bb488bffedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:02.077993 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-40a27966-9a7f-4e15-a98e-9bb488bffedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:02.078408 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-40a27966-9a7f-4e15-a98e-9bb488bffedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:02.210181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-40a27966-9a7f-4e15-a98e-9bb488bffedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:02.217590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-40a27966-9a7f-4e15-a98e-9bb488bffedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153798 Aug 30 14:59:02.218169 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 681/1352] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:02 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:02.690112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fe4c887e-7f9b-4459-8bdb-5e09cb49ca66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:02.690722 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fe4c887e-7f9b-4459-8bdb-5e09cb49ca66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:02.697530 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe4c887e-7f9b-4459-8bdb-5e09cb49ca66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:02.698012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe4c887e-7f9b-4459-8bdb-5e09cb49ca66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:02.698449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe4c887e-7f9b-4459-8bdb-5e09cb49ca66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:02.699138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe4c887e-7f9b-4459-8bdb-5e09cb49ca66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:02.699618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe4c887e-7f9b-4459-8bdb-5e09cb49ca66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:02.700040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe4c887e-7f9b-4459-8bdb-5e09cb49ca66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:02.766659 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fe4c887e-7f9b-4459-8bdb-5e09cb49ca66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:02.777762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fe4c887e-7f9b-4459-8bdb-5e09cb49ca66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:02.779241 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fe4c887e-7f9b-4459-8bdb-5e09cb49ca66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:02.780398 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fe4c887e-7f9b-4459-8bdb-5e09cb49ca66 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.094420 Aug 30 14:59:02.780948 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 672/1353] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:02 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:03.238293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7c3acb95-541d-47e1-9c8d-7c571c06c728 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:03.238928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7c3acb95-541d-47e1-9c8d-7c571c06c728 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:03.245337 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c3acb95-541d-47e1-9c8d-7c571c06c728 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:03.245811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c3acb95-541d-47e1-9c8d-7c571c06c728 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:03.246238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c3acb95-541d-47e1-9c8d-7c571c06c728 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:03.246915 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c3acb95-541d-47e1-9c8d-7c571c06c728 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:03.247398 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c3acb95-541d-47e1-9c8d-7c571c06c728 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:03.247817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c3acb95-541d-47e1-9c8d-7c571c06c728 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:03.374161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7c3acb95-541d-47e1-9c8d-7c571c06c728 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:03.382851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7c3acb95-541d-47e1-9c8d-7c571c06c728 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148295 Aug 30 14:59:03.383449 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 682/1354] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:03 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:03.803974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-967062ed-8918-4e67-a6b3-3926a590e5a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:03.804859 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-967062ed-8918-4e67-a6b3-3926a590e5a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:03.810838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-967062ed-8918-4e67-a6b3-3926a590e5a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:03.811354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-967062ed-8918-4e67-a6b3-3926a590e5a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:03.811790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-967062ed-8918-4e67-a6b3-3926a590e5a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:03.812476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-967062ed-8918-4e67-a6b3-3926a590e5a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:03.812920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-967062ed-8918-4e67-a6b3-3926a590e5a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:03.813341 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-967062ed-8918-4e67-a6b3-3926a590e5a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:03.873868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-967062ed-8918-4e67-a6b3-3926a590e5a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:03.882280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-967062ed-8918-4e67-a6b3-3926a590e5a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:03.883742 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-967062ed-8918-4e67-a6b3-3926a590e5a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:03.884868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-967062ed-8918-4e67-a6b3-3926a590e5a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085406 Aug 30 14:59:03.885422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 673/1355] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:03 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:04.404320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-39de8c95-0506-44a9-bb2a-bd099a2465a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:04.404926 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-39de8c95-0506-44a9-bb2a-bd099a2465a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:04.411258 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39de8c95-0506-44a9-bb2a-bd099a2465a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:04.411733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39de8c95-0506-44a9-bb2a-bd099a2465a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:04.412158 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39de8c95-0506-44a9-bb2a-bd099a2465a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:04.413462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39de8c95-0506-44a9-bb2a-bd099a2465a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:04.413908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39de8c95-0506-44a9-bb2a-bd099a2465a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:04.414321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39de8c95-0506-44a9-bb2a-bd099a2465a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:04.543620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-39de8c95-0506-44a9-bb2a-bd099a2465a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:04.551937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-39de8c95-0506-44a9-bb2a-bd099a2465a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151681 Aug 30 14:59:04.552501 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 683/1356] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:04 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:04.907332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-13f3aa8a-3028-47c9-8a85-f8deba141622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:04.907968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-13f3aa8a-3028-47c9-8a85-f8deba141622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:04.914646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13f3aa8a-3028-47c9-8a85-f8deba141622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:04.915118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13f3aa8a-3028-47c9-8a85-f8deba141622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:04.915574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13f3aa8a-3028-47c9-8a85-f8deba141622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:04.916257 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13f3aa8a-3028-47c9-8a85-f8deba141622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:04.916704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13f3aa8a-3028-47c9-8a85-f8deba141622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:04.917120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13f3aa8a-3028-47c9-8a85-f8deba141622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:04.977937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-13f3aa8a-3028-47c9-8a85-f8deba141622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:04.986319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-13f3aa8a-3028-47c9-8a85-f8deba141622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:04.987790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-13f3aa8a-3028-47c9-8a85-f8deba141622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:04.988926 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-13f3aa8a-3028-47c9-8a85-f8deba141622 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085499 Aug 30 14:59:04.989481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 674/1357] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:04 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:59:05.574007 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0de855b7-9469-419b-8b1d-e5ac6d89767a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:05.574644 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0de855b7-9469-419b-8b1d-e5ac6d89767a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:05.581044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0de855b7-9469-419b-8b1d-e5ac6d89767a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:05.581521 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0de855b7-9469-419b-8b1d-e5ac6d89767a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:05.581948 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0de855b7-9469-419b-8b1d-e5ac6d89767a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:05.582631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0de855b7-9469-419b-8b1d-e5ac6d89767a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:05.583074 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0de855b7-9469-419b-8b1d-e5ac6d89767a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:05.583516 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0de855b7-9469-419b-8b1d-e5ac6d89767a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:05.711337 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0de855b7-9469-419b-8b1d-e5ac6d89767a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:05.719402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0de855b7-9469-419b-8b1d-e5ac6d89767a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149506 Aug 30 14:59:05.719955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 684/1358] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:05 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:06.011726 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-93a5daa5-d6db-4ad1-afdd-4ebf3ce3fde9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:06.012358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-93a5daa5-d6db-4ad1-afdd-4ebf3ce3fde9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:06.018747 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93a5daa5-d6db-4ad1-afdd-4ebf3ce3fde9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:06.019245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93a5daa5-d6db-4ad1-afdd-4ebf3ce3fde9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:06.019682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93a5daa5-d6db-4ad1-afdd-4ebf3ce3fde9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:06.020366 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93a5daa5-d6db-4ad1-afdd-4ebf3ce3fde9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:06.020830 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93a5daa5-d6db-4ad1-afdd-4ebf3ce3fde9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:06.021251 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93a5daa5-d6db-4ad1-afdd-4ebf3ce3fde9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:06.081446 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-93a5daa5-d6db-4ad1-afdd-4ebf3ce3fde9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:06.090410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-93a5daa5-d6db-4ad1-afdd-4ebf3ce3fde9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:06.091885 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-93a5daa5-d6db-4ad1-afdd-4ebf3ce3fde9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:06.093032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-93a5daa5-d6db-4ad1-afdd-4ebf3ce3fde9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085345 Aug 30 14:59:06.093590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 675/1359] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:06 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:59:06.742095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-927c98ef-7ca7-4b53-96c1-92c1b8bc9dc3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:06.742702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-927c98ef-7ca7-4b53-96c1-92c1b8bc9dc3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:06.754113 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-927c98ef-7ca7-4b53-96c1-92c1b8bc9dc3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:06.754595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-927c98ef-7ca7-4b53-96c1-92c1b8bc9dc3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:06.755025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-927c98ef-7ca7-4b53-96c1-92c1b8bc9dc3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:06.755743 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-927c98ef-7ca7-4b53-96c1-92c1b8bc9dc3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:06.756192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-927c98ef-7ca7-4b53-96c1-92c1b8bc9dc3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:06.757752 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-927c98ef-7ca7-4b53-96c1-92c1b8bc9dc3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:06.886669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-927c98ef-7ca7-4b53-96c1-92c1b8bc9dc3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:06.894821 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-927c98ef-7ca7-4b53-96c1-92c1b8bc9dc3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.157671 Aug 30 14:59:06.895431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 685/1360] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:06 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:07.116537 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-613b959f-7a72-4cc7-bbe2-23b87ce9e4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:07.117155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-613b959f-7a72-4cc7-bbe2-23b87ce9e4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:07.123543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-613b959f-7a72-4cc7-bbe2-23b87ce9e4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:07.124026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-613b959f-7a72-4cc7-bbe2-23b87ce9e4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:07.124462 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-613b959f-7a72-4cc7-bbe2-23b87ce9e4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:07.125147 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-613b959f-7a72-4cc7-bbe2-23b87ce9e4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:07.125597 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-613b959f-7a72-4cc7-bbe2-23b87ce9e4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:07.126028 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-613b959f-7a72-4cc7-bbe2-23b87ce9e4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:07.189516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-613b959f-7a72-4cc7-bbe2-23b87ce9e4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:07.198888 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-613b959f-7a72-4cc7-bbe2-23b87ce9e4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:07.200365 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-613b959f-7a72-4cc7-bbe2-23b87ce9e4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:07.201504 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-613b959f-7a72-4cc7-bbe2-23b87ce9e4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089120 Aug 30 14:59:07.202062 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 676/1361] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:07 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:59:07.917832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-118e6d07-4a90-43a9-8e68-fd95896a02dc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:07.918431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-118e6d07-4a90-43a9-8e68-fd95896a02dc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:07.924735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-118e6d07-4a90-43a9-8e68-fd95896a02dc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:07.925203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-118e6d07-4a90-43a9-8e68-fd95896a02dc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:07.925633 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-118e6d07-4a90-43a9-8e68-fd95896a02dc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:07.926312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-118e6d07-4a90-43a9-8e68-fd95896a02dc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:07.926755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-118e6d07-4a90-43a9-8e68-fd95896a02dc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:07.927169 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-118e6d07-4a90-43a9-8e68-fd95896a02dc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:08.057903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-118e6d07-4a90-43a9-8e68-fd95896a02dc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:08.066096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-118e6d07-4a90-43a9-8e68-fd95896a02dc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153185 Aug 30 14:59:08.066659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 686/1362] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:07 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:08.224680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-52302ce1-4fce-469d-abfa-a43014b9b6f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:08.225998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-52302ce1-4fce-469d-abfa-a43014b9b6f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:08.232381 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52302ce1-4fce-469d-abfa-a43014b9b6f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:08.232863 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52302ce1-4fce-469d-abfa-a43014b9b6f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:08.233295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52302ce1-4fce-469d-abfa-a43014b9b6f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:08.233978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52302ce1-4fce-469d-abfa-a43014b9b6f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:08.234425 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52302ce1-4fce-469d-abfa-a43014b9b6f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:08.234841 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52302ce1-4fce-469d-abfa-a43014b9b6f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:08.295176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-52302ce1-4fce-469d-abfa-a43014b9b6f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:08.303865 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-52302ce1-4fce-469d-abfa-a43014b9b6f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:08.305453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-52302ce1-4fce-469d-abfa-a43014b9b6f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:08.306601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-52302ce1-4fce-469d-abfa-a43014b9b6f3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085815 Aug 30 14:59:08.307160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 677/1363] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:08 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:09.086781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4d625158-9c32-402b-a167-1799487181cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:09.087416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4d625158-9c32-402b-a167-1799487181cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:09.093985 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d625158-9c32-402b-a167-1799487181cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:09.094457 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d625158-9c32-402b-a167-1799487181cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:09.094885 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d625158-9c32-402b-a167-1799487181cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:09.095593 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d625158-9c32-402b-a167-1799487181cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:09.096042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d625158-9c32-402b-a167-1799487181cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:09.096455 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d625158-9c32-402b-a167-1799487181cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:09.228338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4d625158-9c32-402b-a167-1799487181cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:09.236580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4d625158-9c32-402b-a167-1799487181cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153752 Aug 30 14:59:09.237143 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 687/1364] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:09 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:09.329518 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1690374c-1a1f-49a6-ae1f-0a4aacb51069 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:09.330162 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1690374c-1a1f-49a6-ae1f-0a4aacb51069 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:09.336521 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1690374c-1a1f-49a6-ae1f-0a4aacb51069 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:09.337058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1690374c-1a1f-49a6-ae1f-0a4aacb51069 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:09.337443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1690374c-1a1f-49a6-ae1f-0a4aacb51069 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:09.338131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1690374c-1a1f-49a6-ae1f-0a4aacb51069 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:09.338582 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1690374c-1a1f-49a6-ae1f-0a4aacb51069 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:09.339009 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1690374c-1a1f-49a6-ae1f-0a4aacb51069 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:09.398812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1690374c-1a1f-49a6-ae1f-0a4aacb51069 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:09.407307 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1690374c-1a1f-49a6-ae1f-0a4aacb51069 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:09.408757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1690374c-1a1f-49a6-ae1f-0a4aacb51069 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:09.409904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1690374c-1a1f-49a6-ae1f-0a4aacb51069 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084326 Aug 30 14:59:09.410467 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 678/1365] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:09 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:10.258817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-234cba10-4f9f-49b7-b986-a343c73be387 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:10.259464 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-234cba10-4f9f-49b7-b986-a343c73be387 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:10.265870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-234cba10-4f9f-49b7-b986-a343c73be387 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:10.266353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-234cba10-4f9f-49b7-b986-a343c73be387 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:10.266788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-234cba10-4f9f-49b7-b986-a343c73be387 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:10.267519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-234cba10-4f9f-49b7-b986-a343c73be387 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:10.267992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-234cba10-4f9f-49b7-b986-a343c73be387 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:10.268418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-234cba10-4f9f-49b7-b986-a343c73be387 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:10.400858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-234cba10-4f9f-49b7-b986-a343c73be387 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:10.409027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-234cba10-4f9f-49b7-b986-a343c73be387 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.154743 Aug 30 14:59:10.409606 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 688/1366] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:10 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:10.433486 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3f3b3ef1-a040-4d59-8544-57586ee7c558 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:10.434092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3f3b3ef1-a040-4d59-8544-57586ee7c558 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:10.440592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f3b3ef1-a040-4d59-8544-57586ee7c558 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:10.441081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f3b3ef1-a040-4d59-8544-57586ee7c558 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:10.441518 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f3b3ef1-a040-4d59-8544-57586ee7c558 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:10.442400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f3b3ef1-a040-4d59-8544-57586ee7c558 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:10.442670 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f3b3ef1-a040-4d59-8544-57586ee7c558 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:10.443093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f3b3ef1-a040-4d59-8544-57586ee7c558 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:10.505421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3f3b3ef1-a040-4d59-8544-57586ee7c558 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:10.514732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3f3b3ef1-a040-4d59-8544-57586ee7c558 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:10.516201 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3f3b3ef1-a040-4d59-8544-57586ee7c558 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:10.517352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3f3b3ef1-a040-4d59-8544-57586ee7c558 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087995 Aug 30 14:59:10.517914 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 679/1367] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:10 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:11.430400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9bc8b32c-b748-4fb3-b565-b477e4151494 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:11.431010 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9bc8b32c-b748-4fb3-b565-b477e4151494 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:11.437530 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9bc8b32c-b748-4fb3-b565-b477e4151494 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:11.437978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9bc8b32c-b748-4fb3-b565-b477e4151494 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:11.438406 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9bc8b32c-b748-4fb3-b565-b477e4151494 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:11.439100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9bc8b32c-b748-4fb3-b565-b477e4151494 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:11.439570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9bc8b32c-b748-4fb3-b565-b477e4151494 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:11.439986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9bc8b32c-b748-4fb3-b565-b477e4151494 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:11.540518 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c1bd0479-bdf4-43c5-a8e0-e9d25c7b974d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:11.541327 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c1bd0479-bdf4-43c5-a8e0-e9d25c7b974d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:11.547785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1bd0479-bdf4-43c5-a8e0-e9d25c7b974d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:11.548264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1bd0479-bdf4-43c5-a8e0-e9d25c7b974d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:11.548694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1bd0479-bdf4-43c5-a8e0-e9d25c7b974d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:11.549389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1bd0479-bdf4-43c5-a8e0-e9d25c7b974d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:11.549842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1bd0479-bdf4-43c5-a8e0-e9d25c7b974d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:11.550266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1bd0479-bdf4-43c5-a8e0-e9d25c7b974d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:11.567763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9bc8b32c-b748-4fb3-b565-b477e4151494 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:11.576157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9bc8b32c-b748-4fb3-b565-b477e4151494 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149904 Aug 30 14:59:11.576978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 689/1368] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:11 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:11.614395 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c1bd0479-bdf4-43c5-a8e0-e9d25c7b974d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:11.623753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c1bd0479-bdf4-43c5-a8e0-e9d25c7b974d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:11.625204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c1bd0479-bdf4-43c5-a8e0-e9d25c7b974d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:11.626419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c1bd0479-bdf4-43c5-a8e0-e9d25c7b974d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090664 Aug 30 14:59:11.626990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 680/1369] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:11 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:59:12.597410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a737936d-9d54-4d21-b48a-60e248956465 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:12.598052 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a737936d-9d54-4d21-b48a-60e248956465 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:12.604685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a737936d-9d54-4d21-b48a-60e248956465 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:12.605160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a737936d-9d54-4d21-b48a-60e248956465 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:12.605589 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a737936d-9d54-4d21-b48a-60e248956465 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:12.606272 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a737936d-9d54-4d21-b48a-60e248956465 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:12.606710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a737936d-9d54-4d21-b48a-60e248956465 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:12.607122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a737936d-9d54-4d21-b48a-60e248956465 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:12.651290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-400642e7-9267-497c-bd0e-c7aa6988fc29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:12.651907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-400642e7-9267-497c-bd0e-c7aa6988fc29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:12.657803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-400642e7-9267-497c-bd0e-c7aa6988fc29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:12.658281 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-400642e7-9267-497c-bd0e-c7aa6988fc29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:12.658715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-400642e7-9267-497c-bd0e-c7aa6988fc29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:12.659444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-400642e7-9267-497c-bd0e-c7aa6988fc29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:12.659907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-400642e7-9267-497c-bd0e-c7aa6988fc29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:12.660328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-400642e7-9267-497c-bd0e-c7aa6988fc29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:12.721935 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-400642e7-9267-497c-bd0e-c7aa6988fc29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:12.730610 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-400642e7-9267-497c-bd0e-c7aa6988fc29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:12.732083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-400642e7-9267-497c-bd0e-c7aa6988fc29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:12.733235 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-400642e7-9267-497c-bd0e-c7aa6988fc29 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086647 Aug 30 14:59:12.734193 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 681/1370] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:12 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:59:12.745311 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a737936d-9d54-4d21-b48a-60e248956465 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:12.753394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a737936d-9d54-4d21-b48a-60e248956465 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.159876 Aug 30 14:59:12.753952 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 690/1371] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:12 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:13.755934 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-92af6292-23a9-42cc-a7d8-f13f09220ded tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:13.757120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-92af6292-23a9-42cc-a7d8-f13f09220ded tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:13.763536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92af6292-23a9-42cc-a7d8-f13f09220ded tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:13.764012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92af6292-23a9-42cc-a7d8-f13f09220ded tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:13.764445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92af6292-23a9-42cc-a7d8-f13f09220ded tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:13.765142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92af6292-23a9-42cc-a7d8-f13f09220ded tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:13.765595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92af6292-23a9-42cc-a7d8-f13f09220ded tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:13.766022 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92af6292-23a9-42cc-a7d8-f13f09220ded tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:13.774518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-146a1596-8003-4b1f-8254-afe9f89575c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:13.775228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-146a1596-8003-4b1f-8254-afe9f89575c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:13.781590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-146a1596-8003-4b1f-8254-afe9f89575c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:13.782064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-146a1596-8003-4b1f-8254-afe9f89575c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:13.782486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-146a1596-8003-4b1f-8254-afe9f89575c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:13.783170 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-146a1596-8003-4b1f-8254-afe9f89575c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:13.783639 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-146a1596-8003-4b1f-8254-afe9f89575c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:13.784062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-146a1596-8003-4b1f-8254-afe9f89575c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:13.914428 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-146a1596-8003-4b1f-8254-afe9f89575c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:13.922539 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-146a1596-8003-4b1f-8254-afe9f89575c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152615 Aug 30 14:59:13.923107 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 691/1372] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:13 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:59:13.984724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-92af6292-23a9-42cc-a7d8-f13f09220ded tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:13.993652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-92af6292-23a9-42cc-a7d8-f13f09220ded tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:13.995080 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-92af6292-23a9-42cc-a7d8-f13f09220ded tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:13.996240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-92af6292-23a9-42cc-a7d8-f13f09220ded tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.244200 Aug 30 14:59:13.996793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 682/1373] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:13 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:14.945922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-282af752-6d3f-4c73-b15a-ce41a27cce99 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:14.946595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-282af752-6d3f-4c73-b15a-ce41a27cce99 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:14.953007 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-282af752-6d3f-4c73-b15a-ce41a27cce99 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:14.953490 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-282af752-6d3f-4c73-b15a-ce41a27cce99 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:14.953926 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-282af752-6d3f-4c73-b15a-ce41a27cce99 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:14.954627 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-282af752-6d3f-4c73-b15a-ce41a27cce99 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:14.955077 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-282af752-6d3f-4c73-b15a-ce41a27cce99 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:14.955538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-282af752-6d3f-4c73-b15a-ce41a27cce99 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:15.019461 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7d4faefa-1d1f-432a-a607-238a6e251560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:15.020266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7d4faefa-1d1f-432a-a607-238a6e251560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:15.027461 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d4faefa-1d1f-432a-a607-238a6e251560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:15.027944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d4faefa-1d1f-432a-a607-238a6e251560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:15.028375 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d4faefa-1d1f-432a-a607-238a6e251560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:15.029067 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d4faefa-1d1f-432a-a607-238a6e251560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:15.029515 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d4faefa-1d1f-432a-a607-238a6e251560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:15.029962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d4faefa-1d1f-432a-a607-238a6e251560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:15.085866 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-282af752-6d3f-4c73-b15a-ce41a27cce99 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:15.091949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7d4faefa-1d1f-432a-a607-238a6e251560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:15.094173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-282af752-6d3f-4c73-b15a-ce41a27cce99 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152514 Aug 30 14:59:15.094828 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 692/1374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:14 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:15.101447 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7d4faefa-1d1f-432a-a607-238a6e251560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:15.102892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7d4faefa-1d1f-432a-a607-238a6e251560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:15.104103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7d4faefa-1d1f-432a-a607-238a6e251560 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088581 Aug 30 14:59:15.104651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 683/1375] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:15 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:59:16.117811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0e872433-b202-44b9-9d87-df379b90e5ea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:16.118425 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0e872433-b202-44b9-9d87-df379b90e5ea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:16.124877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e872433-b202-44b9-9d87-df379b90e5ea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:16.125364 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e872433-b202-44b9-9d87-df379b90e5ea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:16.125641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-37b38206-1330-4e07-a81f-08fde9ace4ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:16.126058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e872433-b202-44b9-9d87-df379b90e5ea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:16.126251 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-37b38206-1330-4e07-a81f-08fde9ace4ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:16.126480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e872433-b202-44b9-9d87-df379b90e5ea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:16.126930 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e872433-b202-44b9-9d87-df379b90e5ea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:16.127383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e872433-b202-44b9-9d87-df379b90e5ea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:16.133103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37b38206-1330-4e07-a81f-08fde9ace4ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:16.133588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37b38206-1330-4e07-a81f-08fde9ace4ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:16.134018 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37b38206-1330-4e07-a81f-08fde9ace4ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:16.134712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37b38206-1330-4e07-a81f-08fde9ace4ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:16.135184 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37b38206-1330-4e07-a81f-08fde9ace4ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:16.135655 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37b38206-1330-4e07-a81f-08fde9ace4ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:16.201322 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-37b38206-1330-4e07-a81f-08fde9ace4ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:16.210241 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-37b38206-1330-4e07-a81f-08fde9ace4ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:16.211726 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-37b38206-1330-4e07-a81f-08fde9ace4ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:16.212885 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-37b38206-1330-4e07-a81f-08fde9ace4ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091111 Aug 30 14:59:16.213494 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 684/1376] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:16 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:59:16.262161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0e872433-b202-44b9-9d87-df379b90e5ea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:16.270240 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0e872433-b202-44b9-9d87-df379b90e5ea tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.157108 Aug 30 14:59:16.270808 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 693/1377] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:16 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:17.241507 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5b50acfb-9c48-4a21-af8e-69f32d2292da tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:17.241507 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5b50acfb-9c48-4a21-af8e-69f32d2292da tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:17.244444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b50acfb-9c48-4a21-af8e-69f32d2292da tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:17.244926 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b50acfb-9c48-4a21-af8e-69f32d2292da tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:17.245359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b50acfb-9c48-4a21-af8e-69f32d2292da tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:17.246045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b50acfb-9c48-4a21-af8e-69f32d2292da tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:17.246559 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b50acfb-9c48-4a21-af8e-69f32d2292da tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:17.246980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b50acfb-9c48-4a21-af8e-69f32d2292da tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:17.291724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7607b05c-fc51-42a8-b15f-379cdcbbd0b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:17.292958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7607b05c-fc51-42a8-b15f-379cdcbbd0b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:17.299046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7607b05c-fc51-42a8-b15f-379cdcbbd0b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:17.299623 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7607b05c-fc51-42a8-b15f-379cdcbbd0b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:17.300066 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7607b05c-fc51-42a8-b15f-379cdcbbd0b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:17.300762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7607b05c-fc51-42a8-b15f-379cdcbbd0b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:17.301209 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7607b05c-fc51-42a8-b15f-379cdcbbd0b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:17.301628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7607b05c-fc51-42a8-b15f-379cdcbbd0b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:17.313823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5b50acfb-9c48-4a21-af8e-69f32d2292da tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:17.321750 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:17.324131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5b50acfb-9c48-4a21-af8e-69f32d2292da tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:17.325890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5b50acfb-9c48-4a21-af8e-69f32d2292da tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:17.327032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5b50acfb-9c48-4a21-af8e-69f32d2292da tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.094851 Aug 30 14:59:17.327631 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 685/1378] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:17 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:17.432981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7607b05c-fc51-42a8-b15f-379cdcbbd0b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:17.441289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7607b05c-fc51-42a8-b15f-379cdcbbd0b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153630 Aug 30 14:59:17.441797 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 694/1379] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:17 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:59:18.349807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4be508b5-023a-46da-b601-f1fa465fc612 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:18.350453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4be508b5-023a-46da-b601-f1fa465fc612 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:18.356852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4be508b5-023a-46da-b601-f1fa465fc612 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:18.357330 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4be508b5-023a-46da-b601-f1fa465fc612 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:18.357762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4be508b5-023a-46da-b601-f1fa465fc612 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:18.358450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4be508b5-023a-46da-b601-f1fa465fc612 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:18.358901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4be508b5-023a-46da-b601-f1fa465fc612 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:18.359361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4be508b5-023a-46da-b601-f1fa465fc612 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:18.420879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4be508b5-023a-46da-b601-f1fa465fc612 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:18.429496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4be508b5-023a-46da-b601-f1fa465fc612 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:18.430937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4be508b5-023a-46da-b601-f1fa465fc612 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:18.432109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4be508b5-023a-46da-b601-f1fa465fc612 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086314 Aug 30 14:59:18.432678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 686/1380] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:18 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:18.462552 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fd5759c4-1352-40e7-9000-16f419273ff2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:18.463235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fd5759c4-1352-40e7-9000-16f419273ff2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:18.469497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd5759c4-1352-40e7-9000-16f419273ff2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:18.469971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd5759c4-1352-40e7-9000-16f419273ff2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:18.470401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd5759c4-1352-40e7-9000-16f419273ff2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:18.471088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd5759c4-1352-40e7-9000-16f419273ff2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:18.471573 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd5759c4-1352-40e7-9000-16f419273ff2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:18.471992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd5759c4-1352-40e7-9000-16f419273ff2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:18.602064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fd5759c4-1352-40e7-9000-16f419273ff2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:18.610140 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fd5759c4-1352-40e7-9000-16f419273ff2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152225 Aug 30 14:59:18.610707 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 695/1381] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:18 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:19.455434 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b16b6556-a254-4099-8760-7df1e653c90d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:19.455963 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b16b6556-a254-4099-8760-7df1e653c90d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:19.458285 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=54 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:19.463978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b16b6556-a254-4099-8760-7df1e653c90d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:19.464456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b16b6556-a254-4099-8760-7df1e653c90d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:19.464892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b16b6556-a254-4099-8760-7df1e653c90d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:19.465579 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b16b6556-a254-4099-8760-7df1e653c90d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:19.466031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b16b6556-a254-4099-8760-7df1e653c90d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:19.466455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b16b6556-a254-4099-8760-7df1e653c90d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:19.528008 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b16b6556-a254-4099-8760-7df1e653c90d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:19.536436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b16b6556-a254-4099-8760-7df1e653c90d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:19.538626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b16b6556-a254-4099-8760-7df1e653c90d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:19.539810 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b16b6556-a254-4099-8760-7df1e653c90d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088511 Aug 30 14:59:19.540369 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 687/1382] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:19 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:19.630458 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9644e941-4378-406b-a1e0-e8f0ecde1644 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:19.631628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9644e941-4378-406b-a1e0-e8f0ecde1644 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:19.633940 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=52 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:19.640330 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9644e941-4378-406b-a1e0-e8f0ecde1644 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:19.640808 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9644e941-4378-406b-a1e0-e8f0ecde1644 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:19.641237 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9644e941-4378-406b-a1e0-e8f0ecde1644 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:19.641921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9644e941-4378-406b-a1e0-e8f0ecde1644 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:19.642366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9644e941-4378-406b-a1e0-e8f0ecde1644 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:19.642781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9644e941-4378-406b-a1e0-e8f0ecde1644 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:19.768163 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9644e941-4378-406b-a1e0-e8f0ecde1644 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:19.777025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9644e941-4378-406b-a1e0-e8f0ecde1644 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150403 Aug 30 14:59:19.777586 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 696/1383] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:19 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:20.562171 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-eb04704b-594b-4709-8175-b3dcff286b0b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:20.562780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-eb04704b-594b-4709-8175-b3dcff286b0b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:20.569175 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb04704b-594b-4709-8175-b3dcff286b0b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:20.569656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb04704b-594b-4709-8175-b3dcff286b0b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:20.570089 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb04704b-594b-4709-8175-b3dcff286b0b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:20.571059 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb04704b-594b-4709-8175-b3dcff286b0b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:20.571550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb04704b-594b-4709-8175-b3dcff286b0b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:20.572132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb04704b-594b-4709-8175-b3dcff286b0b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:20.590809 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:20.637619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-eb04704b-594b-4709-8175-b3dcff286b0b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:20.646109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-eb04704b-594b-4709-8175-b3dcff286b0b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:20.647748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-eb04704b-594b-4709-8175-b3dcff286b0b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:20.648886 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-eb04704b-594b-4709-8175-b3dcff286b0b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090664 Aug 30 14:59:20.649437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 688/1384] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:20 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:20.797471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5307300a-30a3-496a-b3d4-36ae305cf3ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:20.798081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5307300a-30a3-496a-b3d4-36ae305cf3ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:20.804921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5307300a-30a3-496a-b3d4-36ae305cf3ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:20.805393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5307300a-30a3-496a-b3d4-36ae305cf3ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:20.805821 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5307300a-30a3-496a-b3d4-36ae305cf3ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:20.806504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5307300a-30a3-496a-b3d4-36ae305cf3ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:20.806953 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5307300a-30a3-496a-b3d4-36ae305cf3ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:20.807402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5307300a-30a3-496a-b3d4-36ae305cf3ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:20.933472 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5307300a-30a3-496a-b3d4-36ae305cf3ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:20.941476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5307300a-30a3-496a-b3d4-36ae305cf3ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147923 Aug 30 14:59:20.942037 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 697/1385] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:20 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:21.671849 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-989dcdac-b556-4b5a-a207-ae26d1149587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:21.672463 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-989dcdac-b556-4b5a-a207-ae26d1149587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:21.679077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-989dcdac-b556-4b5a-a207-ae26d1149587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:21.679585 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-989dcdac-b556-4b5a-a207-ae26d1149587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:21.680023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-989dcdac-b556-4b5a-a207-ae26d1149587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:21.680707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-989dcdac-b556-4b5a-a207-ae26d1149587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:21.681160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-989dcdac-b556-4b5a-a207-ae26d1149587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:21.681583 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-989dcdac-b556-4b5a-a207-ae26d1149587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:21.742112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-989dcdac-b556-4b5a-a207-ae26d1149587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:21.750613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-989dcdac-b556-4b5a-a207-ae26d1149587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:21.752081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-989dcdac-b556-4b5a-a207-ae26d1149587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:21.753667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-989dcdac-b556-4b5a-a207-ae26d1149587 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085735 Aug 30 14:59:21.754427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 689/1386] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:21 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:59:21.962815 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9c8c754a-7c66-4126-896f-832193bb1c7e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:21.963470 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9c8c754a-7c66-4126-896f-832193bb1c7e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:21.970060 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c8c754a-7c66-4126-896f-832193bb1c7e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:21.970532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c8c754a-7c66-4126-896f-832193bb1c7e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:21.970975 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c8c754a-7c66-4126-896f-832193bb1c7e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:21.971687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c8c754a-7c66-4126-896f-832193bb1c7e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:21.972160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c8c754a-7c66-4126-896f-832193bb1c7e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:21.972574 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c8c754a-7c66-4126-896f-832193bb1c7e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:22.103507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9c8c754a-7c66-4126-896f-832193bb1c7e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:22.111620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9c8c754a-7c66-4126-896f-832193bb1c7e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153017 Aug 30 14:59:22.112177 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 698/1387] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:21 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:22.778301 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6f1ee8e9-ec2c-4a34-ba69-d7f22ff5d956 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:22.778883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6f1ee8e9-ec2c-4a34-ba69-d7f22ff5d956 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:22.785369 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f1ee8e9-ec2c-4a34-ba69-d7f22ff5d956 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:22.785764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f1ee8e9-ec2c-4a34-ba69-d7f22ff5d956 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:22.786191 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f1ee8e9-ec2c-4a34-ba69-d7f22ff5d956 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:22.786868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f1ee8e9-ec2c-4a34-ba69-d7f22ff5d956 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:22.787344 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f1ee8e9-ec2c-4a34-ba69-d7f22ff5d956 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:22.787766 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f1ee8e9-ec2c-4a34-ba69-d7f22ff5d956 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:22.849123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6f1ee8e9-ec2c-4a34-ba69-d7f22ff5d956 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:22.857887 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6f1ee8e9-ec2c-4a34-ba69-d7f22ff5d956 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:22.859349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6f1ee8e9-ec2c-4a34-ba69-d7f22ff5d956 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:22.860486 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6f1ee8e9-ec2c-4a34-ba69-d7f22ff5d956 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086605 Aug 30 14:59:22.861038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 690/1388] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:22 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:23.133654 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-92a323b3-7d08-47fd-aa29-2c5a59354056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:23.134268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-92a323b3-7d08-47fd-aa29-2c5a59354056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:23.140624 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-92a323b3-7d08-47fd-aa29-2c5a59354056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:23.141102 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-92a323b3-7d08-47fd-aa29-2c5a59354056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:23.141534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-92a323b3-7d08-47fd-aa29-2c5a59354056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:23.142220 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-92a323b3-7d08-47fd-aa29-2c5a59354056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:23.142668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-92a323b3-7d08-47fd-aa29-2c5a59354056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:23.143085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-92a323b3-7d08-47fd-aa29-2c5a59354056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:23.277531 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-92a323b3-7d08-47fd-aa29-2c5a59354056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:23.285631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-92a323b3-7d08-47fd-aa29-2c5a59354056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156431 Aug 30 14:59:23.286191 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 699/1389] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:23 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:23.883483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-57ae1b56-e619-47f9-9d19-e232815344ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:23.884053 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-57ae1b56-e619-47f9-9d19-e232815344ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:23.892597 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57ae1b56-e619-47f9-9d19-e232815344ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:23.893111 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57ae1b56-e619-47f9-9d19-e232815344ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:23.893544 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57ae1b56-e619-47f9-9d19-e232815344ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:23.894238 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57ae1b56-e619-47f9-9d19-e232815344ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:23.894688 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57ae1b56-e619-47f9-9d19-e232815344ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:23.895108 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57ae1b56-e619-47f9-9d19-e232815344ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:23.965216 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-57ae1b56-e619-47f9-9d19-e232815344ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:23.975858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-57ae1b56-e619-47f9-9d19-e232815344ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:23.977802 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-57ae1b56-e619-47f9-9d19-e232815344ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:23.978986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-57ae1b56-e619-47f9-9d19-e232815344ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.099458 Aug 30 14:59:23.979578 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 691/1390] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:23 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:24.306799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5ef30c37-535b-4314-b8e5-5255becbc565 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:24.307441 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5ef30c37-535b-4314-b8e5-5255becbc565 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:24.314022 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ef30c37-535b-4314-b8e5-5255becbc565 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:24.314502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ef30c37-535b-4314-b8e5-5255becbc565 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:24.314932 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ef30c37-535b-4314-b8e5-5255becbc565 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:24.315659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ef30c37-535b-4314-b8e5-5255becbc565 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:24.316109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ef30c37-535b-4314-b8e5-5255becbc565 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:24.316524 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ef30c37-535b-4314-b8e5-5255becbc565 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:24.447363 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5ef30c37-535b-4314-b8e5-5255becbc565 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:24.455469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5ef30c37-535b-4314-b8e5-5255becbc565 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152617 Aug 30 14:59:24.456039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 700/1391] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:24 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:25.002195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e548f95c-095e-45df-8a66-338b71a19169 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:25.002809 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e548f95c-095e-45df-8a66-338b71a19169 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:25.009552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e548f95c-095e-45df-8a66-338b71a19169 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:25.010033 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e548f95c-095e-45df-8a66-338b71a19169 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:25.010469 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e548f95c-095e-45df-8a66-338b71a19169 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:25.011154 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e548f95c-095e-45df-8a66-338b71a19169 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:25.011637 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e548f95c-095e-45df-8a66-338b71a19169 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:25.012069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e548f95c-095e-45df-8a66-338b71a19169 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:25.077778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e548f95c-095e-45df-8a66-338b71a19169 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:25.086752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e548f95c-095e-45df-8a66-338b71a19169 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:25.088153 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e548f95c-095e-45df-8a66-338b71a19169 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:25.089330 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e548f95c-095e-45df-8a66-338b71a19169 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091038 Aug 30 14:59:25.089889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 692/1392] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:24 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:25.477341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cffcf51e-b67f-413e-9dc0-cb0a84ec4142 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:25.477946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cffcf51e-b67f-413e-9dc0-cb0a84ec4142 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:25.484282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cffcf51e-b67f-413e-9dc0-cb0a84ec4142 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:25.484756 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cffcf51e-b67f-413e-9dc0-cb0a84ec4142 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:25.485182 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cffcf51e-b67f-413e-9dc0-cb0a84ec4142 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:25.485861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cffcf51e-b67f-413e-9dc0-cb0a84ec4142 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:25.486336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cffcf51e-b67f-413e-9dc0-cb0a84ec4142 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:25.486749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cffcf51e-b67f-413e-9dc0-cb0a84ec4142 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:25.618021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cffcf51e-b67f-413e-9dc0-cb0a84ec4142 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:25.626200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cffcf51e-b67f-413e-9dc0-cb0a84ec4142 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153814 Aug 30 14:59:25.626758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 701/1393] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:25 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:26.112480 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-558d87cc-3e5e-4c8e-b781-99bc8f0005fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:26.113088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-558d87cc-3e5e-4c8e-b781-99bc8f0005fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:26.120260 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-558d87cc-3e5e-4c8e-b781-99bc8f0005fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:26.120734 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-558d87cc-3e5e-4c8e-b781-99bc8f0005fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:26.121160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-558d87cc-3e5e-4c8e-b781-99bc8f0005fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:26.121833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-558d87cc-3e5e-4c8e-b781-99bc8f0005fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:26.122281 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-558d87cc-3e5e-4c8e-b781-99bc8f0005fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:26.122694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-558d87cc-3e5e-4c8e-b781-99bc8f0005fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:26.183371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-558d87cc-3e5e-4c8e-b781-99bc8f0005fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:26.192110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-558d87cc-3e5e-4c8e-b781-99bc8f0005fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:26.194314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-558d87cc-3e5e-4c8e-b781-99bc8f0005fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:26.195963 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-558d87cc-3e5e-4c8e-b781-99bc8f0005fb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087210 Aug 30 14:59:26.196555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 693/1394] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:26 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:26.647649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-12d6e29a-2888-45eb-80ff-9e76571e10f6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:26.648263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-12d6e29a-2888-45eb-80ff-9e76571e10f6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:26.654703 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12d6e29a-2888-45eb-80ff-9e76571e10f6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:26.655183 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12d6e29a-2888-45eb-80ff-9e76571e10f6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:26.655647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12d6e29a-2888-45eb-80ff-9e76571e10f6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:26.656344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12d6e29a-2888-45eb-80ff-9e76571e10f6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:26.656793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12d6e29a-2888-45eb-80ff-9e76571e10f6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:26.657215 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12d6e29a-2888-45eb-80ff-9e76571e10f6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:26.788247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-12d6e29a-2888-45eb-80ff-9e76571e10f6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:26.796322 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-12d6e29a-2888-45eb-80ff-9e76571e10f6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152802 Aug 30 14:59:26.796879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 702/1395] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:26 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:27.217925 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4b1ecc29-3f88-4737-b0c3-e3c7ebb21e18 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:27.218531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4b1ecc29-3f88-4737-b0c3-e3c7ebb21e18 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:27.224881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b1ecc29-3f88-4737-b0c3-e3c7ebb21e18 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:27.225346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b1ecc29-3f88-4737-b0c3-e3c7ebb21e18 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:27.225776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b1ecc29-3f88-4737-b0c3-e3c7ebb21e18 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:27.226456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b1ecc29-3f88-4737-b0c3-e3c7ebb21e18 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:27.226897 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b1ecc29-3f88-4737-b0c3-e3c7ebb21e18 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:27.227341 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b1ecc29-3f88-4737-b0c3-e3c7ebb21e18 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:27.288584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4b1ecc29-3f88-4737-b0c3-e3c7ebb21e18 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:27.297087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4b1ecc29-3f88-4737-b0c3-e3c7ebb21e18 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:27.298549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4b1ecc29-3f88-4737-b0c3-e3c7ebb21e18 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:27.299752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4b1ecc29-3f88-4737-b0c3-e3c7ebb21e18 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085705 Aug 30 14:59:27.300304 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 694/1396] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:27 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:27.817661 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-35639c5a-a0d5-42b8-ab03-056e71ff3ece tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:27.818909 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-35639c5a-a0d5-42b8-ab03-056e71ff3ece tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:27.825775 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35639c5a-a0d5-42b8-ab03-056e71ff3ece tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:27.826250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35639c5a-a0d5-42b8-ab03-056e71ff3ece tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:27.826677 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35639c5a-a0d5-42b8-ab03-056e71ff3ece tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:27.827387 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35639c5a-a0d5-42b8-ab03-056e71ff3ece tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:27.827842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35639c5a-a0d5-42b8-ab03-056e71ff3ece tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:27.828244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35639c5a-a0d5-42b8-ab03-056e71ff3ece tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:27.956594 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-35639c5a-a0d5-42b8-ab03-056e71ff3ece tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:27.964858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-35639c5a-a0d5-42b8-ab03-056e71ff3ece tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151111 Aug 30 14:59:27.965420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 703/1397] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:27 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:28.322606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-409709e1-915a-432c-9f33-0979f399e979 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:28.323229 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-409709e1-915a-432c-9f33-0979f399e979 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:28.329588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-409709e1-915a-432c-9f33-0979f399e979 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:28.330068 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-409709e1-915a-432c-9f33-0979f399e979 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:28.330612 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-409709e1-915a-432c-9f33-0979f399e979 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:28.331336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-409709e1-915a-432c-9f33-0979f399e979 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:28.331786 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-409709e1-915a-432c-9f33-0979f399e979 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:28.332210 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-409709e1-915a-432c-9f33-0979f399e979 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:28.392782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-409709e1-915a-432c-9f33-0979f399e979 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:28.401972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-409709e1-915a-432c-9f33-0979f399e979 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:28.403437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-409709e1-915a-432c-9f33-0979f399e979 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:28.404699 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-409709e1-915a-432c-9f33-0979f399e979 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086274 Aug 30 14:59:28.405257 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 695/1398] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:28 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:28.986367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-79575db7-66d2-4e53-bff7-868b697d5a3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:28.986983 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-79575db7-66d2-4e53-bff7-868b697d5a3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:28.993968 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-79575db7-66d2-4e53-bff7-868b697d5a3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:28.994468 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-79575db7-66d2-4e53-bff7-868b697d5a3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:28.994893 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-79575db7-66d2-4e53-bff7-868b697d5a3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:28.995618 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-79575db7-66d2-4e53-bff7-868b697d5a3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:28.996063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-79575db7-66d2-4e53-bff7-868b697d5a3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:28.996477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-79575db7-66d2-4e53-bff7-868b697d5a3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:29.124388 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-79575db7-66d2-4e53-bff7-868b697d5a3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:29.132949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-79575db7-66d2-4e53-bff7-868b697d5a3c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150427 Aug 30 14:59:29.133507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 704/1399] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:28 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:29.426629 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6b265a4f-3ff4-4142-ad2c-66edf3de5182 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:29.427260 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6b265a4f-3ff4-4142-ad2c-66edf3de5182 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:29.434405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b265a4f-3ff4-4142-ad2c-66edf3de5182 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:29.434889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b265a4f-3ff4-4142-ad2c-66edf3de5182 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:29.435345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b265a4f-3ff4-4142-ad2c-66edf3de5182 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:29.436032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b265a4f-3ff4-4142-ad2c-66edf3de5182 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:29.436484 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b265a4f-3ff4-4142-ad2c-66edf3de5182 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:29.436909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b265a4f-3ff4-4142-ad2c-66edf3de5182 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:29.500166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6b265a4f-3ff4-4142-ad2c-66edf3de5182 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:29.508734 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6b265a4f-3ff4-4142-ad2c-66edf3de5182 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:29.510159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6b265a4f-3ff4-4142-ad2c-66edf3de5182 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:29.511324 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6b265a4f-3ff4-4142-ad2c-66edf3de5182 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088632 Aug 30 14:59:29.511893 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 696/1400] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:29 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:30.153898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-003df804-b73c-4744-92ca-ab19ca3a2036 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:30.154511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-003df804-b73c-4744-92ca-ab19ca3a2036 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:30.161228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-003df804-b73c-4744-92ca-ab19ca3a2036 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:30.161704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-003df804-b73c-4744-92ca-ab19ca3a2036 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:30.162638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-003df804-b73c-4744-92ca-ab19ca3a2036 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:30.163365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-003df804-b73c-4744-92ca-ab19ca3a2036 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:30.163819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-003df804-b73c-4744-92ca-ab19ca3a2036 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:30.164244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-003df804-b73c-4744-92ca-ab19ca3a2036 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:30.298407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-003df804-b73c-4744-92ca-ab19ca3a2036 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:30.307185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-003df804-b73c-4744-92ca-ab19ca3a2036 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.157280 Aug 30 14:59:30.307766 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 705/1401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:30 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:30.533982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fbf226a2-6196-4520-9d5a-209a63ea81c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:30.534520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fbf226a2-6196-4520-9d5a-209a63ea81c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:30.540936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fbf226a2-6196-4520-9d5a-209a63ea81c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:30.541417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fbf226a2-6196-4520-9d5a-209a63ea81c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:30.541852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fbf226a2-6196-4520-9d5a-209a63ea81c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:30.542537 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fbf226a2-6196-4520-9d5a-209a63ea81c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:30.542988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fbf226a2-6196-4520-9d5a-209a63ea81c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:30.543437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fbf226a2-6196-4520-9d5a-209a63ea81c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:30.604635 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fbf226a2-6196-4520-9d5a-209a63ea81c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:30.613181 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fbf226a2-6196-4520-9d5a-209a63ea81c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:30.614614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fbf226a2-6196-4520-9d5a-209a63ea81c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:30.616396 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fbf226a2-6196-4520-9d5a-209a63ea81c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086284 Aug 30 14:59:30.616958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 697/1402] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:30 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:31.329360 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b92d5159-6e1f-4908-b7f9-ad4bc737b43c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:31.329967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b92d5159-6e1f-4908-b7f9-ad4bc737b43c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:31.337351 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b92d5159-6e1f-4908-b7f9-ad4bc737b43c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:31.337828 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b92d5159-6e1f-4908-b7f9-ad4bc737b43c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:31.338252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b92d5159-6e1f-4908-b7f9-ad4bc737b43c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:31.338969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b92d5159-6e1f-4908-b7f9-ad4bc737b43c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:31.339449 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b92d5159-6e1f-4908-b7f9-ad4bc737b43c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:31.339868 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b92d5159-6e1f-4908-b7f9-ad4bc737b43c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:31.465379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b92d5159-6e1f-4908-b7f9-ad4bc737b43c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:31.473399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b92d5159-6e1f-4908-b7f9-ad4bc737b43c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147943 Aug 30 14:59:31.473960 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 706/1403] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:31 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:59:31.639497 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-09ecbc8f-9ada-4b90-b3ad-f7009edda586 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:31.640101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-09ecbc8f-9ada-4b90-b3ad-f7009edda586 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:31.647183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09ecbc8f-9ada-4b90-b3ad-f7009edda586 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:31.648064 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09ecbc8f-9ada-4b90-b3ad-f7009edda586 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:31.648838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09ecbc8f-9ada-4b90-b3ad-f7009edda586 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:31.649558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09ecbc8f-9ada-4b90-b3ad-f7009edda586 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:31.650003 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09ecbc8f-9ada-4b90-b3ad-f7009edda586 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:31.650419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09ecbc8f-9ada-4b90-b3ad-f7009edda586 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:31.711379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-09ecbc8f-9ada-4b90-b3ad-f7009edda586 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:31.719956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-09ecbc8f-9ada-4b90-b3ad-f7009edda586 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:31.721315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-09ecbc8f-9ada-4b90-b3ad-f7009edda586 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:31.722449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-09ecbc8f-9ada-4b90-b3ad-f7009edda586 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086884 Aug 30 14:59:31.723005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 698/1404] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:31 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:32.495544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3f8573e9-c326-428a-846d-30ee4139c0c2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:32.496110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3f8573e9-c326-428a-846d-30ee4139c0c2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:32.502540 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f8573e9-c326-428a-846d-30ee4139c0c2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:32.503011 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f8573e9-c326-428a-846d-30ee4139c0c2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:32.503476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f8573e9-c326-428a-846d-30ee4139c0c2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:32.504155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f8573e9-c326-428a-846d-30ee4139c0c2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:32.504599 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f8573e9-c326-428a-846d-30ee4139c0c2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:32.505013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f8573e9-c326-428a-846d-30ee4139c0c2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:32.633970 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3f8573e9-c326-428a-846d-30ee4139c0c2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:32.642703 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3f8573e9-c326-428a-846d-30ee4139c0c2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151191 Aug 30 14:59:32.643289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 707/1405] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:32 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:32.745355 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3f441ad8-1956-4e64-b7d4-859ff298d5d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:32.745996 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3f441ad8-1956-4e64-b7d4-859ff298d5d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:32.752456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f441ad8-1956-4e64-b7d4-859ff298d5d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:32.752918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f441ad8-1956-4e64-b7d4-859ff298d5d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:32.753343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f441ad8-1956-4e64-b7d4-859ff298d5d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:32.754020 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f441ad8-1956-4e64-b7d4-859ff298d5d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:32.754462 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f441ad8-1956-4e64-b7d4-859ff298d5d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:32.754876 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f441ad8-1956-4e64-b7d4-859ff298d5d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:32.817081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3f441ad8-1956-4e64-b7d4-859ff298d5d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:32.826071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3f441ad8-1956-4e64-b7d4-859ff298d5d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:32.827515 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3f441ad8-1956-4e64-b7d4-859ff298d5d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:32.828646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3f441ad8-1956-4e64-b7d4-859ff298d5d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087285 Aug 30 14:59:32.829195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 699/1406] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:32 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:33.664128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-65f7e8a3-c68f-4bce-8418-863c0f027b1d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:33.664994 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-65f7e8a3-c68f-4bce-8418-863c0f027b1d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:33.671359 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65f7e8a3-c68f-4bce-8418-863c0f027b1d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:33.671832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65f7e8a3-c68f-4bce-8418-863c0f027b1d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:33.672258 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65f7e8a3-c68f-4bce-8418-863c0f027b1d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:33.672931 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65f7e8a3-c68f-4bce-8418-863c0f027b1d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:33.673375 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65f7e8a3-c68f-4bce-8418-863c0f027b1d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:33.673787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65f7e8a3-c68f-4bce-8418-863c0f027b1d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:33.800345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-65f7e8a3-c68f-4bce-8418-863c0f027b1d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:33.809534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-65f7e8a3-c68f-4bce-8418-863c0f027b1d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149270 Aug 30 14:59:33.810074 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 708/1407] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:33 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:33.851908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fc373d43-0c5d-4311-99d7-2b4ff89e58c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:33.852517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fc373d43-0c5d-4311-99d7-2b4ff89e58c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:33.858831 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc373d43-0c5d-4311-99d7-2b4ff89e58c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:33.859343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc373d43-0c5d-4311-99d7-2b4ff89e58c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:33.859778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc373d43-0c5d-4311-99d7-2b4ff89e58c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:33.860469 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc373d43-0c5d-4311-99d7-2b4ff89e58c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:33.860917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc373d43-0c5d-4311-99d7-2b4ff89e58c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:33.861342 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc373d43-0c5d-4311-99d7-2b4ff89e58c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:33.925085 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fc373d43-0c5d-4311-99d7-2b4ff89e58c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:33.934169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fc373d43-0c5d-4311-99d7-2b4ff89e58c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:33.935637 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fc373d43-0c5d-4311-99d7-2b4ff89e58c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:33.936774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fc373d43-0c5d-4311-99d7-2b4ff89e58c3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089477 Aug 30 14:59:33.937336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 700/1408] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:33 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:34.831647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-44d048a6-8326-406f-82fe-960b4804b054 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:34.832260 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-44d048a6-8326-406f-82fe-960b4804b054 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:34.838889 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44d048a6-8326-406f-82fe-960b4804b054 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:34.839383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44d048a6-8326-406f-82fe-960b4804b054 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:34.839816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44d048a6-8326-406f-82fe-960b4804b054 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:34.840505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44d048a6-8326-406f-82fe-960b4804b054 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:34.840954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44d048a6-8326-406f-82fe-960b4804b054 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:34.841375 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44d048a6-8326-406f-82fe-960b4804b054 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:34.960221 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d4ba0898-3074-4f0b-b5f2-0be48b5b0e20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:34.960829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d4ba0898-3074-4f0b-b5f2-0be48b5b0e20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:34.967021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-44d048a6-8326-406f-82fe-960b4804b054 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:34.967936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4ba0898-3074-4f0b-b5f2-0be48b5b0e20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:34.968426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4ba0898-3074-4f0b-b5f2-0be48b5b0e20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:34.968864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4ba0898-3074-4f0b-b5f2-0be48b5b0e20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:34.969588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4ba0898-3074-4f0b-b5f2-0be48b5b0e20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:34.970036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4ba0898-3074-4f0b-b5f2-0be48b5b0e20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:34.970457 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4ba0898-3074-4f0b-b5f2-0be48b5b0e20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:34.975786 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-44d048a6-8326-406f-82fe-960b4804b054 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147902 Aug 30 14:59:34.976444 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 709/1409] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:34 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:35.274087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d4ba0898-3074-4f0b-b5f2-0be48b5b0e20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:35.282628 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d4ba0898-3074-4f0b-b5f2-0be48b5b0e20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:35.284101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d4ba0898-3074-4f0b-b5f2-0be48b5b0e20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:35.285250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d4ba0898-3074-4f0b-b5f2-0be48b5b0e20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.329443 Aug 30 14:59:35.285811 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 701/1410] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:34 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:59:35.997392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bafb9e45-1c5d-4ea5-928f-364efb4b9288 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:35.998076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bafb9e45-1c5d-4ea5-928f-364efb4b9288 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:36.004908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bafb9e45-1c5d-4ea5-928f-364efb4b9288 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:36.005385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bafb9e45-1c5d-4ea5-928f-364efb4b9288 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:36.006391 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bafb9e45-1c5d-4ea5-928f-364efb4b9288 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:36.007073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bafb9e45-1c5d-4ea5-928f-364efb4b9288 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:36.007549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bafb9e45-1c5d-4ea5-928f-364efb4b9288 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:36.007964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bafb9e45-1c5d-4ea5-928f-364efb4b9288 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:36.136490 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bafb9e45-1c5d-4ea5-928f-364efb4b9288 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:36.144585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bafb9e45-1c5d-4ea5-928f-364efb4b9288 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151177 Aug 30 14:59:36.145155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 710/1411] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:35 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:36.307805 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d1382c6c-8748-435a-8eea-71c4fba3b5e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:36.308411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d1382c6c-8748-435a-8eea-71c4fba3b5e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:36.314824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1382c6c-8748-435a-8eea-71c4fba3b5e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:36.315406 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1382c6c-8748-435a-8eea-71c4fba3b5e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:36.315839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1382c6c-8748-435a-8eea-71c4fba3b5e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:36.316522 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1382c6c-8748-435a-8eea-71c4fba3b5e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:36.316966 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1382c6c-8748-435a-8eea-71c4fba3b5e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:36.317386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1382c6c-8748-435a-8eea-71c4fba3b5e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:36.377380 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d1382c6c-8748-435a-8eea-71c4fba3b5e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:36.385860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d1382c6c-8748-435a-8eea-71c4fba3b5e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:36.387332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d1382c6c-8748-435a-8eea-71c4fba3b5e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:36.388474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d1382c6c-8748-435a-8eea-71c4fba3b5e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084551 Aug 30 14:59:36.389026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 702/1412] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:36 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:37.165928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1ee5f4ef-e171-427b-b7be-a3a3ec077ebb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:37.166520 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1ee5f4ef-e171-427b-b7be-a3a3ec077ebb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:37.172842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ee5f4ef-e171-427b-b7be-a3a3ec077ebb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:37.173314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ee5f4ef-e171-427b-b7be-a3a3ec077ebb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:37.173740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ee5f4ef-e171-427b-b7be-a3a3ec077ebb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:37.174424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ee5f4ef-e171-427b-b7be-a3a3ec077ebb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:37.174869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ee5f4ef-e171-427b-b7be-a3a3ec077ebb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:37.175304 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ee5f4ef-e171-427b-b7be-a3a3ec077ebb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:37.179811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:37.305806 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1ee5f4ef-e171-427b-b7be-a3a3ec077ebb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:37.313948 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1ee5f4ef-e171-427b-b7be-a3a3ec077ebb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152477 Aug 30 14:59:37.314501 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 711/1413] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:37 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:37.411429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9ac443dd-a1fb-4f74-8c10-ef286b71d909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:37.412076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9ac443dd-a1fb-4f74-8c10-ef286b71d909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:37.418382 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ac443dd-a1fb-4f74-8c10-ef286b71d909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:37.418798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ac443dd-a1fb-4f74-8c10-ef286b71d909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:37.419244 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ac443dd-a1fb-4f74-8c10-ef286b71d909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:37.419919 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ac443dd-a1fb-4f74-8c10-ef286b71d909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:37.420362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ac443dd-a1fb-4f74-8c10-ef286b71d909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:37.420776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ac443dd-a1fb-4f74-8c10-ef286b71d909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:37.486064 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9ac443dd-a1fb-4f74-8c10-ef286b71d909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:37.495426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9ac443dd-a1fb-4f74-8c10-ef286b71d909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:37.496876 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9ac443dd-a1fb-4f74-8c10-ef286b71d909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:37.498015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9ac443dd-a1fb-4f74-8c10-ef286b71d909 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090478 Aug 30 14:59:37.498562 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 703/1414] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:37 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:38.335437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ba86d3ab-dded-4ccf-9b3f-2b25a6e36d12 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:38.336046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ba86d3ab-dded-4ccf-9b3f-2b25a6e36d12 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:38.342404 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba86d3ab-dded-4ccf-9b3f-2b25a6e36d12 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:38.342880 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba86d3ab-dded-4ccf-9b3f-2b25a6e36d12 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:38.343342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba86d3ab-dded-4ccf-9b3f-2b25a6e36d12 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:38.344035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba86d3ab-dded-4ccf-9b3f-2b25a6e36d12 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:38.344479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba86d3ab-dded-4ccf-9b3f-2b25a6e36d12 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:38.344894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba86d3ab-dded-4ccf-9b3f-2b25a6e36d12 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:38.479990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ba86d3ab-dded-4ccf-9b3f-2b25a6e36d12 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:38.488316 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ba86d3ab-dded-4ccf-9b3f-2b25a6e36d12 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156843 Aug 30 14:59:38.489091 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 712/1415] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:38 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:38.522026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d9dcf3fd-183d-4092-9e58-5abc22454476 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:38.522683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d9dcf3fd-183d-4092-9e58-5abc22454476 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:38.529169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9dcf3fd-183d-4092-9e58-5abc22454476 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:38.529652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9dcf3fd-183d-4092-9e58-5abc22454476 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:38.530088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9dcf3fd-183d-4092-9e58-5abc22454476 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:38.530782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9dcf3fd-183d-4092-9e58-5abc22454476 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:38.531274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9dcf3fd-183d-4092-9e58-5abc22454476 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:38.531696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9dcf3fd-183d-4092-9e58-5abc22454476 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:38.609271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d9dcf3fd-183d-4092-9e58-5abc22454476 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:38.618542 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d9dcf3fd-183d-4092-9e58-5abc22454476 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:38.620029 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d9dcf3fd-183d-4092-9e58-5abc22454476 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:38.621176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d9dcf3fd-183d-4092-9e58-5abc22454476 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.103204 Aug 30 14:59:38.621741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 704/1416] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:38 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:39.511288 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-55f10279-812b-4621-97f7-00c6032a2d09 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:39.511831 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-55f10279-812b-4621-97f7-00c6032a2d09 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:39.518206 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55f10279-812b-4621-97f7-00c6032a2d09 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:39.518687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55f10279-812b-4621-97f7-00c6032a2d09 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:39.519123 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55f10279-812b-4621-97f7-00c6032a2d09 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:39.519839 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55f10279-812b-4621-97f7-00c6032a2d09 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:39.520299 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55f10279-812b-4621-97f7-00c6032a2d09 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:39.520730 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55f10279-812b-4621-97f7-00c6032a2d09 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:39.644424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b2034bbc-555b-4e87-ab00-e85e1fb89f2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:39.645039 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b2034bbc-555b-4e87-ab00-e85e1fb89f2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:39.649696 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-55f10279-812b-4621-97f7-00c6032a2d09 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:39.651676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2034bbc-555b-4e87-ab00-e85e1fb89f2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:39.652159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2034bbc-555b-4e87-ab00-e85e1fb89f2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:39.652595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2034bbc-555b-4e87-ab00-e85e1fb89f2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:39.653295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2034bbc-555b-4e87-ab00-e85e1fb89f2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:39.653756 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2034bbc-555b-4e87-ab00-e85e1fb89f2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:39.654178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2034bbc-555b-4e87-ab00-e85e1fb89f2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:39.658061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-55f10279-812b-4621-97f7-00c6032a2d09 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151438 Aug 30 14:59:39.658206 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:39.658995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 713/1417] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:39 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:39.723560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b2034bbc-555b-4e87-ab00-e85e1fb89f2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:39.732747 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b2034bbc-555b-4e87-ab00-e85e1fb89f2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:39.734171 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b2034bbc-555b-4e87-ab00-e85e1fb89f2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:39.735472 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b2034bbc-555b-4e87-ab00-e85e1fb89f2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.094830 Aug 30 14:59:39.736035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 705/1418] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:39 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:40.677915 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e651b01d-1bb4-4878-a4ee-d911377045e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:40.679180 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e651b01d-1bb4-4878-a4ee-d911377045e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:40.685623 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e651b01d-1bb4-4878-a4ee-d911377045e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:40.686110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e651b01d-1bb4-4878-a4ee-d911377045e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:40.686550 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e651b01d-1bb4-4878-a4ee-d911377045e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:40.687276 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e651b01d-1bb4-4878-a4ee-d911377045e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:40.687729 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e651b01d-1bb4-4878-a4ee-d911377045e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:40.688156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e651b01d-1bb4-4878-a4ee-d911377045e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:40.757618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ffde2f3f-5790-4e80-b272-bda74dfa5989 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:40.758321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ffde2f3f-5790-4e80-b272-bda74dfa5989 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:40.764966 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffde2f3f-5790-4e80-b272-bda74dfa5989 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:40.765092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffde2f3f-5790-4e80-b272-bda74dfa5989 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:40.765511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffde2f3f-5790-4e80-b272-bda74dfa5989 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:40.766199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffde2f3f-5790-4e80-b272-bda74dfa5989 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:40.766645 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffde2f3f-5790-4e80-b272-bda74dfa5989 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:40.767066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffde2f3f-5790-4e80-b272-bda74dfa5989 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:40.820998 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e651b01d-1bb4-4878-a4ee-d911377045e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:40.828742 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ffde2f3f-5790-4e80-b272-bda74dfa5989 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:40.829226 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e651b01d-1bb4-4878-a4ee-d911377045e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.155159 Aug 30 14:59:40.829805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 714/1419] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:40 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:40.837763 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ffde2f3f-5790-4e80-b272-bda74dfa5989 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:40.839237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ffde2f3f-5790-4e80-b272-bda74dfa5989 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:40.840384 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ffde2f3f-5790-4e80-b272-bda74dfa5989 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086764 Aug 30 14:59:40.840907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 706/1420] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:40 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:59:41.849975 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-44735f86-7456-4f9c-9493-f26334ec6f44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:41.850629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-44735f86-7456-4f9c-9493-f26334ec6f44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:41.857212 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44735f86-7456-4f9c-9493-f26334ec6f44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:41.857706 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44735f86-7456-4f9c-9493-f26334ec6f44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:41.858149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44735f86-7456-4f9c-9493-f26334ec6f44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:41.858887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44735f86-7456-4f9c-9493-f26334ec6f44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:41.859380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44735f86-7456-4f9c-9493-f26334ec6f44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:41.859820 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44735f86-7456-4f9c-9493-f26334ec6f44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:41.863429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2049103c-1231-4c54-a9bd-8655421541af tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:41.864113 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2049103c-1231-4c54-a9bd-8655421541af tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:41.871027 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2049103c-1231-4c54-a9bd-8655421541af tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:41.871605 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2049103c-1231-4c54-a9bd-8655421541af tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:41.872111 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2049103c-1231-4c54-a9bd-8655421541af tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:41.872866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2049103c-1231-4c54-a9bd-8655421541af tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:41.873386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2049103c-1231-4c54-a9bd-8655421541af tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:41.873810 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2049103c-1231-4c54-a9bd-8655421541af tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:41.936409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2049103c-1231-4c54-a9bd-8655421541af tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:41.946150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2049103c-1231-4c54-a9bd-8655421541af tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:41.947730 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2049103c-1231-4c54-a9bd-8655421541af tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:41.948880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2049103c-1231-4c54-a9bd-8655421541af tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089530 Aug 30 14:59:41.949442 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 707/1421] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:41 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:41.989366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-44735f86-7456-4f9c-9493-f26334ec6f44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:41.998058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-44735f86-7456-4f9c-9493-f26334ec6f44 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151962 Aug 30 14:59:41.998628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 715/1422] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:41 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:42.971181 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-37dceece-0097-47f7-8ae5-490b9de2b80e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:42.971910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-37dceece-0097-47f7-8ae5-490b9de2b80e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:42.978362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37dceece-0097-47f7-8ae5-490b9de2b80e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:42.978843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37dceece-0097-47f7-8ae5-490b9de2b80e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:42.979299 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37dceece-0097-47f7-8ae5-490b9de2b80e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:42.979981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37dceece-0097-47f7-8ae5-490b9de2b80e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:42.980431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37dceece-0097-47f7-8ae5-490b9de2b80e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:42.980847 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37dceece-0097-47f7-8ae5-490b9de2b80e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:43.018595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bd553620-7cd8-4578-8b11-846dd664c903 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:43.019230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bd553620-7cd8-4578-8b11-846dd664c903 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:43.026707 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd553620-7cd8-4578-8b11-846dd664c903 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:43.027193 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd553620-7cd8-4578-8b11-846dd664c903 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:43.027665 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd553620-7cd8-4578-8b11-846dd664c903 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:43.028368 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd553620-7cd8-4578-8b11-846dd664c903 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:43.028819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd553620-7cd8-4578-8b11-846dd664c903 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:43.029242 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd553620-7cd8-4578-8b11-846dd664c903 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:43.046112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-37dceece-0097-47f7-8ae5-490b9de2b80e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:43.054830 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-37dceece-0097-47f7-8ae5-490b9de2b80e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:43.056313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-37dceece-0097-47f7-8ae5-490b9de2b80e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:43.057465 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-37dceece-0097-47f7-8ae5-490b9de2b80e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090211 Aug 30 14:59:43.058036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 708/1423] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:42 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:43.155961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bd553620-7cd8-4578-8b11-846dd664c903 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:43.164370 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bd553620-7cd8-4578-8b11-846dd664c903 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149626 Aug 30 14:59:43.164945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 716/1424] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:43 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 14:59:44.080461 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-667e315a-28b9-4bd4-a582-32d81ef39de4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:44.081059 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-667e315a-28b9-4bd4-a582-32d81ef39de4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:44.088297 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-667e315a-28b9-4bd4-a582-32d81ef39de4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:44.088772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-667e315a-28b9-4bd4-a582-32d81ef39de4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:44.089231 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-667e315a-28b9-4bd4-a582-32d81ef39de4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:44.089909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-667e315a-28b9-4bd4-a582-32d81ef39de4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:44.090351 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-667e315a-28b9-4bd4-a582-32d81ef39de4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:44.090792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-667e315a-28b9-4bd4-a582-32d81ef39de4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:44.151459 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-667e315a-28b9-4bd4-a582-32d81ef39de4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:44.159866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-667e315a-28b9-4bd4-a582-32d81ef39de4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:44.161297 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-667e315a-28b9-4bd4-a582-32d81ef39de4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:44.162423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-667e315a-28b9-4bd4-a582-32d81ef39de4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085884 Aug 30 14:59:44.163963 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 709/1425] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:44 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:44.184407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-61991305-1bf5-4af2-9ea2-1274852db9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:44.185026 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-61991305-1bf5-4af2-9ea2-1274852db9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:44.191847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61991305-1bf5-4af2-9ea2-1274852db9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:44.192322 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61991305-1bf5-4af2-9ea2-1274852db9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:44.192750 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61991305-1bf5-4af2-9ea2-1274852db9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:44.193432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61991305-1bf5-4af2-9ea2-1274852db9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:44.194023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61991305-1bf5-4af2-9ea2-1274852db9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:44.194507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61991305-1bf5-4af2-9ea2-1274852db9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:44.325604 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-61991305-1bf5-4af2-9ea2-1274852db9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:44.333758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-61991305-1bf5-4af2-9ea2-1274852db9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153220 Aug 30 14:59:44.334335 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 717/1426] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:44 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:45.185917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1bec58f7-4a10-4712-9f95-8ec4b612b7f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:45.186517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1bec58f7-4a10-4712-9f95-8ec4b612b7f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:45.192836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bec58f7-4a10-4712-9f95-8ec4b612b7f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:45.193309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bec58f7-4a10-4712-9f95-8ec4b612b7f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:45.193783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bec58f7-4a10-4712-9f95-8ec4b612b7f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:45.194637 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bec58f7-4a10-4712-9f95-8ec4b612b7f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:45.195100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bec58f7-4a10-4712-9f95-8ec4b612b7f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:45.195555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bec58f7-4a10-4712-9f95-8ec4b612b7f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:45.256854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1bec58f7-4a10-4712-9f95-8ec4b612b7f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:45.265871 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1bec58f7-4a10-4712-9f95-8ec4b612b7f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:45.267345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1bec58f7-4a10-4712-9f95-8ec4b612b7f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:45.268495 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1bec58f7-4a10-4712-9f95-8ec4b612b7f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086483 Aug 30 14:59:45.269054 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 710/1427] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:45 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:45.354701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4869aa04-2edb-4db5-bd51-0391d108c3e2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:45.355344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4869aa04-2edb-4db5-bd51-0391d108c3e2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:45.361829 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4869aa04-2edb-4db5-bd51-0391d108c3e2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:45.362299 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4869aa04-2edb-4db5-bd51-0391d108c3e2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:45.362723 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4869aa04-2edb-4db5-bd51-0391d108c3e2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:45.363441 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4869aa04-2edb-4db5-bd51-0391d108c3e2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:45.363881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4869aa04-2edb-4db5-bd51-0391d108c3e2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:45.364294 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4869aa04-2edb-4db5-bd51-0391d108c3e2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:45.493450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4869aa04-2edb-4db5-bd51-0391d108c3e2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:45.501791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4869aa04-2edb-4db5-bd51-0391d108c3e2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151505 Aug 30 14:59:45.507612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 718/1428] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:45 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:46.291313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8d86ed9e-168e-45f7-a40d-90737fa8c176 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:46.291924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8d86ed9e-168e-45f7-a40d-90737fa8c176 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:46.298292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d86ed9e-168e-45f7-a40d-90737fa8c176 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:46.298757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d86ed9e-168e-45f7-a40d-90737fa8c176 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:46.299186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d86ed9e-168e-45f7-a40d-90737fa8c176 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:46.299894 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d86ed9e-168e-45f7-a40d-90737fa8c176 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:46.300343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d86ed9e-168e-45f7-a40d-90737fa8c176 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:46.300759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d86ed9e-168e-45f7-a40d-90737fa8c176 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:46.361614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8d86ed9e-168e-45f7-a40d-90737fa8c176 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:46.372378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8d86ed9e-168e-45f7-a40d-90737fa8c176 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:46.373807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8d86ed9e-168e-45f7-a40d-90737fa8c176 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:46.374950 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8d86ed9e-168e-45f7-a40d-90737fa8c176 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088163 Aug 30 14:59:46.375557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 711/1429] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:46 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:46.524421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fb86b765-e266-4ed5-ba02-2d32514689b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:46.524946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fb86b765-e266-4ed5-ba02-2d32514689b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:46.531309 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb86b765-e266-4ed5-ba02-2d32514689b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:46.531789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb86b765-e266-4ed5-ba02-2d32514689b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:46.532219 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb86b765-e266-4ed5-ba02-2d32514689b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:46.532903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb86b765-e266-4ed5-ba02-2d32514689b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:46.533348 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb86b765-e266-4ed5-ba02-2d32514689b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:46.533762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb86b765-e266-4ed5-ba02-2d32514689b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:46.661891 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fb86b765-e266-4ed5-ba02-2d32514689b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:46.670423 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fb86b765-e266-4ed5-ba02-2d32514689b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150813 Aug 30 14:59:46.670982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 719/1430] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:46 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:47.397832 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-64dad34d-0cba-422f-a03a-05bd17a9b8bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:47.398430 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-64dad34d-0cba-422f-a03a-05bd17a9b8bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:47.404830 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64dad34d-0cba-422f-a03a-05bd17a9b8bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:47.405309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64dad34d-0cba-422f-a03a-05bd17a9b8bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:47.405736 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64dad34d-0cba-422f-a03a-05bd17a9b8bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:47.406416 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64dad34d-0cba-422f-a03a-05bd17a9b8bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:47.406862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64dad34d-0cba-422f-a03a-05bd17a9b8bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:47.407308 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64dad34d-0cba-422f-a03a-05bd17a9b8bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:47.473651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-64dad34d-0cba-422f-a03a-05bd17a9b8bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:47.482070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-64dad34d-0cba-422f-a03a-05bd17a9b8bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:47.483531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-64dad34d-0cba-422f-a03a-05bd17a9b8bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:47.484668 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-64dad34d-0cba-422f-a03a-05bd17a9b8bf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091329 Aug 30 14:59:47.485232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 712/1431] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:47 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:59:47.692341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e126ee58-069e-4fe0-bd96-ffc2c28717b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:47.692950 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e126ee58-069e-4fe0-bd96-ffc2c28717b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:47.700280 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e126ee58-069e-4fe0-bd96-ffc2c28717b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:47.700758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e126ee58-069e-4fe0-bd96-ffc2c28717b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:47.701185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e126ee58-069e-4fe0-bd96-ffc2c28717b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:47.701874 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e126ee58-069e-4fe0-bd96-ffc2c28717b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:47.702321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e126ee58-069e-4fe0-bd96-ffc2c28717b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:47.702748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e126ee58-069e-4fe0-bd96-ffc2c28717b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:47.830658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e126ee58-069e-4fe0-bd96-ffc2c28717b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:47.838830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e126ee58-069e-4fe0-bd96-ffc2c28717b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150355 Aug 30 14:59:47.839423 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 720/1432] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:47 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:48.507776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-308dab77-c234-4b05-a089-9c9df323856d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:48.508321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-308dab77-c234-4b05-a089-9c9df323856d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:48.514591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-308dab77-c234-4b05-a089-9c9df323856d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:48.515090 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-308dab77-c234-4b05-a089-9c9df323856d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:48.515574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-308dab77-c234-4b05-a089-9c9df323856d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:48.516248 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-308dab77-c234-4b05-a089-9c9df323856d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:48.516688 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-308dab77-c234-4b05-a089-9c9df323856d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:48.517140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-308dab77-c234-4b05-a089-9c9df323856d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:48.579684 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-308dab77-c234-4b05-a089-9c9df323856d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:48.588684 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-308dab77-c234-4b05-a089-9c9df323856d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:48.590125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-308dab77-c234-4b05-a089-9c9df323856d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:48.591289 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-308dab77-c234-4b05-a089-9c9df323856d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087523 Aug 30 14:59:48.591850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 713/1433] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:48 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:48.859876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9d02d735-3d68-4e2d-9351-a4abed65768a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:48.860479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9d02d735-3d68-4e2d-9351-a4abed65768a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:48.867140 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d02d735-3d68-4e2d-9351-a4abed65768a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:48.867682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d02d735-3d68-4e2d-9351-a4abed65768a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:48.868116 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d02d735-3d68-4e2d-9351-a4abed65768a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:48.868815 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d02d735-3d68-4e2d-9351-a4abed65768a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:48.869266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d02d735-3d68-4e2d-9351-a4abed65768a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:48.869691 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9d02d735-3d68-4e2d-9351-a4abed65768a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:48.994593 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9d02d735-3d68-4e2d-9351-a4abed65768a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:49.002670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9d02d735-3d68-4e2d-9351-a4abed65768a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.146686 Aug 30 14:59:49.003246 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 721/1434] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:48 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:49.613868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e7bab6b4-a0d8-48b6-8b46-e831070938a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:49.614474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e7bab6b4-a0d8-48b6-8b46-e831070938a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:49.617510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=54 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:49.623131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7bab6b4-a0d8-48b6-8b46-e831070938a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:49.623625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7bab6b4-a0d8-48b6-8b46-e831070938a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:49.624048 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7bab6b4-a0d8-48b6-8b46-e831070938a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:49.624728 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7bab6b4-a0d8-48b6-8b46-e831070938a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:49.625171 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7bab6b4-a0d8-48b6-8b46-e831070938a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:49.625586 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7bab6b4-a0d8-48b6-8b46-e831070938a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:49.687906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e7bab6b4-a0d8-48b6-8b46-e831070938a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:49.697006 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e7bab6b4-a0d8-48b6-8b46-e831070938a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:49.698421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e7bab6b4-a0d8-48b6-8b46-e831070938a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:49.699602 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e7bab6b4-a0d8-48b6-8b46-e831070938a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089593 Aug 30 14:59:49.700158 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 714/1435] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:49 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:50.024519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a4255ea5-bebe-43ce-85f5-ad3cef64c268 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:50.025068 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a4255ea5-bebe-43ce-85f5-ad3cef64c268 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:50.027143 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=52 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:50.032535 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a4255ea5-bebe-43ce-85f5-ad3cef64c268 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:50.033017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a4255ea5-bebe-43ce-85f5-ad3cef64c268 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:50.033477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a4255ea5-bebe-43ce-85f5-ad3cef64c268 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:50.034173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a4255ea5-bebe-43ce-85f5-ad3cef64c268 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:50.034624 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a4255ea5-bebe-43ce-85f5-ad3cef64c268 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:50.035048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a4255ea5-bebe-43ce-85f5-ad3cef64c268 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:50.166945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a4255ea5-bebe-43ce-85f5-ad3cef64c268 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:50.175015 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a4255ea5-bebe-43ce-85f5-ad3cef64c268 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.154960 Aug 30 14:59:50.175615 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 722/1436] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:50 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:50.722317 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7a0b151d-a182-4eaf-860c-5a2090647e3e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:50.722875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7a0b151d-a182-4eaf-860c-5a2090647e3e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:50.729332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a0b151d-a182-4eaf-860c-5a2090647e3e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:50.729804 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a0b151d-a182-4eaf-860c-5a2090647e3e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:50.730233 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a0b151d-a182-4eaf-860c-5a2090647e3e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:50.730909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a0b151d-a182-4eaf-860c-5a2090647e3e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:50.731394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a0b151d-a182-4eaf-860c-5a2090647e3e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:50.731810 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a0b151d-a182-4eaf-860c-5a2090647e3e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:50.792619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7a0b151d-a182-4eaf-860c-5a2090647e3e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:50.801080 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7a0b151d-a182-4eaf-860c-5a2090647e3e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:50.802505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7a0b151d-a182-4eaf-860c-5a2090647e3e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:50.803661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7a0b151d-a182-4eaf-860c-5a2090647e3e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085369 Aug 30 14:59:50.804908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 715/1437] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:50 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:51.196901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7333e682-2eab-4e93-8f8d-fe9216e45961 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:51.197511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7333e682-2eab-4e93-8f8d-fe9216e45961 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:51.204175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7333e682-2eab-4e93-8f8d-fe9216e45961 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:51.204651 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7333e682-2eab-4e93-8f8d-fe9216e45961 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:51.205106 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7333e682-2eab-4e93-8f8d-fe9216e45961 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:51.205768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7333e682-2eab-4e93-8f8d-fe9216e45961 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:51.206209 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7333e682-2eab-4e93-8f8d-fe9216e45961 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:51.206623 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7333e682-2eab-4e93-8f8d-fe9216e45961 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:51.336365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7333e682-2eab-4e93-8f8d-fe9216e45961 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:51.344502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7333e682-2eab-4e93-8f8d-fe9216e45961 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152359 Aug 30 14:59:51.345083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 723/1438] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:51 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:51.826686 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7b4e3681-3c1a-4c79-b2d7-eedaabc9f75e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:51.827318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7b4e3681-3c1a-4c79-b2d7-eedaabc9f75e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:51.833683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b4e3681-3c1a-4c79-b2d7-eedaabc9f75e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:51.834169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b4e3681-3c1a-4c79-b2d7-eedaabc9f75e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:51.834619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b4e3681-3c1a-4c79-b2d7-eedaabc9f75e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:51.835937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b4e3681-3c1a-4c79-b2d7-eedaabc9f75e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:51.836398 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b4e3681-3c1a-4c79-b2d7-eedaabc9f75e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:51.836824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b4e3681-3c1a-4c79-b2d7-eedaabc9f75e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:51.899701 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7b4e3681-3c1a-4c79-b2d7-eedaabc9f75e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:51.908445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7b4e3681-3c1a-4c79-b2d7-eedaabc9f75e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:51.909921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7b4e3681-3c1a-4c79-b2d7-eedaabc9f75e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:51.911101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7b4e3681-3c1a-4c79-b2d7-eedaabc9f75e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088340 Aug 30 14:59:51.911743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 716/1439] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:51 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:52.365860 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2fed538e-4bb6-4002-aad9-0d0e3074b990 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:52.367006 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2fed538e-4bb6-4002-aad9-0d0e3074b990 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:52.373622 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2fed538e-4bb6-4002-aad9-0d0e3074b990 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:52.374096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2fed538e-4bb6-4002-aad9-0d0e3074b990 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:52.374527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2fed538e-4bb6-4002-aad9-0d0e3074b990 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:52.375229 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2fed538e-4bb6-4002-aad9-0d0e3074b990 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:52.375675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2fed538e-4bb6-4002-aad9-0d0e3074b990 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:52.376095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2fed538e-4bb6-4002-aad9-0d0e3074b990 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:52.505214 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2fed538e-4bb6-4002-aad9-0d0e3074b990 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:52.513905 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2fed538e-4bb6-4002-aad9-0d0e3074b990 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151877 Aug 30 14:59:52.514472 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 724/1440] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:52 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:52.934592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6ecf8032-ed3f-4357-ae51-2bdcba55c5f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:52.935199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6ecf8032-ed3f-4357-ae51-2bdcba55c5f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:52.941561 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ecf8032-ed3f-4357-ae51-2bdcba55c5f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:52.942039 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ecf8032-ed3f-4357-ae51-2bdcba55c5f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:52.942471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ecf8032-ed3f-4357-ae51-2bdcba55c5f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:52.943150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ecf8032-ed3f-4357-ae51-2bdcba55c5f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:52.943624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ecf8032-ed3f-4357-ae51-2bdcba55c5f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:52.944042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ecf8032-ed3f-4357-ae51-2bdcba55c5f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:53.006321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6ecf8032-ed3f-4357-ae51-2bdcba55c5f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:53.014885 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6ecf8032-ed3f-4357-ae51-2bdcba55c5f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:53.016398 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6ecf8032-ed3f-4357-ae51-2bdcba55c5f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:53.017571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6ecf8032-ed3f-4357-ae51-2bdcba55c5f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086891 Aug 30 14:59:53.018136 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 717/1441] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:52 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:53.534960 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c33c343a-c359-4eaf-8dbe-59af2d078e6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:53.535532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c33c343a-c359-4eaf-8dbe-59af2d078e6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:53.542422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c33c343a-c359-4eaf-8dbe-59af2d078e6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:53.542901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c33c343a-c359-4eaf-8dbe-59af2d078e6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:53.543356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c33c343a-c359-4eaf-8dbe-59af2d078e6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:53.544043 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c33c343a-c359-4eaf-8dbe-59af2d078e6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:53.544487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c33c343a-c359-4eaf-8dbe-59af2d078e6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:53.544903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c33c343a-c359-4eaf-8dbe-59af2d078e6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:53.673518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c33c343a-c359-4eaf-8dbe-59af2d078e6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:53.682327 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c33c343a-c359-4eaf-8dbe-59af2d078e6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151241 Aug 30 14:59:53.682887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 725/1442] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:53 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:54.041246 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b8ba72d4-849c-4382-912a-813bd5f63107 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:54.041852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b8ba72d4-849c-4382-912a-813bd5f63107 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:54.048449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8ba72d4-849c-4382-912a-813bd5f63107 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:54.048929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8ba72d4-849c-4382-912a-813bd5f63107 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:54.049394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8ba72d4-849c-4382-912a-813bd5f63107 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:54.050083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8ba72d4-849c-4382-912a-813bd5f63107 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:54.050532 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8ba72d4-849c-4382-912a-813bd5f63107 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:54.050954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8ba72d4-849c-4382-912a-813bd5f63107 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:54.113803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b8ba72d4-849c-4382-912a-813bd5f63107 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:54.122489 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b8ba72d4-849c-4382-912a-813bd5f63107 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:54.123954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b8ba72d4-849c-4382-912a-813bd5f63107 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:54.125090 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b8ba72d4-849c-4382-912a-813bd5f63107 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088413 Aug 30 14:59:54.125658 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 718/1443] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:54 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 14:59:54.703836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2d5e273e-a31a-463b-a246-44201cde0628 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:54.704433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2d5e273e-a31a-463b-a246-44201cde0628 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:54.711142 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d5e273e-a31a-463b-a246-44201cde0628 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:54.711649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d5e273e-a31a-463b-a246-44201cde0628 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:54.712078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d5e273e-a31a-463b-a246-44201cde0628 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:54.712796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d5e273e-a31a-463b-a246-44201cde0628 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:54.713243 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d5e273e-a31a-463b-a246-44201cde0628 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:54.713662 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d5e273e-a31a-463b-a246-44201cde0628 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:54.844988 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2d5e273e-a31a-463b-a246-44201cde0628 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:54.854451 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2d5e273e-a31a-463b-a246-44201cde0628 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.154423 Aug 30 14:59:54.855019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 726/1444] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:54 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:55.148093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9ce4deaa-60f6-4da3-afd2-d75381e1de94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:55.148794 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9ce4deaa-60f6-4da3-afd2-d75381e1de94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:55.155200 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ce4deaa-60f6-4da3-afd2-d75381e1de94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:55.155701 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ce4deaa-60f6-4da3-afd2-d75381e1de94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:55.156131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ce4deaa-60f6-4da3-afd2-d75381e1de94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:55.156813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ce4deaa-60f6-4da3-afd2-d75381e1de94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:55.157256 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ce4deaa-60f6-4da3-afd2-d75381e1de94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:55.157672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ce4deaa-60f6-4da3-afd2-d75381e1de94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:55.220269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9ce4deaa-60f6-4da3-afd2-d75381e1de94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:55.229997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9ce4deaa-60f6-4da3-afd2-d75381e1de94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:55.231463 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9ce4deaa-60f6-4da3-afd2-d75381e1de94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:55.232608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9ce4deaa-60f6-4da3-afd2-d75381e1de94 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088580 Aug 30 14:59:55.233159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 719/1445] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:55 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:55.876848 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b30b3987-acb4-48fc-8638-02507f551125 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:55.877392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b30b3987-acb4-48fc-8638-02507f551125 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:55.884391 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b30b3987-acb4-48fc-8638-02507f551125 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:55.884863 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b30b3987-acb4-48fc-8638-02507f551125 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:55.885294 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b30b3987-acb4-48fc-8638-02507f551125 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:55.885974 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b30b3987-acb4-48fc-8638-02507f551125 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:55.886418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b30b3987-acb4-48fc-8638-02507f551125 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:55.886830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b30b3987-acb4-48fc-8638-02507f551125 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:56.015254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b30b3987-acb4-48fc-8638-02507f551125 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:56.018824 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:56.024504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b30b3987-acb4-48fc-8638-02507f551125 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151599 Aug 30 14:59:56.025079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 727/1446] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:55 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:56.254970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-45c0cd9c-7f86-4f41-87ed-a3e40fa1dcb4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:56.255602 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-45c0cd9c-7f86-4f41-87ed-a3e40fa1dcb4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:56.262943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45c0cd9c-7f86-4f41-87ed-a3e40fa1dcb4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:56.263462 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45c0cd9c-7f86-4f41-87ed-a3e40fa1dcb4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:56.263893 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45c0cd9c-7f86-4f41-87ed-a3e40fa1dcb4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:56.264575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45c0cd9c-7f86-4f41-87ed-a3e40fa1dcb4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:56.265025 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45c0cd9c-7f86-4f41-87ed-a3e40fa1dcb4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:56.265444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45c0cd9c-7f86-4f41-87ed-a3e40fa1dcb4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:56.329033 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45c0cd9c-7f86-4f41-87ed-a3e40fa1dcb4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:56.337592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45c0cd9c-7f86-4f41-87ed-a3e40fa1dcb4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:56.339032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45c0cd9c-7f86-4f41-87ed-a3e40fa1dcb4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:56.340216 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-45c0cd9c-7f86-4f41-87ed-a3e40fa1dcb4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089213 Aug 30 14:59:56.340764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 720/1447] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:56 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:57.045967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8adb81a1-4e4e-446f-ad39-bed484a82060 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:57.046578 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8adb81a1-4e4e-446f-ad39-bed484a82060 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:57.053004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8adb81a1-4e4e-446f-ad39-bed484a82060 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:57.053483 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8adb81a1-4e4e-446f-ad39-bed484a82060 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:57.053916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8adb81a1-4e4e-446f-ad39-bed484a82060 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:57.054855 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8adb81a1-4e4e-446f-ad39-bed484a82060 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:57.055346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8adb81a1-4e4e-446f-ad39-bed484a82060 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:57.055776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8adb81a1-4e4e-446f-ad39-bed484a82060 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:57.182333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8adb81a1-4e4e-446f-ad39-bed484a82060 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:57.190439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8adb81a1-4e4e-446f-ad39-bed484a82060 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148536 Aug 30 14:59:57.191012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 728/1448] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:57 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:57.363132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5107abe0-665f-4dce-8ab8-9506028e9961 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:57.363772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5107abe0-665f-4dce-8ab8-9506028e9961 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:57.370327 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5107abe0-665f-4dce-8ab8-9506028e9961 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:57.370799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5107abe0-665f-4dce-8ab8-9506028e9961 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:57.371245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5107abe0-665f-4dce-8ab8-9506028e9961 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:57.371930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5107abe0-665f-4dce-8ab8-9506028e9961 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:57.372379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5107abe0-665f-4dce-8ab8-9506028e9961 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:57.372798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5107abe0-665f-4dce-8ab8-9506028e9961 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:57.433376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5107abe0-665f-4dce-8ab8-9506028e9961 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:57.436743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 14:59:57.442597 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5107abe0-665f-4dce-8ab8-9506028e9961 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:57.444066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5107abe0-665f-4dce-8ab8-9506028e9961 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:57.446310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5107abe0-665f-4dce-8ab8-9506028e9961 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086814 Aug 30 14:59:57.446868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 721/1449] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:57 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:58.211917 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b89b6dc7-c12f-42e3-98f5-a4bcdf588c4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:58.212971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b89b6dc7-c12f-42e3-98f5-a4bcdf588c4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:58.218952 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b89b6dc7-c12f-42e3-98f5-a4bcdf588c4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:58.219478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b89b6dc7-c12f-42e3-98f5-a4bcdf588c4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:58.219903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b89b6dc7-c12f-42e3-98f5-a4bcdf588c4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:58.220598 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b89b6dc7-c12f-42e3-98f5-a4bcdf588c4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:58.221050 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b89b6dc7-c12f-42e3-98f5-a4bcdf588c4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:58.221469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b89b6dc7-c12f-42e3-98f5-a4bcdf588c4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:58.350640 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b89b6dc7-c12f-42e3-98f5-a4bcdf588c4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:58.360123 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b89b6dc7-c12f-42e3-98f5-a4bcdf588c4c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152662 Aug 30 14:59:58.360684 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 729/1450] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:58 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:58.468295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-21c8e717-af79-42e1-a2ea-20284d85a053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:58.468821 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-21c8e717-af79-42e1-a2ea-20284d85a053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:58.476591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21c8e717-af79-42e1-a2ea-20284d85a053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:58.477083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21c8e717-af79-42e1-a2ea-20284d85a053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:58.477515 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21c8e717-af79-42e1-a2ea-20284d85a053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:58.478211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21c8e717-af79-42e1-a2ea-20284d85a053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:58.478663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21c8e717-af79-42e1-a2ea-20284d85a053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:58.479082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21c8e717-af79-42e1-a2ea-20284d85a053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:58.539462 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-21c8e717-af79-42e1-a2ea-20284d85a053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:58.547879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-21c8e717-af79-42e1-a2ea-20284d85a053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:58.549317 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-21c8e717-af79-42e1-a2ea-20284d85a053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:58.550452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-21c8e717-af79-42e1-a2ea-20284d85a053 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086385 Aug 30 14:59:58.551012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 722/1451] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:58 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 14:59:59.381568 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-46405070-2ed4-4f33-a31b-8295a6289bbf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:59.382181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-46405070-2ed4-4f33-a31b-8295a6289bbf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:59.388893 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46405070-2ed4-4f33-a31b-8295a6289bbf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:59.389374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46405070-2ed4-4f33-a31b-8295a6289bbf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:59.389808 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46405070-2ed4-4f33-a31b-8295a6289bbf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:59.390499 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46405070-2ed4-4f33-a31b-8295a6289bbf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:59.390982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46405070-2ed4-4f33-a31b-8295a6289bbf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:59.391435 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46405070-2ed4-4f33-a31b-8295a6289bbf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:59.517260 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-46405070-2ed4-4f33-a31b-8295a6289bbf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:59.525353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-46405070-2ed4-4f33-a31b-8295a6289bbf tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147742 Aug 30 14:59:59.525932 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 730/1452] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 14:59:59 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 14:59:59.572211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-aeaee583-6bac-4947-b1b5-5548772117cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 14:59:59.572823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-aeaee583-6bac-4947-b1b5-5548772117cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 14:59:59.579142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aeaee583-6bac-4947-b1b5-5548772117cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:59.579776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aeaee583-6bac-4947-b1b5-5548772117cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:59.580211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aeaee583-6bac-4947-b1b5-5548772117cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:59.580929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aeaee583-6bac-4947-b1b5-5548772117cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 14:59:59.581382 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aeaee583-6bac-4947-b1b5-5548772117cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 14:59:59.581803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aeaee583-6bac-4947-b1b5-5548772117cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 14:59:59.642929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-aeaee583-6bac-4947-b1b5-5548772117cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:59.651792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-aeaee583-6bac-4947-b1b5-5548772117cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:59.653227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-aeaee583-6bac-4947-b1b5-5548772117cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 14:59:59.654364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-aeaee583-6bac-4947-b1b5-5548772117cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086283 Aug 30 14:59:59.654918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 723/1453] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 14:59:59 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:00.546646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2a05e74b-0f1e-43e3-902a-432ad5800606 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:00.547199 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2a05e74b-0f1e-43e3-902a-432ad5800606 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:00.553640 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a05e74b-0f1e-43e3-902a-432ad5800606 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:00.554634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a05e74b-0f1e-43e3-902a-432ad5800606 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:00.555139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a05e74b-0f1e-43e3-902a-432ad5800606 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:00.555838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a05e74b-0f1e-43e3-902a-432ad5800606 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:00.556283 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a05e74b-0f1e-43e3-902a-432ad5800606 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:00.556712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a05e74b-0f1e-43e3-902a-432ad5800606 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:00.677723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e3d914ae-6799-4fca-812e-b843e0953d17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:00.678365 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e3d914ae-6799-4fca-812e-b843e0953d17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:00.685450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d914ae-6799-4fca-812e-b843e0953d17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:00.685937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d914ae-6799-4fca-812e-b843e0953d17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:00.686206 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2a05e74b-0f1e-43e3-902a-432ad5800606 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:00.686372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d914ae-6799-4fca-812e-b843e0953d17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:00.687079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d914ae-6799-4fca-812e-b843e0953d17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:00.687702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d914ae-6799-4fca-812e-b843e0953d17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:00.688134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3d914ae-6799-4fca-812e-b843e0953d17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:00.694768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2a05e74b-0f1e-43e3-902a-432ad5800606 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152106 Aug 30 15:00:00.696329 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 731/1454] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:00 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:00.753015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e3d914ae-6799-4fca-812e-b843e0953d17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:00.762530 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e3d914ae-6799-4fca-812e-b843e0953d17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:00.763982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e3d914ae-6799-4fca-812e-b843e0953d17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:00.765118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e3d914ae-6799-4fca-812e-b843e0953d17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091297 Aug 30 15:00:00.765673 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 724/1455] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:00 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:00:01.717186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4e3b9dee-d16f-4077-8d97-8017c940d09f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:01.717804 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4e3b9dee-d16f-4077-8d97-8017c940d09f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:01.724238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4e3b9dee-d16f-4077-8d97-8017c940d09f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:01.724718 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4e3b9dee-d16f-4077-8d97-8017c940d09f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:01.725154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4e3b9dee-d16f-4077-8d97-8017c940d09f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:01.725847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4e3b9dee-d16f-4077-8d97-8017c940d09f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:01.728034 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4e3b9dee-d16f-4077-8d97-8017c940d09f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:01.728034 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4e3b9dee-d16f-4077-8d97-8017c940d09f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:01.787495 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e7f26911-518b-42bc-8a1d-341f3f99f208 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:01.788224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e7f26911-518b-42bc-8a1d-341f3f99f208 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:01.795058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7f26911-518b-42bc-8a1d-341f3f99f208 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:01.795644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7f26911-518b-42bc-8a1d-341f3f99f208 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:01.796140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7f26911-518b-42bc-8a1d-341f3f99f208 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:01.796896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7f26911-518b-42bc-8a1d-341f3f99f208 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:01.797409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7f26911-518b-42bc-8a1d-341f3f99f208 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:01.797833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7f26911-518b-42bc-8a1d-341f3f99f208 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:01.857845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4e3b9dee-d16f-4077-8d97-8017c940d09f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:01.861105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e7f26911-518b-42bc-8a1d-341f3f99f208 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:01.866044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4e3b9dee-d16f-4077-8d97-8017c940d09f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152764 Aug 30 15:00:01.866785 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 732/1456] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:01 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:01.870086 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e7f26911-518b-42bc-8a1d-341f3f99f208 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:01.871665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e7f26911-518b-42bc-8a1d-341f3f99f208 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:01.872882 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e7f26911-518b-42bc-8a1d-341f3f99f208 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089386 Aug 30 15:00:01.873542 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 725/1457] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:01 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:00:02.887867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-62d0652f-29c2-4013-9b47-d2fdcfc292ad tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:02.888525 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-62d0652f-29c2-4013-9b47-d2fdcfc292ad tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:02.895049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62d0652f-29c2-4013-9b47-d2fdcfc292ad tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:02.895480 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-89b564c1-9756-485f-bad3-da647500d3b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:02.895888 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62d0652f-29c2-4013-9b47-d2fdcfc292ad tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:02.896001 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62d0652f-29c2-4013-9b47-d2fdcfc292ad tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:02.896132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-89b564c1-9756-485f-bad3-da647500d3b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:02.896635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62d0652f-29c2-4013-9b47-d2fdcfc292ad tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:02.897078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62d0652f-29c2-4013-9b47-d2fdcfc292ad tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:02.897493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62d0652f-29c2-4013-9b47-d2fdcfc292ad tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:02.902454 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89b564c1-9756-485f-bad3-da647500d3b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:02.902932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89b564c1-9756-485f-bad3-da647500d3b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:02.903400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89b564c1-9756-485f-bad3-da647500d3b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:02.904092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89b564c1-9756-485f-bad3-da647500d3b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:02.904554 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89b564c1-9756-485f-bad3-da647500d3b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:02.904962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89b564c1-9756-485f-bad3-da647500d3b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:02.966794 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-89b564c1-9756-485f-bad3-da647500d3b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:02.975436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-89b564c1-9756-485f-bad3-da647500d3b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:02.977526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-89b564c1-9756-485f-bad3-da647500d3b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:02.978694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-89b564c1-9756-485f-bad3-da647500d3b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087099 Aug 30 15:00:02.983358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 726/1458] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:02 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:00:03.031293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-62d0652f-29c2-4013-9b47-d2fdcfc292ad tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:03.040805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-62d0652f-29c2-4013-9b47-d2fdcfc292ad tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156720 Aug 30 15:00:03.043551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 733/1459] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:02 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:04.000782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6deb33e2-11e9-42b1-a1ec-1ae9e8be5146 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:04.001467 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6deb33e2-11e9-42b1-a1ec-1ae9e8be5146 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:04.008304 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6deb33e2-11e9-42b1-a1ec-1ae9e8be5146 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:04.008783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6deb33e2-11e9-42b1-a1ec-1ae9e8be5146 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:04.009217 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6deb33e2-11e9-42b1-a1ec-1ae9e8be5146 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:04.009905 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6deb33e2-11e9-42b1-a1ec-1ae9e8be5146 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:04.010359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6deb33e2-11e9-42b1-a1ec-1ae9e8be5146 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:04.010785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6deb33e2-11e9-42b1-a1ec-1ae9e8be5146 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:04.062023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3d37a525-5bc3-4dce-9149-d03674b0a05c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:04.062637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3d37a525-5bc3-4dce-9149-d03674b0a05c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:04.069268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d37a525-5bc3-4dce-9149-d03674b0a05c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:04.069733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d37a525-5bc3-4dce-9149-d03674b0a05c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:04.070377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d37a525-5bc3-4dce-9149-d03674b0a05c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:04.071508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d37a525-5bc3-4dce-9149-d03674b0a05c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:04.071959 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d37a525-5bc3-4dce-9149-d03674b0a05c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:04.072087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6deb33e2-11e9-42b1-a1ec-1ae9e8be5146 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:04.072383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d37a525-5bc3-4dce-9149-d03674b0a05c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:04.080724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6deb33e2-11e9-42b1-a1ec-1ae9e8be5146 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:04.082196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6deb33e2-11e9-42b1-a1ec-1ae9e8be5146 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:04.083375 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6deb33e2-11e9-42b1-a1ec-1ae9e8be5146 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086459 Aug 30 15:00:04.083942 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 727/1460] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:03 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:04.206456 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3d37a525-5bc3-4dce-9149-d03674b0a05c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:04.215500 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3d37a525-5bc3-4dce-9149-d03674b0a05c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.157330 Aug 30 15:00:04.216080 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 734/1461] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:04 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:05.105856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bb9b6c59-9c55-43a1-b521-0df7a8d4da2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:05.106442 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bb9b6c59-9c55-43a1-b521-0df7a8d4da2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:05.112705 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bb9b6c59-9c55-43a1-b521-0df7a8d4da2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:05.113173 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bb9b6c59-9c55-43a1-b521-0df7a8d4da2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:05.113596 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bb9b6c59-9c55-43a1-b521-0df7a8d4da2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:05.114270 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bb9b6c59-9c55-43a1-b521-0df7a8d4da2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:05.114711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bb9b6c59-9c55-43a1-b521-0df7a8d4da2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:05.115126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bb9b6c59-9c55-43a1-b521-0df7a8d4da2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:05.178199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bb9b6c59-9c55-43a1-b521-0df7a8d4da2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:05.187444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bb9b6c59-9c55-43a1-b521-0df7a8d4da2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:05.188872 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bb9b6c59-9c55-43a1-b521-0df7a8d4da2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:05.189997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bb9b6c59-9c55-43a1-b521-0df7a8d4da2d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088083 Aug 30 15:00:05.190552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 728/1462] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:05 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:05.236911 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-62d9fb40-7b01-4c71-b7a9-bc2cc1e55fff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:05.237525 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-62d9fb40-7b01-4c71-b7a9-bc2cc1e55fff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:05.244674 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62d9fb40-7b01-4c71-b7a9-bc2cc1e55fff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:05.245162 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62d9fb40-7b01-4c71-b7a9-bc2cc1e55fff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:05.245595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62d9fb40-7b01-4c71-b7a9-bc2cc1e55fff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:05.246289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62d9fb40-7b01-4c71-b7a9-bc2cc1e55fff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:05.246739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62d9fb40-7b01-4c71-b7a9-bc2cc1e55fff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:05.247163 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62d9fb40-7b01-4c71-b7a9-bc2cc1e55fff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:05.373441 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-62d9fb40-7b01-4c71-b7a9-bc2cc1e55fff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:05.381496 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-62d9fb40-7b01-4c71-b7a9-bc2cc1e55fff tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148586 Aug 30 15:00:05.382063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 735/1463] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:05 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:06.213904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ba2fff4a-c83e-43ed-b779-0071be90ff4a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:06.214518 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ba2fff4a-c83e-43ed-b779-0071be90ff4a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:06.220917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba2fff4a-c83e-43ed-b779-0071be90ff4a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:06.221395 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba2fff4a-c83e-43ed-b779-0071be90ff4a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:06.221829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba2fff4a-c83e-43ed-b779-0071be90ff4a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:06.222521 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba2fff4a-c83e-43ed-b779-0071be90ff4a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:06.222969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba2fff4a-c83e-43ed-b779-0071be90ff4a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:06.223417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba2fff4a-c83e-43ed-b779-0071be90ff4a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:06.283885 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ba2fff4a-c83e-43ed-b779-0071be90ff4a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:06.292388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ba2fff4a-c83e-43ed-b779-0071be90ff4a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:06.293823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ba2fff4a-c83e-43ed-b779-0071be90ff4a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:06.294963 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ba2fff4a-c83e-43ed-b779-0071be90ff4a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085760 Aug 30 15:00:06.295568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 729/1464] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:06 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:06.402783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8d9854ba-8e91-4897-8a60-49157fba9871 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:06.403427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8d9854ba-8e91-4897-8a60-49157fba9871 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:06.409791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d9854ba-8e91-4897-8a60-49157fba9871 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:06.410270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d9854ba-8e91-4897-8a60-49157fba9871 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:06.410704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d9854ba-8e91-4897-8a60-49157fba9871 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:06.411427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d9854ba-8e91-4897-8a60-49157fba9871 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:06.411901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d9854ba-8e91-4897-8a60-49157fba9871 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:06.412321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d9854ba-8e91-4897-8a60-49157fba9871 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:06.540798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8d9854ba-8e91-4897-8a60-49157fba9871 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:06.548973 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8d9854ba-8e91-4897-8a60-49157fba9871 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149930 Aug 30 15:00:06.549552 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 736/1465] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:06 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:07.316197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-50d99cdc-5983-4aca-a890-29353a435d9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:07.316802 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-50d99cdc-5983-4aca-a890-29353a435d9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:07.323638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50d99cdc-5983-4aca-a890-29353a435d9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:07.324113 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50d99cdc-5983-4aca-a890-29353a435d9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:07.324543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50d99cdc-5983-4aca-a890-29353a435d9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:07.325227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50d99cdc-5983-4aca-a890-29353a435d9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:07.325676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50d99cdc-5983-4aca-a890-29353a435d9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:07.326098 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50d99cdc-5983-4aca-a890-29353a435d9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:07.385861 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-50d99cdc-5983-4aca-a890-29353a435d9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:07.394350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-50d99cdc-5983-4aca-a890-29353a435d9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:07.395811 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-50d99cdc-5983-4aca-a890-29353a435d9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:07.396972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-50d99cdc-5983-4aca-a890-29353a435d9b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084699 Aug 30 15:00:07.397516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 730/1466] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:07 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:07.571620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e67ab386-50cf-41da-a314-75c59ef81f10 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:07.572261 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e67ab386-50cf-41da-a314-75c59ef81f10 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:07.578601 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e67ab386-50cf-41da-a314-75c59ef81f10 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:07.579084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e67ab386-50cf-41da-a314-75c59ef81f10 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:07.579555 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e67ab386-50cf-41da-a314-75c59ef81f10 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:07.580251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e67ab386-50cf-41da-a314-75c59ef81f10 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:07.580705 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e67ab386-50cf-41da-a314-75c59ef81f10 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:07.581130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e67ab386-50cf-41da-a314-75c59ef81f10 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:07.707751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e67ab386-50cf-41da-a314-75c59ef81f10 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:07.715877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e67ab386-50cf-41da-a314-75c59ef81f10 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149039 Aug 30 15:00:07.716445 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 737/1467] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:07 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:08.420069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e09b453b-7432-423a-80f0-a317033dc37e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:08.420704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e09b453b-7432-423a-80f0-a317033dc37e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:08.426996 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e09b453b-7432-423a-80f0-a317033dc37e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:08.427508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e09b453b-7432-423a-80f0-a317033dc37e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:08.427945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e09b453b-7432-423a-80f0-a317033dc37e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:08.428656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e09b453b-7432-423a-80f0-a317033dc37e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:08.429405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e09b453b-7432-423a-80f0-a317033dc37e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:08.429814 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e09b453b-7432-423a-80f0-a317033dc37e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:08.492699 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e09b453b-7432-423a-80f0-a317033dc37e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:08.501136 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e09b453b-7432-423a-80f0-a317033dc37e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:08.502565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e09b453b-7432-423a-80f0-a317033dc37e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:08.503745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e09b453b-7432-423a-80f0-a317033dc37e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087674 Aug 30 15:00:08.504313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 731/1468] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:08 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:08.737672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8067d326-855b-4eec-9ade-d16c9d8c870a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:08.738350 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8067d326-855b-4eec-9ade-d16c9d8c870a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:08.745682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8067d326-855b-4eec-9ade-d16c9d8c870a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:08.746112 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8067d326-855b-4eec-9ade-d16c9d8c870a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:08.746558 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8067d326-855b-4eec-9ade-d16c9d8c870a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:08.747277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8067d326-855b-4eec-9ade-d16c9d8c870a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:08.747740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8067d326-855b-4eec-9ade-d16c9d8c870a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:08.748257 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8067d326-855b-4eec-9ade-d16c9d8c870a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:08.881761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8067d326-855b-4eec-9ade-d16c9d8c870a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:08.890581 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8067d326-855b-4eec-9ade-d16c9d8c870a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156882 Aug 30 15:00:08.891149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 738/1469] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:08 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:09.526096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-83c1664f-dcb5-4035-b2ca-1f53d2e00206 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:09.526659 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-83c1664f-dcb5-4035-b2ca-1f53d2e00206 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:09.533068 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83c1664f-dcb5-4035-b2ca-1f53d2e00206 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:09.533549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83c1664f-dcb5-4035-b2ca-1f53d2e00206 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:09.533985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83c1664f-dcb5-4035-b2ca-1f53d2e00206 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:09.534669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83c1664f-dcb5-4035-b2ca-1f53d2e00206 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:09.535122 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83c1664f-dcb5-4035-b2ca-1f53d2e00206 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:09.535576 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-83c1664f-dcb5-4035-b2ca-1f53d2e00206 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:09.599303 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-83c1664f-dcb5-4035-b2ca-1f53d2e00206 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:09.608558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-83c1664f-dcb5-4035-b2ca-1f53d2e00206 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:09.609978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-83c1664f-dcb5-4035-b2ca-1f53d2e00206 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:09.611137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-83c1664f-dcb5-4035-b2ca-1f53d2e00206 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089559 Aug 30 15:00:09.611760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 732/1470] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:09 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:09.911951 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-69a00a46-56b3-4730-a6a1-39626e13957e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:09.912565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-69a00a46-56b3-4730-a6a1-39626e13957e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:09.918943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69a00a46-56b3-4730-a6a1-39626e13957e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:09.919457 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69a00a46-56b3-4730-a6a1-39626e13957e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:09.919897 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69a00a46-56b3-4730-a6a1-39626e13957e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:09.920589 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69a00a46-56b3-4730-a6a1-39626e13957e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:09.921042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69a00a46-56b3-4730-a6a1-39626e13957e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:09.921467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69a00a46-56b3-4730-a6a1-39626e13957e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:10.046147 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-69a00a46-56b3-4730-a6a1-39626e13957e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:10.054332 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-69a00a46-56b3-4730-a6a1-39626e13957e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.146195 Aug 30 15:00:10.054892 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 739/1471] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:09 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:10.632993 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9c5829c4-f459-43c4-aa84-4e79290a3c60 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:10.633606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9c5829c4-f459-43c4-aa84-4e79290a3c60 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:10.639980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c5829c4-f459-43c4-aa84-4e79290a3c60 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:10.640460 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c5829c4-f459-43c4-aa84-4e79290a3c60 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:10.640892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c5829c4-f459-43c4-aa84-4e79290a3c60 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:10.641577 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c5829c4-f459-43c4-aa84-4e79290a3c60 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:10.642026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c5829c4-f459-43c4-aa84-4e79290a3c60 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:10.642447 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c5829c4-f459-43c4-aa84-4e79290a3c60 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:10.703539 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9c5829c4-f459-43c4-aa84-4e79290a3c60 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:10.712255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9c5829c4-f459-43c4-aa84-4e79290a3c60 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:10.713700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9c5829c4-f459-43c4-aa84-4e79290a3c60 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:10.714837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9c5829c4-f459-43c4-aa84-4e79290a3c60 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085804 Aug 30 15:00:10.715414 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 733/1472] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:10 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:11.075796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e2d593cc-5c83-410a-8fb0-ddd34783773b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:11.076416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e2d593cc-5c83-410a-8fb0-ddd34783773b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:11.082833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e2d593cc-5c83-410a-8fb0-ddd34783773b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:11.083350 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e2d593cc-5c83-410a-8fb0-ddd34783773b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:11.083787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e2d593cc-5c83-410a-8fb0-ddd34783773b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:11.084486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e2d593cc-5c83-410a-8fb0-ddd34783773b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:11.084940 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e2d593cc-5c83-410a-8fb0-ddd34783773b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:11.085861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e2d593cc-5c83-410a-8fb0-ddd34783773b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:11.212395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e2d593cc-5c83-410a-8fb0-ddd34783773b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:11.220567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e2d593cc-5c83-410a-8fb0-ddd34783773b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148671 Aug 30 15:00:11.221950 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 740/1473] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:11 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:11.737563 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-03421684-2fb6-476e-a2ff-0503c1871e37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:11.738159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-03421684-2fb6-476e-a2ff-0503c1871e37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:11.745190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-03421684-2fb6-476e-a2ff-0503c1871e37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:11.745668 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-03421684-2fb6-476e-a2ff-0503c1871e37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:11.746103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-03421684-2fb6-476e-a2ff-0503c1871e37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:11.746799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-03421684-2fb6-476e-a2ff-0503c1871e37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:11.747284 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-03421684-2fb6-476e-a2ff-0503c1871e37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:11.747708 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-03421684-2fb6-476e-a2ff-0503c1871e37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:11.808006 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-03421684-2fb6-476e-a2ff-0503c1871e37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:11.816480 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-03421684-2fb6-476e-a2ff-0503c1871e37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:11.817925 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-03421684-2fb6-476e-a2ff-0503c1871e37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:11.819071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-03421684-2fb6-476e-a2ff-0503c1871e37 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085441 Aug 30 15:00:11.820446 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 734/1474] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:11 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:12.242774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-466fe5b5-6b47-4b79-93bc-19a489e7831a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:12.243440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-466fe5b5-6b47-4b79-93bc-19a489e7831a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:12.249849 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-466fe5b5-6b47-4b79-93bc-19a489e7831a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:12.250331 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-466fe5b5-6b47-4b79-93bc-19a489e7831a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:12.250765 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-466fe5b5-6b47-4b79-93bc-19a489e7831a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:12.251494 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-466fe5b5-6b47-4b79-93bc-19a489e7831a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:12.251950 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-466fe5b5-6b47-4b79-93bc-19a489e7831a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:12.252383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-466fe5b5-6b47-4b79-93bc-19a489e7831a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:12.381372 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-466fe5b5-6b47-4b79-93bc-19a489e7831a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:12.389669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-466fe5b5-6b47-4b79-93bc-19a489e7831a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151539 Aug 30 15:00:12.390241 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 741/1475] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:12 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:12.843883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a9a3738e-2e9c-4cc4-9625-e9dc2be9f058 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:12.843883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a9a3738e-2e9c-4cc4-9625-e9dc2be9f058 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:12.849429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9a3738e-2e9c-4cc4-9625-e9dc2be9f058 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:12.849904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9a3738e-2e9c-4cc4-9625-e9dc2be9f058 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:12.850336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9a3738e-2e9c-4cc4-9625-e9dc2be9f058 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:12.851059 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9a3738e-2e9c-4cc4-9625-e9dc2be9f058 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:12.851535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9a3738e-2e9c-4cc4-9625-e9dc2be9f058 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:12.851949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9a3738e-2e9c-4cc4-9625-e9dc2be9f058 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:12.912510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a9a3738e-2e9c-4cc4-9625-e9dc2be9f058 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:12.921054 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a9a3738e-2e9c-4cc4-9625-e9dc2be9f058 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:12.922481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a9a3738e-2e9c-4cc4-9625-e9dc2be9f058 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:12.923648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a9a3738e-2e9c-4cc4-9625-e9dc2be9f058 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085332 Aug 30 15:00:12.924211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 735/1476] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:12 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:13.512025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f685816e-17fa-444b-af9b-040e5c9b9ef5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:13.512774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f685816e-17fa-444b-af9b-040e5c9b9ef5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:13.518637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f685816e-17fa-444b-af9b-040e5c9b9ef5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:13.519112 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f685816e-17fa-444b-af9b-040e5c9b9ef5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:13.519574 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f685816e-17fa-444b-af9b-040e5c9b9ef5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:13.520258 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f685816e-17fa-444b-af9b-040e5c9b9ef5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:13.520707 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f685816e-17fa-444b-af9b-040e5c9b9ef5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:13.521129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f685816e-17fa-444b-af9b-040e5c9b9ef5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:13.646057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f685816e-17fa-444b-af9b-040e5c9b9ef5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:13.654259 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f685816e-17fa-444b-af9b-040e5c9b9ef5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.248459 Aug 30 15:00:13.654833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 742/1477] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:13 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:13.946854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a2db0f9c-fd26-452c-a899-28b11201818c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:13.947489 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a2db0f9c-fd26-452c-a899-28b11201818c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:13.953909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2db0f9c-fd26-452c-a899-28b11201818c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:13.954387 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2db0f9c-fd26-452c-a899-28b11201818c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:13.954820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2db0f9c-fd26-452c-a899-28b11201818c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:13.955534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2db0f9c-fd26-452c-a899-28b11201818c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:13.955986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2db0f9c-fd26-452c-a899-28b11201818c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:13.956413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2db0f9c-fd26-452c-a899-28b11201818c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:14.020168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a2db0f9c-fd26-452c-a899-28b11201818c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:14.028765 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a2db0f9c-fd26-452c-a899-28b11201818c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:14.030218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a2db0f9c-fd26-452c-a899-28b11201818c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:14.031397 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a2db0f9c-fd26-452c-a899-28b11201818c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089430 Aug 30 15:00:14.031951 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 736/1478] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:13 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:14.675705 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a58ab3f2-00e3-4012-a990-c7d261ab9227 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:14.676352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a58ab3f2-00e3-4012-a990-c7d261ab9227 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:14.683431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a58ab3f2-00e3-4012-a990-c7d261ab9227 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:14.683913 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a58ab3f2-00e3-4012-a990-c7d261ab9227 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:14.684346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a58ab3f2-00e3-4012-a990-c7d261ab9227 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:14.685040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a58ab3f2-00e3-4012-a990-c7d261ab9227 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:14.685495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a58ab3f2-00e3-4012-a990-c7d261ab9227 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:14.685915 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a58ab3f2-00e3-4012-a990-c7d261ab9227 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:14.814609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a58ab3f2-00e3-4012-a990-c7d261ab9227 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:14.823763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a58ab3f2-00e3-4012-a990-c7d261ab9227 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151941 Aug 30 15:00:14.824326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 743/1479] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:14 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:15.054573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1254e089-feb7-453a-b602-14a4ab5f0cc3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:15.055199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1254e089-feb7-453a-b602-14a4ab5f0cc3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:15.061497 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1254e089-feb7-453a-b602-14a4ab5f0cc3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:15.061970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1254e089-feb7-453a-b602-14a4ab5f0cc3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:15.062397 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1254e089-feb7-453a-b602-14a4ab5f0cc3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:15.063072 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1254e089-feb7-453a-b602-14a4ab5f0cc3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:15.063562 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1254e089-feb7-453a-b602-14a4ab5f0cc3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:15.063963 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1254e089-feb7-453a-b602-14a4ab5f0cc3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:15.124304 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1254e089-feb7-453a-b602-14a4ab5f0cc3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:15.133368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1254e089-feb7-453a-b602-14a4ab5f0cc3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:15.134808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1254e089-feb7-453a-b602-14a4ab5f0cc3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:15.135962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1254e089-feb7-453a-b602-14a4ab5f0cc3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085968 Aug 30 15:00:15.136512 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 737/1480] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:15 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:15.845106 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-74f71cc8-d7b6-4bd2-aec1-9cff0b60f279 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:15.845723 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-74f71cc8-d7b6-4bd2-aec1-9cff0b60f279 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:15.853015 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-74f71cc8-d7b6-4bd2-aec1-9cff0b60f279 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:15.853505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-74f71cc8-d7b6-4bd2-aec1-9cff0b60f279 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:15.853939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-74f71cc8-d7b6-4bd2-aec1-9cff0b60f279 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:15.854631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-74f71cc8-d7b6-4bd2-aec1-9cff0b60f279 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:15.855078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-74f71cc8-d7b6-4bd2-aec1-9cff0b60f279 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:15.855522 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-74f71cc8-d7b6-4bd2-aec1-9cff0b60f279 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:15.873382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:15.982939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-74f71cc8-d7b6-4bd2-aec1-9cff0b60f279 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:15.991176 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-74f71cc8-d7b6-4bd2-aec1-9cff0b60f279 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149960 Aug 30 15:00:15.991915 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 744/1481] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:15 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:16.158684 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0051e35b-a532-4fe6-8e17-068499f9c1a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:16.159289 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0051e35b-a532-4fe6-8e17-068499f9c1a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:16.166070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0051e35b-a532-4fe6-8e17-068499f9c1a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:16.166540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0051e35b-a532-4fe6-8e17-068499f9c1a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:16.166967 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0051e35b-a532-4fe6-8e17-068499f9c1a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:16.167676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0051e35b-a532-4fe6-8e17-068499f9c1a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:16.168144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0051e35b-a532-4fe6-8e17-068499f9c1a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:16.168560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0051e35b-a532-4fe6-8e17-068499f9c1a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:16.188725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:16.233526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0051e35b-a532-4fe6-8e17-068499f9c1a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:16.243226 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0051e35b-a532-4fe6-8e17-068499f9c1a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:16.244665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0051e35b-a532-4fe6-8e17-068499f9c1a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:16.245799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0051e35b-a532-4fe6-8e17-068499f9c1a6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091345 Aug 30 15:00:16.246349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 738/1482] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:16 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:17.012785 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-51c27f23-9ab6-4a09-a8aa-c93751bc21cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:17.013399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-51c27f23-9ab6-4a09-a8aa-c93751bc21cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:17.019791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-51c27f23-9ab6-4a09-a8aa-c93751bc21cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:17.020270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-51c27f23-9ab6-4a09-a8aa-c93751bc21cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:17.020798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-51c27f23-9ab6-4a09-a8aa-c93751bc21cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:17.021492 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-51c27f23-9ab6-4a09-a8aa-c93751bc21cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:17.021943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-51c27f23-9ab6-4a09-a8aa-c93751bc21cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:17.022366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-51c27f23-9ab6-4a09-a8aa-c93751bc21cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:17.151366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-51c27f23-9ab6-4a09-a8aa-c93751bc21cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:17.159534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-51c27f23-9ab6-4a09-a8aa-c93751bc21cd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150701 Aug 30 15:00:17.160107 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 745/1483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:17 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:17.269387 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f45f44b4-c013-4dc4-8307-9ae6364d2d6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:17.269963 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f45f44b4-c013-4dc4-8307-9ae6364d2d6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:17.276815 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f45f44b4-c013-4dc4-8307-9ae6364d2d6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:17.277293 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f45f44b4-c013-4dc4-8307-9ae6364d2d6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:17.277725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f45f44b4-c013-4dc4-8307-9ae6364d2d6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:17.278406 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f45f44b4-c013-4dc4-8307-9ae6364d2d6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:17.278851 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f45f44b4-c013-4dc4-8307-9ae6364d2d6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:17.279293 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f45f44b4-c013-4dc4-8307-9ae6364d2d6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:17.340583 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f45f44b4-c013-4dc4-8307-9ae6364d2d6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:17.349010 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f45f44b4-c013-4dc4-8307-9ae6364d2d6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:17.350452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f45f44b4-c013-4dc4-8307-9ae6364d2d6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:17.351627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f45f44b4-c013-4dc4-8307-9ae6364d2d6a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086261 Aug 30 15:00:17.352191 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 739/1484] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:17 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:18.181811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4bc7e692-981b-4f04-a0fa-f219ed41e01c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:18.182401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4bc7e692-981b-4f04-a0fa-f219ed41e01c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:18.188721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bc7e692-981b-4f04-a0fa-f219ed41e01c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:18.189191 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bc7e692-981b-4f04-a0fa-f219ed41e01c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:18.189615 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bc7e692-981b-4f04-a0fa-f219ed41e01c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:18.190292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bc7e692-981b-4f04-a0fa-f219ed41e01c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:18.190738 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bc7e692-981b-4f04-a0fa-f219ed41e01c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:18.191146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bc7e692-981b-4f04-a0fa-f219ed41e01c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:18.321697 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4bc7e692-981b-4f04-a0fa-f219ed41e01c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:18.329774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4bc7e692-981b-4f04-a0fa-f219ed41e01c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152500 Aug 30 15:00:18.330330 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 746/1485] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:18 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:18.373671 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a8c7d74e-9d8d-4385-989e-c9bbc6f6441c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:18.374287 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a8c7d74e-9d8d-4385-989e-c9bbc6f6441c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:18.380907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c7d74e-9d8d-4385-989e-c9bbc6f6441c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:18.381453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c7d74e-9d8d-4385-989e-c9bbc6f6441c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:18.382106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c7d74e-9d8d-4385-989e-c9bbc6f6441c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:18.382735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c7d74e-9d8d-4385-989e-c9bbc6f6441c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:18.383179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c7d74e-9d8d-4385-989e-c9bbc6f6441c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:18.383764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c7d74e-9d8d-4385-989e-c9bbc6f6441c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:18.447735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a8c7d74e-9d8d-4385-989e-c9bbc6f6441c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:18.456211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a8c7d74e-9d8d-4385-989e-c9bbc6f6441c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:18.457643 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a8c7d74e-9d8d-4385-989e-c9bbc6f6441c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:18.458781 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a8c7d74e-9d8d-4385-989e-c9bbc6f6441c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088964 Aug 30 15:00:18.459369 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 740/1486] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:18 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:19.349912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4e79f215-5f54-4740-9e9c-ebe2858b792c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:19.350584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4e79f215-5f54-4740-9e9c-ebe2858b792c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:19.357285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4e79f215-5f54-4740-9e9c-ebe2858b792c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:19.357760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4e79f215-5f54-4740-9e9c-ebe2858b792c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:19.358187 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4e79f215-5f54-4740-9e9c-ebe2858b792c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:19.358870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4e79f215-5f54-4740-9e9c-ebe2858b792c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:19.359339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4e79f215-5f54-4740-9e9c-ebe2858b792c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:19.359769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4e79f215-5f54-4740-9e9c-ebe2858b792c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:19.482196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-58abb8fa-6439-4258-b735-5b7fc0de41f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:19.483619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-58abb8fa-6439-4258-b735-5b7fc0de41f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:19.484974 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4e79f215-5f54-4740-9e9c-ebe2858b792c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:19.493459 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58abb8fa-6439-4258-b735-5b7fc0de41f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:19.493665 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4e79f215-5f54-4740-9e9c-ebe2858b792c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147587 Aug 30 15:00:19.493967 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58abb8fa-6439-4258-b735-5b7fc0de41f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:19.494232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 747/1487] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:19 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:19.494394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58abb8fa-6439-4258-b735-5b7fc0de41f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:19.495344 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58abb8fa-6439-4258-b735-5b7fc0de41f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:19.495789 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58abb8fa-6439-4258-b735-5b7fc0de41f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:19.496213 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58abb8fa-6439-4258-b735-5b7fc0de41f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:19.559059 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-58abb8fa-6439-4258-b735-5b7fc0de41f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:19.567635 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-58abb8fa-6439-4258-b735-5b7fc0de41f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:19.569075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-58abb8fa-6439-4258-b735-5b7fc0de41f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:19.570226 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-58abb8fa-6439-4258-b735-5b7fc0de41f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091957 Aug 30 15:00:19.570782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 741/1488] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:19 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:00:20.515188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-aa6cf320-a144-48ca-9650-550f74310984 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:20.515763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-aa6cf320-a144-48ca-9650-550f74310984 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:20.517608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=52 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:20.522858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aa6cf320-a144-48ca-9650-550f74310984 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:20.523364 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aa6cf320-a144-48ca-9650-550f74310984 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:20.524498 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aa6cf320-a144-48ca-9650-550f74310984 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:20.525194 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aa6cf320-a144-48ca-9650-550f74310984 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:20.525644 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aa6cf320-a144-48ca-9650-550f74310984 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:20.526067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aa6cf320-a144-48ca-9650-550f74310984 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:20.593419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cd481557-542b-418d-b405-30e690cc77a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:20.594057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cd481557-542b-418d-b405-30e690cc77a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:20.596371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=56 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:20.601489 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd481557-542b-418d-b405-30e690cc77a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:20.601972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd481557-542b-418d-b405-30e690cc77a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:20.602410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd481557-542b-418d-b405-30e690cc77a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:20.603224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd481557-542b-418d-b405-30e690cc77a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:20.603753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd481557-542b-418d-b405-30e690cc77a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:20.604176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd481557-542b-418d-b405-30e690cc77a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:20.660528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-aa6cf320-a144-48ca-9650-550f74310984 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:20.667040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cd481557-542b-418d-b405-30e690cc77a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:20.668809 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-aa6cf320-a144-48ca-9650-550f74310984 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.157732 Aug 30 15:00:20.669385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 748/1489] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:20 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:20.675532 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cd481557-542b-418d-b405-30e690cc77a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:20.676956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cd481557-542b-418d-b405-30e690cc77a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:20.678082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cd481557-542b-418d-b405-30e690cc77a9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088556 Aug 30 15:00:20.678617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 742/1490] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:20 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:00:21.689987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c79420bc-ff36-49db-825c-056fd621cedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:21.690613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c79420bc-ff36-49db-825c-056fd621cedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:21.697682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c79420bc-ff36-49db-825c-056fd621cedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:21.698164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c79420bc-ff36-49db-825c-056fd621cedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:21.698599 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c79420bc-ff36-49db-825c-056fd621cedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:21.699322 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c79420bc-ff36-49db-825c-056fd621cedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:21.699807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c79420bc-ff36-49db-825c-056fd621cedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:21.700230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c79420bc-ff36-49db-825c-056fd621cedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:21.700958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cc93dceb-2455-4a2e-9acf-2900ca26c4a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:21.701571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cc93dceb-2455-4a2e-9acf-2900ca26c4a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:21.707555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc93dceb-2455-4a2e-9acf-2900ca26c4a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:21.708032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc93dceb-2455-4a2e-9acf-2900ca26c4a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:21.708463 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc93dceb-2455-4a2e-9acf-2900ca26c4a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:21.709147 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc93dceb-2455-4a2e-9acf-2900ca26c4a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:21.709599 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc93dceb-2455-4a2e-9acf-2900ca26c4a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:21.710017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc93dceb-2455-4a2e-9acf-2900ca26c4a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:21.775653 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cc93dceb-2455-4a2e-9acf-2900ca26c4a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:21.784362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cc93dceb-2455-4a2e-9acf-2900ca26c4a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:21.785803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cc93dceb-2455-4a2e-9acf-2900ca26c4a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:21.786948 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cc93dceb-2455-4a2e-9acf-2900ca26c4a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089970 Aug 30 15:00:21.787545 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 743/1491] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:21 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:00:21.830739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c79420bc-ff36-49db-825c-056fd621cedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:21.839777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c79420bc-ff36-49db-825c-056fd621cedb tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153757 Aug 30 15:00:21.840334 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 749/1492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:21 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:22.809821 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-88f95808-67d4-469a-b9c5-cbbae969b8a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:22.810428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-88f95808-67d4-469a-b9c5-cbbae969b8a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:22.824695 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88f95808-67d4-469a-b9c5-cbbae969b8a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:22.825173 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88f95808-67d4-469a-b9c5-cbbae969b8a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:22.825603 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88f95808-67d4-469a-b9c5-cbbae969b8a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:22.826292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88f95808-67d4-469a-b9c5-cbbae969b8a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:22.826735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88f95808-67d4-469a-b9c5-cbbae969b8a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:22.827149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88f95808-67d4-469a-b9c5-cbbae969b8a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:22.860664 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-69888d5b-1497-4d81-9ed2-0dc92e9bffa4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:22.861285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-69888d5b-1497-4d81-9ed2-0dc92e9bffa4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:22.868199 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69888d5b-1497-4d81-9ed2-0dc92e9bffa4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:22.868687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69888d5b-1497-4d81-9ed2-0dc92e9bffa4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:22.869128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69888d5b-1497-4d81-9ed2-0dc92e9bffa4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:22.869835 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69888d5b-1497-4d81-9ed2-0dc92e9bffa4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:22.870490 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69888d5b-1497-4d81-9ed2-0dc92e9bffa4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:22.870921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69888d5b-1497-4d81-9ed2-0dc92e9bffa4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:22.896346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-88f95808-67d4-469a-b9c5-cbbae969b8a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:22.905762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-88f95808-67d4-469a-b9c5-cbbae969b8a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:22.907223 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-88f95808-67d4-469a-b9c5-cbbae969b8a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:22.908376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-88f95808-67d4-469a-b9c5-cbbae969b8a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.102492 Aug 30 15:00:22.908933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 744/1493] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:22 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:23.006902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-69888d5b-1497-4d81-9ed2-0dc92e9bffa4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:23.015709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-69888d5b-1497-4d81-9ed2-0dc92e9bffa4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.158904 Aug 30 15:00:23.016289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 750/1494] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:22 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:23.929913 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c48e44b8-a409-44dc-bf59-3eb722e940eb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:23.930550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c48e44b8-a409-44dc-bf59-3eb722e940eb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:23.937090 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c48e44b8-a409-44dc-bf59-3eb722e940eb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:23.937564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c48e44b8-a409-44dc-bf59-3eb722e940eb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:23.937993 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c48e44b8-a409-44dc-bf59-3eb722e940eb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:23.938687 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c48e44b8-a409-44dc-bf59-3eb722e940eb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:23.939142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c48e44b8-a409-44dc-bf59-3eb722e940eb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:23.939576 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c48e44b8-a409-44dc-bf59-3eb722e940eb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:24.003711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c48e44b8-a409-44dc-bf59-3eb722e940eb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:24.012788 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c48e44b8-a409-44dc-bf59-3eb722e940eb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:24.014224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c48e44b8-a409-44dc-bf59-3eb722e940eb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:24.015393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c48e44b8-a409-44dc-bf59-3eb722e940eb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089499 Aug 30 15:00:24.015958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 745/1495] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:23 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:24.036328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-25480c81-62d2-4de1-b932-1512d05be9b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:24.036961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-25480c81-62d2-4de1-b932-1512d05be9b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:24.043815 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-25480c81-62d2-4de1-b932-1512d05be9b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:24.044403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-25480c81-62d2-4de1-b932-1512d05be9b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:24.044968 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-25480c81-62d2-4de1-b932-1512d05be9b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:24.045801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-25480c81-62d2-4de1-b932-1512d05be9b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:24.046257 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-25480c81-62d2-4de1-b932-1512d05be9b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:24.046679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-25480c81-62d2-4de1-b932-1512d05be9b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:24.173303 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-25480c81-62d2-4de1-b932-1512d05be9b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:24.181512 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-25480c81-62d2-4de1-b932-1512d05be9b0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149026 Aug 30 15:00:24.182069 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 751/1496] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:24 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:25.038538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6a855729-e8ee-47e2-b60b-d863a53fef45 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:25.039647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6a855729-e8ee-47e2-b60b-d863a53fef45 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:25.045962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a855729-e8ee-47e2-b60b-d863a53fef45 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:25.046457 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a855729-e8ee-47e2-b60b-d863a53fef45 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:25.046877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a855729-e8ee-47e2-b60b-d863a53fef45 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:25.047591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a855729-e8ee-47e2-b60b-d863a53fef45 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:25.048045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a855729-e8ee-47e2-b60b-d863a53fef45 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:25.048464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a855729-e8ee-47e2-b60b-d863a53fef45 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:25.109348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6a855729-e8ee-47e2-b60b-d863a53fef45 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:25.118586 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6a855729-e8ee-47e2-b60b-d863a53fef45 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:25.120045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6a855729-e8ee-47e2-b60b-d863a53fef45 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:25.121189 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6a855729-e8ee-47e2-b60b-d863a53fef45 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086604 Aug 30 15:00:25.121744 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 746/1497] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:25 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:25.202549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1941f7e5-c427-40ff-8455-ec377baaf794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:25.203106 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1941f7e5-c427-40ff-8455-ec377baaf794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:25.209638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1941f7e5-c427-40ff-8455-ec377baaf794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:25.210120 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1941f7e5-c427-40ff-8455-ec377baaf794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:25.210546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1941f7e5-c427-40ff-8455-ec377baaf794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:25.211805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1941f7e5-c427-40ff-8455-ec377baaf794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:25.212732 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1941f7e5-c427-40ff-8455-ec377baaf794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:25.212836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1941f7e5-c427-40ff-8455-ec377baaf794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:25.346271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1941f7e5-c427-40ff-8455-ec377baaf794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:25.355513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1941f7e5-c427-40ff-8455-ec377baaf794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156928 Aug 30 15:00:25.356083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 752/1498] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:25 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:26.144931 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0cc95810-82fd-44f9-869a-98d03e76ae4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:26.145540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0cc95810-82fd-44f9-869a-98d03e76ae4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:26.152130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cc95810-82fd-44f9-869a-98d03e76ae4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:26.152651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cc95810-82fd-44f9-869a-98d03e76ae4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:26.153083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cc95810-82fd-44f9-869a-98d03e76ae4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:26.153772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cc95810-82fd-44f9-869a-98d03e76ae4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:26.154219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cc95810-82fd-44f9-869a-98d03e76ae4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:26.154638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cc95810-82fd-44f9-869a-98d03e76ae4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:26.215582 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0cc95810-82fd-44f9-869a-98d03e76ae4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:26.224482 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0cc95810-82fd-44f9-869a-98d03e76ae4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:26.225922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0cc95810-82fd-44f9-869a-98d03e76ae4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:26.227076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0cc95810-82fd-44f9-869a-98d03e76ae4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086041 Aug 30 15:00:26.227664 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 747/1499] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:26 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:26.375881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cb38f0a9-25a8-44e8-81d5-3377b0751976 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:26.376488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cb38f0a9-25a8-44e8-81d5-3377b0751976 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:26.382823 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb38f0a9-25a8-44e8-81d5-3377b0751976 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:26.383631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb38f0a9-25a8-44e8-81d5-3377b0751976 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:26.384067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb38f0a9-25a8-44e8-81d5-3377b0751976 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:26.384748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb38f0a9-25a8-44e8-81d5-3377b0751976 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:26.385194 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb38f0a9-25a8-44e8-81d5-3377b0751976 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:26.385609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb38f0a9-25a8-44e8-81d5-3377b0751976 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:26.515927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cb38f0a9-25a8-44e8-81d5-3377b0751976 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:26.524377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cb38f0a9-25a8-44e8-81d5-3377b0751976 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151929 Aug 30 15:00:26.524903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 753/1500] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:26 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:27.249506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4457ba02-0a17-4a9c-9f80-42eeda081b69 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:27.250109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4457ba02-0a17-4a9c-9f80-42eeda081b69 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:27.256419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4457ba02-0a17-4a9c-9f80-42eeda081b69 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:27.256885 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4457ba02-0a17-4a9c-9f80-42eeda081b69 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:27.257311 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4457ba02-0a17-4a9c-9f80-42eeda081b69 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:27.258493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4457ba02-0a17-4a9c-9f80-42eeda081b69 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:27.258937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4457ba02-0a17-4a9c-9f80-42eeda081b69 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:27.259383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4457ba02-0a17-4a9c-9f80-42eeda081b69 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:27.322477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4457ba02-0a17-4a9c-9f80-42eeda081b69 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:27.330838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4457ba02-0a17-4a9c-9f80-42eeda081b69 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:27.332571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4457ba02-0a17-4a9c-9f80-42eeda081b69 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:27.333740 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4457ba02-0a17-4a9c-9f80-42eeda081b69 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088435 Aug 30 15:00:27.334291 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 748/1501] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:27 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:27.545529 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d8078248-50f0-431b-8db3-979572a2844c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:27.546063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d8078248-50f0-431b-8db3-979572a2844c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:27.552495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8078248-50f0-431b-8db3-979572a2844c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:27.552973 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8078248-50f0-431b-8db3-979572a2844c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:27.553406 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8078248-50f0-431b-8db3-979572a2844c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:27.554095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8078248-50f0-431b-8db3-979572a2844c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:27.554547 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8078248-50f0-431b-8db3-979572a2844c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:27.555720 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8078248-50f0-431b-8db3-979572a2844c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:27.683161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d8078248-50f0-431b-8db3-979572a2844c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:27.691168 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d8078248-50f0-431b-8db3-979572a2844c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149650 Aug 30 15:00:27.691756 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 754/1502] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:27 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:28.357713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5a727537-98eb-483b-ba64-adff8ab3c4b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:28.358317 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5a727537-98eb-483b-ba64-adff8ab3c4b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:28.364724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a727537-98eb-483b-ba64-adff8ab3c4b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:28.365207 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a727537-98eb-483b-ba64-adff8ab3c4b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:28.365635 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a727537-98eb-483b-ba64-adff8ab3c4b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:28.366319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a727537-98eb-483b-ba64-adff8ab3c4b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:28.366770 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a727537-98eb-483b-ba64-adff8ab3c4b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:28.367466 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5a727537-98eb-483b-ba64-adff8ab3c4b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:28.427530 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5a727537-98eb-483b-ba64-adff8ab3c4b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:28.436012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5a727537-98eb-483b-ba64-adff8ab3c4b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:28.437445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5a727537-98eb-483b-ba64-adff8ab3c4b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:28.438579 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5a727537-98eb-483b-ba64-adff8ab3c4b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084792 Aug 30 15:00:28.439136 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 749/1503] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:28 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:28.713779 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-64e6b466-4fae-482d-8261-85b807e4ac6e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:28.714394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-64e6b466-4fae-482d-8261-85b807e4ac6e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:28.720762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64e6b466-4fae-482d-8261-85b807e4ac6e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:28.721245 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64e6b466-4fae-482d-8261-85b807e4ac6e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:28.721681 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64e6b466-4fae-482d-8261-85b807e4ac6e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:28.722374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64e6b466-4fae-482d-8261-85b807e4ac6e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:28.722835 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64e6b466-4fae-482d-8261-85b807e4ac6e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:28.723279 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-64e6b466-4fae-482d-8261-85b807e4ac6e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:28.852450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-64e6b466-4fae-482d-8261-85b807e4ac6e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:28.860656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-64e6b466-4fae-482d-8261-85b807e4ac6e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151590 Aug 30 15:00:28.861228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 755/1504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:28 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:29.461541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-79e946d7-073d-41c5-b96c-2978cb769418 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:29.462247 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-79e946d7-073d-41c5-b96c-2978cb769418 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:29.468619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79e946d7-073d-41c5-b96c-2978cb769418 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:29.469158 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79e946d7-073d-41c5-b96c-2978cb769418 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:29.469590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79e946d7-073d-41c5-b96c-2978cb769418 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:29.470276 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79e946d7-073d-41c5-b96c-2978cb769418 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:29.470728 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79e946d7-073d-41c5-b96c-2978cb769418 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:29.471147 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-79e946d7-073d-41c5-b96c-2978cb769418 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:29.535707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-79e946d7-073d-41c5-b96c-2978cb769418 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:29.544657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-79e946d7-073d-41c5-b96c-2978cb769418 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:29.546092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-79e946d7-073d-41c5-b96c-2978cb769418 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:29.547256 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-79e946d7-073d-41c5-b96c-2978cb769418 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089882 Aug 30 15:00:29.547829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 750/1505] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:29 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:29.881841 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c8aa32ee-809c-410f-9454-86c7d0f3f723 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:29.882446 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c8aa32ee-809c-410f-9454-86c7d0f3f723 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:29.889115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8aa32ee-809c-410f-9454-86c7d0f3f723 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:29.889587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8aa32ee-809c-410f-9454-86c7d0f3f723 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:29.890013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8aa32ee-809c-410f-9454-86c7d0f3f723 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:29.890693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8aa32ee-809c-410f-9454-86c7d0f3f723 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:29.891137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8aa32ee-809c-410f-9454-86c7d0f3f723 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:29.891576 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8aa32ee-809c-410f-9454-86c7d0f3f723 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:30.018018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c8aa32ee-809c-410f-9454-86c7d0f3f723 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:30.026721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c8aa32ee-809c-410f-9454-86c7d0f3f723 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148987 Aug 30 15:00:30.027298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 756/1506] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:29 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:30.571367 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ab43768a-897e-4cb4-9f51-257ee3694443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:30.571980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ab43768a-897e-4cb4-9f51-257ee3694443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:30.578275 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab43768a-897e-4cb4-9f51-257ee3694443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:30.578753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab43768a-897e-4cb4-9f51-257ee3694443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:30.579182 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab43768a-897e-4cb4-9f51-257ee3694443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:30.579891 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab43768a-897e-4cb4-9f51-257ee3694443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:30.580336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab43768a-897e-4cb4-9f51-257ee3694443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:30.580754 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab43768a-897e-4cb4-9f51-257ee3694443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:30.641283 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ab43768a-897e-4cb4-9f51-257ee3694443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:30.649874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ab43768a-897e-4cb4-9f51-257ee3694443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:30.651404 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ab43768a-897e-4cb4-9f51-257ee3694443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:30.652573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ab43768a-897e-4cb4-9f51-257ee3694443 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086097 Aug 30 15:00:30.653126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 751/1507] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:30 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:31.047565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f1257ab5-8e38-470f-aa6a-7a91c613cfb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:31.048113 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f1257ab5-8e38-470f-aa6a-7a91c613cfb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:31.054473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f1257ab5-8e38-470f-aa6a-7a91c613cfb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:31.055648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f1257ab5-8e38-470f-aa6a-7a91c613cfb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:31.056086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f1257ab5-8e38-470f-aa6a-7a91c613cfb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:31.056781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f1257ab5-8e38-470f-aa6a-7a91c613cfb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:31.057235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f1257ab5-8e38-470f-aa6a-7a91c613cfb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:31.057661 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f1257ab5-8e38-470f-aa6a-7a91c613cfb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:31.183884 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f1257ab5-8e38-470f-aa6a-7a91c613cfb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:31.191982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f1257ab5-8e38-470f-aa6a-7a91c613cfb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148429 Aug 30 15:00:31.192547 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 757/1508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:31 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:31.674722 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9451062a-d7ce-4bb1-a015-2b3e1a9879d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:31.675331 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9451062a-d7ce-4bb1-a015-2b3e1a9879d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:31.682069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9451062a-d7ce-4bb1-a015-2b3e1a9879d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:31.682539 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9451062a-d7ce-4bb1-a015-2b3e1a9879d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:31.682965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9451062a-d7ce-4bb1-a015-2b3e1a9879d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:31.683682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9451062a-d7ce-4bb1-a015-2b3e1a9879d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:31.684119 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9451062a-d7ce-4bb1-a015-2b3e1a9879d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:31.684535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9451062a-d7ce-4bb1-a015-2b3e1a9879d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:31.750114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9451062a-d7ce-4bb1-a015-2b3e1a9879d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:31.759631 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9451062a-d7ce-4bb1-a015-2b3e1a9879d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:31.761070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9451062a-d7ce-4bb1-a015-2b3e1a9879d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:31.762201 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9451062a-d7ce-4bb1-a015-2b3e1a9879d1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091400 Aug 30 15:00:31.762757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 752/1509] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:31 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:32.213919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7233e60d-4071-4c72-8a16-f23f28664979 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:32.214534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7233e60d-4071-4c72-8a16-f23f28664979 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:32.220958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7233e60d-4071-4c72-8a16-f23f28664979 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:32.221437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7233e60d-4071-4c72-8a16-f23f28664979 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:32.221864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7233e60d-4071-4c72-8a16-f23f28664979 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:32.222555 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7233e60d-4071-4c72-8a16-f23f28664979 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:32.222996 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7233e60d-4071-4c72-8a16-f23f28664979 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:32.223444 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7233e60d-4071-4c72-8a16-f23f28664979 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:32.355864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7233e60d-4071-4c72-8a16-f23f28664979 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:32.363903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7233e60d-4071-4c72-8a16-f23f28664979 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.154460 Aug 30 15:00:32.364473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 758/1510] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:32 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:32.785516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-07b2fa08-db03-4637-aa72-6716fa18bf58 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:32.786061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-07b2fa08-db03-4637-aa72-6716fa18bf58 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:32.792982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07b2fa08-db03-4637-aa72-6716fa18bf58 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:32.793475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07b2fa08-db03-4637-aa72-6716fa18bf58 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:32.793890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07b2fa08-db03-4637-aa72-6716fa18bf58 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:32.794575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07b2fa08-db03-4637-aa72-6716fa18bf58 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:32.795026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07b2fa08-db03-4637-aa72-6716fa18bf58 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:32.795472 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07b2fa08-db03-4637-aa72-6716fa18bf58 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:32.856580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-07b2fa08-db03-4637-aa72-6716fa18bf58 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:32.865073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-07b2fa08-db03-4637-aa72-6716fa18bf58 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:32.866503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-07b2fa08-db03-4637-aa72-6716fa18bf58 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:32.868282 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-07b2fa08-db03-4637-aa72-6716fa18bf58 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086836 Aug 30 15:00:32.868842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 753/1511] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:32 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:33.385259 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-61e3e414-5e1b-4714-8c40-869ccb50deb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:33.385871 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-61e3e414-5e1b-4714-8c40-869ccb50deb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:33.392299 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61e3e414-5e1b-4714-8c40-869ccb50deb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:33.392777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61e3e414-5e1b-4714-8c40-869ccb50deb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:33.393210 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61e3e414-5e1b-4714-8c40-869ccb50deb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:33.393892 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61e3e414-5e1b-4714-8c40-869ccb50deb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:33.394338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61e3e414-5e1b-4714-8c40-869ccb50deb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:33.394758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-61e3e414-5e1b-4714-8c40-869ccb50deb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:33.521368 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-61e3e414-5e1b-4714-8c40-869ccb50deb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:33.529952 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-61e3e414-5e1b-4714-8c40-869ccb50deb4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148580 Aug 30 15:00:33.530517 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 759/1512] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:33 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:33.891330 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1ef2088c-a9f5-48a7-87aa-f388d4ba1693 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:33.891941 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1ef2088c-a9f5-48a7-87aa-f388d4ba1693 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:33.898278 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ef2088c-a9f5-48a7-87aa-f388d4ba1693 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:33.899327 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ef2088c-a9f5-48a7-87aa-f388d4ba1693 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:33.899755 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ef2088c-a9f5-48a7-87aa-f388d4ba1693 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:33.900432 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ef2088c-a9f5-48a7-87aa-f388d4ba1693 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:33.900877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ef2088c-a9f5-48a7-87aa-f388d4ba1693 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:33.901293 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1ef2088c-a9f5-48a7-87aa-f388d4ba1693 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:33.961550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1ef2088c-a9f5-48a7-87aa-f388d4ba1693 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:33.970141 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1ef2088c-a9f5-48a7-87aa-f388d4ba1693 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:33.971612 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1ef2088c-a9f5-48a7-87aa-f388d4ba1693 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:33.972785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1ef2088c-a9f5-48a7-87aa-f388d4ba1693 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085386 Aug 30 15:00:33.973337 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 754/1513] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:33 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:34.552095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8ba5d996-688f-4dcd-a95f-4ae51c0b278d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:34.552713 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8ba5d996-688f-4dcd-a95f-4ae51c0b278d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:34.568808 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ba5d996-688f-4dcd-a95f-4ae51c0b278d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:34.569289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ba5d996-688f-4dcd-a95f-4ae51c0b278d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:34.569867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ba5d996-688f-4dcd-a95f-4ae51c0b278d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:34.570488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ba5d996-688f-4dcd-a95f-4ae51c0b278d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:34.570967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ba5d996-688f-4dcd-a95f-4ae51c0b278d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:34.574380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ba5d996-688f-4dcd-a95f-4ae51c0b278d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:34.578941 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-636a55c9-b35f-4fa7-acab-b2213809323e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:34.579462 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-636a55c9-b35f-4fa7-acab-b2213809323e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:34.586201 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636a55c9-b35f-4fa7-acab-b2213809323e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:34.586863 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636a55c9-b35f-4fa7-acab-b2213809323e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:34.587325 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636a55c9-b35f-4fa7-acab-b2213809323e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:34.588653 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636a55c9-b35f-4fa7-acab-b2213809323e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:34.589124 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636a55c9-b35f-4fa7-acab-b2213809323e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:34.589550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636a55c9-b35f-4fa7-acab-b2213809323e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:34.603287 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:34.604873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-636a55c9-b35f-4fa7-acab-b2213809323e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] HTTP exception thrown: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-636a55c9-b35f-4fa7-acab-b2213809323e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Request method failure captured: Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a HTTP/1.1 Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDiHXgeukw0ZNoeficrJEf5lm6v5wj-1PFcFAuJEVMG7EHf6PXGtj7rdqQW2W_0AJCo9VQHgduruYwxwCrpZ10VB9ejqPXjJYMY10nBr1H3zK66KAO8Jy47XLqCblx9Q6gEvo1HZaGbtdLUD5lU6Pc3W6-xhQLr_9vp1ZGNC261GauT4 Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: 04efb141e084405992bfc0418a74da2a Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeTestJSON-105252644 Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:00:34.606516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:00:34.608047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/04efb141e084405992bfc0418a74da2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_04efb141e084405992bfc0418a74da2a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/04efb141e084405992bfc0418a74da2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/04efb141e084405992bfc0418a74da2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:00:34.608047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeTestJSON-105252644 Aug 30 15:00:34.608047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 04efb141e084405992bfc0418a74da2a Aug 30 15:00:34.608047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeTestJSON-105252644 Aug 30 15:00:34.608047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeTestJSON-105252644-project Aug 30 15:00:34.608047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:00:34.608047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:00:34.608047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: ca9bafc5ff4e43719f37e62cad946cf7 Aug 30 15:00:34.608047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeTestJSON-105252644-project Aug 30 15:00:34.608047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:00:34.608047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. Aug 30 15:00:34.608047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': '17fcd66f-fa4d-4b53-a76c-6d10cba8674a'} Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:00:34.609078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. Aug 30 15:00:34.610525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:00:34.612011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-636a55c9-b35f-4fa7-acab-b2213809323e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Returning 404 to user: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:00:34.612011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-636a55c9-b35f-4fa7-acab-b2213809323e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "DELETE /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 404 len: 111 microversion: 2.1 time: 0.032901 Aug 30 15:00:34.612011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 755/1514] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:00:34 2022] DELETE /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 15:00:34.618481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9207d325-c388-4d82-8c0a-30ccc9add60e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:34.618481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9207d325-c388-4d82-8c0a-30ccc9add60e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: 17fcd66f-fa4d-4b53-a76c-6d10cba8674a] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:34.624700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9207d325-c388-4d82-8c0a-30ccc9add60e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:34.625178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9207d325-c388-4d82-8c0a-30ccc9add60e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:34.625617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9207d325-c388-4d82-8c0a-30ccc9add60e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:34.626312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9207d325-c388-4d82-8c0a-30ccc9add60e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:34.626762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9207d325-c388-4d82-8c0a-30ccc9add60e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:34.627183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9207d325-c388-4d82-8c0a-30ccc9add60e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:34.641506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-9207d325-c388-4d82-8c0a-30ccc9add60e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] HTTP exception thrown: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9207d325-c388-4d82-8c0a-30ccc9add60e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Request method failure captured: Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a HTTP/1.1 Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDiHXgeukw0ZNoeficrJEf5lm6v5wj-1PFcFAuJEVMG7EHf6PXGtj7rdqQW2W_0AJCo9VQHgduruYwxwCrpZ10VB9ejqPXjJYMY10nBr1H3zK66KAO8Jy47XLqCblx9Q6gEvo1HZaGbtdLUD5lU6Pc3W6-xhQLr_9vp1ZGNC261GauT4 Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: 04efb141e084405992bfc0418a74da2a Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeTestJSON-105252644 Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:00:34.643117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:00:34.644790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/04efb141e084405992bfc0418a74da2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_04efb141e084405992bfc0418a74da2a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/04efb141e084405992bfc0418a74da2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/04efb141e084405992bfc0418a74da2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:00:34.644790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeTestJSON-105252644 Aug 30 15:00:34.644790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 04efb141e084405992bfc0418a74da2a Aug 30 15:00:34.644790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeTestJSON-105252644 Aug 30 15:00:34.644790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeTestJSON-105252644-project Aug 30 15:00:34.644790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:00:34.644790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:00:34.644790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: ca9bafc5ff4e43719f37e62cad946cf7 Aug 30 15:00:34.644790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeTestJSON-105252644-project Aug 30 15:00:34.644790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:00:34.644790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. Aug 30 15:00:34.644790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': '17fcd66f-fa4d-4b53-a76c-6d10cba8674a'} Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:00:34.645657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. Aug 30 15:00:34.646971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:00:34.649856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9207d325-c388-4d82-8c0a-30ccc9add60e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Returning 404 to user: Instance 17fcd66f-fa4d-4b53-a76c-6d10cba8674a could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:00:34.649856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9207d325-c388-4d82-8c0a-30ccc9add60e tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a" status: 404 len: 111 microversion: 2.1 time: 0.031260 Aug 30 15:00:34.649856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 756/1515] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:34 2022] GET /compute/v2.1/servers/17fcd66f-fa4d-4b53-a76c-6d10cba8674a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:00:34.672144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-12b62a2b-1a6f-43fc-9495-960e1a2834c8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:34.672636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-12b62a2b-1a6f-43fc-9495-960e1a2834c8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:34.678783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12b62a2b-1a6f-43fc-9495-960e1a2834c8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:34.679296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12b62a2b-1a6f-43fc-9495-960e1a2834c8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:34.680508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12b62a2b-1a6f-43fc-9495-960e1a2834c8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:34.681177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12b62a2b-1a6f-43fc-9495-960e1a2834c8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:34.681632 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12b62a2b-1a6f-43fc-9495-960e1a2834c8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:34.682054 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12b62a2b-1a6f-43fc-9495-960e1a2834c8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:34.708353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-12b62a2b-1a6f-43fc-9495-960e1a2834c8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 15:00:34.715308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8ba5d996-688f-4dcd-a95f-4ae51c0b278d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:34.723525 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8ba5d996-688f-4dcd-a95f-4ae51c0b278d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.175388 Aug 30 15:00:34.724113 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 760/1516] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:34 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:34.784970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-12b62a2b-1a6f-43fc-9495-960e1a2834c8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 204 len: 0 microversion: 2.1 time: 0.116370 Aug 30 15:00:34.785985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 757/1517] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:00:34 2022] DELETE /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 15:00:34.795226 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1979cfb8-e76f-4c26-9417-0620ca6d963a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:34.795850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1979cfb8-e76f-4c26-9417-0620ca6d963a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:34.801826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1979cfb8-e76f-4c26-9417-0620ca6d963a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:34.802306 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1979cfb8-e76f-4c26-9417-0620ca6d963a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:34.802734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1979cfb8-e76f-4c26-9417-0620ca6d963a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:34.803456 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1979cfb8-e76f-4c26-9417-0620ca6d963a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:34.803906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1979cfb8-e76f-4c26-9417-0620ca6d963a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:34.804356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1979cfb8-e76f-4c26-9417-0620ca6d963a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:34.809743 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:34.934740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1979cfb8-e76f-4c26-9417-0620ca6d963a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:34.942982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1979cfb8-e76f-4c26-9417-0620ca6d963a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151629 Aug 30 15:00:34.943590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 761/1518] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:34 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:34.995967 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7cec598c-60f7-4f31-9830-2229a2cc25cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:34.996583 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7cec598c-60f7-4f31-9830-2229a2cc25cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:35.003032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cec598c-60f7-4f31-9830-2229a2cc25cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:35.003614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cec598c-60f7-4f31-9830-2229a2cc25cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:35.004272 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cec598c-60f7-4f31-9830-2229a2cc25cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:35.004713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cec598c-60f7-4f31-9830-2229a2cc25cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:35.005156 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cec598c-60f7-4f31-9830-2229a2cc25cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:35.005571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cec598c-60f7-4f31-9830-2229a2cc25cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:35.066792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7cec598c-60f7-4f31-9830-2229a2cc25cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:35.076531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7cec598c-60f7-4f31-9830-2229a2cc25cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:35.077971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7cec598c-60f7-4f31-9830-2229a2cc25cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:35.079112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7cec598c-60f7-4f31-9830-2229a2cc25cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088109 Aug 30 15:00:35.079696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 758/1519] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:34 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:35.747644 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-72a397ad-2ba0-4e76-b0a1-ae442c4fd548 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:35.748256 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-72a397ad-2ba0-4e76-b0a1-ae442c4fd548 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:35.754777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-72a397ad-2ba0-4e76-b0a1-ae442c4fd548 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:35.755281 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-72a397ad-2ba0-4e76-b0a1-ae442c4fd548 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:35.755717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-72a397ad-2ba0-4e76-b0a1-ae442c4fd548 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:35.756402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-72a397ad-2ba0-4e76-b0a1-ae442c4fd548 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:35.756851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-72a397ad-2ba0-4e76-b0a1-ae442c4fd548 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:35.757273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-72a397ad-2ba0-4e76-b0a1-ae442c4fd548 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:35.886139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-72a397ad-2ba0-4e76-b0a1-ae442c4fd548 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:35.894181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-72a397ad-2ba0-4e76-b0a1-ae442c4fd548 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150472 Aug 30 15:00:35.894746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 762/1520] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:35 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:35.965332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8f2adbfc-b6e6-4255-9a49-dde4684f7a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:35.965947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8f2adbfc-b6e6-4255-9a49-dde4684f7a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:35.971930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f2adbfc-b6e6-4255-9a49-dde4684f7a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:35.972416 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f2adbfc-b6e6-4255-9a49-dde4684f7a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:35.972855 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f2adbfc-b6e6-4255-9a49-dde4684f7a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:35.973541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f2adbfc-b6e6-4255-9a49-dde4684f7a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:35.974003 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f2adbfc-b6e6-4255-9a49-dde4684f7a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:35.974427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f2adbfc-b6e6-4255-9a49-dde4684f7a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:36.101631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3c6631d9-c3af-4f6f-b194-9661ee21c9e9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:36.102803 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3c6631d9-c3af-4f6f-b194-9661ee21c9e9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:36.104818 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8f2adbfc-b6e6-4255-9a49-dde4684f7a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:36.108443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c6631d9-c3af-4f6f-b194-9661ee21c9e9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:36.108920 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c6631d9-c3af-4f6f-b194-9661ee21c9e9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:36.109353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c6631d9-c3af-4f6f-b194-9661ee21c9e9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:36.110043 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c6631d9-c3af-4f6f-b194-9661ee21c9e9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:36.110489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c6631d9-c3af-4f6f-b194-9661ee21c9e9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:36.110916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c6631d9-c3af-4f6f-b194-9661ee21c9e9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:36.113160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8f2adbfc-b6e6-4255-9a49-dde4684f7a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152332 Aug 30 15:00:36.113732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 759/1521] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:35 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:36.171839 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3c6631d9-c3af-4f6f-b194-9661ee21c9e9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:36.180324 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3c6631d9-c3af-4f6f-b194-9661ee21c9e9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:36.181780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3c6631d9-c3af-4f6f-b194-9661ee21c9e9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:36.182913 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3c6631d9-c3af-4f6f-b194-9661ee21c9e9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085399 Aug 30 15:00:36.183528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 763/1522] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:36 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:00:36.915695 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-97528bf9-2383-4819-abdc-49925b33425f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:36.916305 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-97528bf9-2383-4819-abdc-49925b33425f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:36.922284 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97528bf9-2383-4819-abdc-49925b33425f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:36.922762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97528bf9-2383-4819-abdc-49925b33425f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:36.923192 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97528bf9-2383-4819-abdc-49925b33425f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:36.923905 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97528bf9-2383-4819-abdc-49925b33425f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:36.924352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97528bf9-2383-4819-abdc-49925b33425f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:36.924772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97528bf9-2383-4819-abdc-49925b33425f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:37.053183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-97528bf9-2383-4819-abdc-49925b33425f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:37.062378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-97528bf9-2383-4819-abdc-49925b33425f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151147 Aug 30 15:00:37.062943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 760/1523] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:36 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:37.133780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b7bb6f38-abc2-4799-bfb3-d0a6dd17bbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:37.134393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b7bb6f38-abc2-4799-bfb3-d0a6dd17bbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:37.140801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7bb6f38-abc2-4799-bfb3-d0a6dd17bbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:37.141278 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7bb6f38-abc2-4799-bfb3-d0a6dd17bbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:37.141709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7bb6f38-abc2-4799-bfb3-d0a6dd17bbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:37.142398 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7bb6f38-abc2-4799-bfb3-d0a6dd17bbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:37.142854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7bb6f38-abc2-4799-bfb3-d0a6dd17bbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:37.143304 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7bb6f38-abc2-4799-bfb3-d0a6dd17bbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:37.206258 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ec238560-fe33-44c9-b248-887dea80ccd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:37.206847 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ec238560-fe33-44c9-b248-887dea80ccd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:37.214030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec238560-fe33-44c9-b248-887dea80ccd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:37.214560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec238560-fe33-44c9-b248-887dea80ccd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:37.215000 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec238560-fe33-44c9-b248-887dea80ccd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:37.215796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec238560-fe33-44c9-b248-887dea80ccd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:37.216247 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec238560-fe33-44c9-b248-887dea80ccd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:37.216720 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec238560-fe33-44c9-b248-887dea80ccd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:37.272235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b7bb6f38-abc2-4799-bfb3-d0a6dd17bbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:37.281615 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b7bb6f38-abc2-4799-bfb3-d0a6dd17bbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151618 Aug 30 15:00:37.282201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 764/1524] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:37 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:37.283370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ec238560-fe33-44c9-b248-887dea80ccd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:37.293871 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ec238560-fe33-44c9-b248-887dea80ccd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:37.295360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ec238560-fe33-44c9-b248-887dea80ccd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:37.296530 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ec238560-fe33-44c9-b248-887dea80ccd1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.094324 Aug 30 15:00:37.297132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 761/1525] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:37 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:00:38.084151 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1fd79f49-e8b5-4de6-a976-c71b8f84a445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:38.084787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1fd79f49-e8b5-4de6-a976-c71b8f84a445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:38.091016 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1fd79f49-e8b5-4de6-a976-c71b8f84a445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:38.091523 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1fd79f49-e8b5-4de6-a976-c71b8f84a445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:38.091954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1fd79f49-e8b5-4de6-a976-c71b8f84a445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:38.092637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1fd79f49-e8b5-4de6-a976-c71b8f84a445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:38.093084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1fd79f49-e8b5-4de6-a976-c71b8f84a445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:38.093501 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1fd79f49-e8b5-4de6-a976-c71b8f84a445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:38.221404 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1fd79f49-e8b5-4de6-a976-c71b8f84a445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:38.229833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1fd79f49-e8b5-4de6-a976-c71b8f84a445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149525 Aug 30 15:00:38.230399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 765/1526] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:38 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:38.302914 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ee73ae5f-0ed2-430a-8610-fc19540f0bef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:38.303547 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ee73ae5f-0ed2-430a-8610-fc19540f0bef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:38.310419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee73ae5f-0ed2-430a-8610-fc19540f0bef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:38.310896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee73ae5f-0ed2-430a-8610-fc19540f0bef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:38.313401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee73ae5f-0ed2-430a-8610-fc19540f0bef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:38.313401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee73ae5f-0ed2-430a-8610-fc19540f0bef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:38.313401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee73ae5f-0ed2-430a-8610-fc19540f0bef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:38.313401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee73ae5f-0ed2-430a-8610-fc19540f0bef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:38.323542 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f7b2ad27-d5c8-443e-a7e3-1fe62834f765 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:38.324874 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f7b2ad27-d5c8-443e-a7e3-1fe62834f765 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:38.331026 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7b2ad27-d5c8-443e-a7e3-1fe62834f765 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:38.331545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7b2ad27-d5c8-443e-a7e3-1fe62834f765 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:38.331986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7b2ad27-d5c8-443e-a7e3-1fe62834f765 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:38.332684 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7b2ad27-d5c8-443e-a7e3-1fe62834f765 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:38.333132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7b2ad27-d5c8-443e-a7e3-1fe62834f765 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:38.333553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f7b2ad27-d5c8-443e-a7e3-1fe62834f765 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:38.395523 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f7b2ad27-d5c8-443e-a7e3-1fe62834f765 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:38.404191 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f7b2ad27-d5c8-443e-a7e3-1fe62834f765 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:38.405642 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f7b2ad27-d5c8-443e-a7e3-1fe62834f765 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:38.406783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f7b2ad27-d5c8-443e-a7e3-1fe62834f765 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091198 Aug 30 15:00:38.407364 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 766/1527] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:38 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:38.441910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ee73ae5f-0ed2-430a-8610-fc19540f0bef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:38.450864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ee73ae5f-0ed2-430a-8610-fc19540f0bef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151838 Aug 30 15:00:38.451456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 762/1528] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:38 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:39.251458 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3dab18fa-b980-460c-98dc-ef67244ca143 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:39.252079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3dab18fa-b980-460c-98dc-ef67244ca143 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:39.258950 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3dab18fa-b980-460c-98dc-ef67244ca143 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:39.259471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3dab18fa-b980-460c-98dc-ef67244ca143 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:39.259908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3dab18fa-b980-460c-98dc-ef67244ca143 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:39.260605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3dab18fa-b980-460c-98dc-ef67244ca143 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:39.261057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3dab18fa-b980-460c-98dc-ef67244ca143 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:39.261478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3dab18fa-b980-460c-98dc-ef67244ca143 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:39.387838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3dab18fa-b980-460c-98dc-ef67244ca143 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:39.395921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3dab18fa-b980-460c-98dc-ef67244ca143 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148393 Aug 30 15:00:39.396491 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 767/1529] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:39 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:39.430182 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9e6669fe-2313-48d3-b8de-8cc40e17d7e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:39.430939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9e6669fe-2313-48d3-b8de-8cc40e17d7e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:39.437224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e6669fe-2313-48d3-b8de-8cc40e17d7e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:39.437699 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e6669fe-2313-48d3-b8de-8cc40e17d7e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:39.438132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e6669fe-2313-48d3-b8de-8cc40e17d7e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:39.438812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e6669fe-2313-48d3-b8de-8cc40e17d7e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:39.439292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e6669fe-2313-48d3-b8de-8cc40e17d7e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:39.439714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e6669fe-2313-48d3-b8de-8cc40e17d7e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:39.472104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-03d1023b-c955-479b-9b0f-b4a137c3f8f1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:39.472644 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-03d1023b-c955-479b-9b0f-b4a137c3f8f1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:39.478815 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-03d1023b-c955-479b-9b0f-b4a137c3f8f1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:39.479342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-03d1023b-c955-479b-9b0f-b4a137c3f8f1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:39.479784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-03d1023b-c955-479b-9b0f-b4a137c3f8f1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:39.480532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-03d1023b-c955-479b-9b0f-b4a137c3f8f1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:39.480981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-03d1023b-c955-479b-9b0f-b4a137c3f8f1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:39.481736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-03d1023b-c955-479b-9b0f-b4a137c3f8f1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:39.501388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9e6669fe-2313-48d3-b8de-8cc40e17d7e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:39.511063 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9e6669fe-2313-48d3-b8de-8cc40e17d7e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:39.512568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9e6669fe-2313-48d3-b8de-8cc40e17d7e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:39.513780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9e6669fe-2313-48d3-b8de-8cc40e17d7e7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088088 Aug 30 15:00:39.514411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 763/1530] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:39 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:39.611480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-03d1023b-c955-479b-9b0f-b4a137c3f8f1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:39.620122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-03d1023b-c955-479b-9b0f-b4a137c3f8f1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151878 Aug 30 15:00:39.620686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 768/1531] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:39 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:40.418580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7e6c11ba-f6a9-4b64-870a-86746e06a90b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:40.419195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7e6c11ba-f6a9-4b64-870a-86746e06a90b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:40.425119 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e6c11ba-f6a9-4b64-870a-86746e06a90b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:40.425598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e6c11ba-f6a9-4b64-870a-86746e06a90b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:40.426035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e6c11ba-f6a9-4b64-870a-86746e06a90b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:40.426741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e6c11ba-f6a9-4b64-870a-86746e06a90b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:40.427174 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e6c11ba-f6a9-4b64-870a-86746e06a90b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:40.427624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e6c11ba-f6a9-4b64-870a-86746e06a90b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:40.537737 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e461fac1-4e01-4e0d-b165-8383406c9354 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:40.538434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e461fac1-4e01-4e0d-b165-8383406c9354 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:40.545130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e461fac1-4e01-4e0d-b165-8383406c9354 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:40.545622 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e461fac1-4e01-4e0d-b165-8383406c9354 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:40.546063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e461fac1-4e01-4e0d-b165-8383406c9354 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:40.546768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e461fac1-4e01-4e0d-b165-8383406c9354 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:40.547254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e461fac1-4e01-4e0d-b165-8383406c9354 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:40.547671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e461fac1-4e01-4e0d-b165-8383406c9354 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:40.611323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e461fac1-4e01-4e0d-b165-8383406c9354 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:40.620021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e461fac1-4e01-4e0d-b165-8383406c9354 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:40.621473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e461fac1-4e01-4e0d-b165-8383406c9354 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:40.622628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e461fac1-4e01-4e0d-b165-8383406c9354 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089361 Aug 30 15:00:40.623191 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 769/1532] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:40 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:40.636664 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7e6c11ba-f6a9-4b64-870a-86746e06a90b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:40.644862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-757df34a-fef4-4424-83ab-28053de68c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:40.645280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7e6c11ba-f6a9-4b64-870a-86746e06a90b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.231457 Aug 30 15:00:40.645626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-757df34a-fef4-4424-83ab-28053de68c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:40.657409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 764/1533] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:40 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:40.657628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-757df34a-fef4-4424-83ab-28053de68c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:40.657628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-757df34a-fef4-4424-83ab-28053de68c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:40.657628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-757df34a-fef4-4424-83ab-28053de68c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:40.657628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-757df34a-fef4-4424-83ab-28053de68c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:40.658040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-757df34a-fef4-4424-83ab-28053de68c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:40.658040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-757df34a-fef4-4424-83ab-28053de68c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:40.783762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-757df34a-fef4-4424-83ab-28053de68c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:40.792780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-757df34a-fef4-4424-83ab-28053de68c40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151628 Aug 30 15:00:40.793374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 770/1534] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:40 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:41.647433 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b4c6e18b-b660-4c76-a341-72ea051c8516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:41.648117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b4c6e18b-b660-4c76-a341-72ea051c8516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:41.655248 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4c6e18b-b660-4c76-a341-72ea051c8516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:41.655801 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4c6e18b-b660-4c76-a341-72ea051c8516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:41.656296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4c6e18b-b660-4c76-a341-72ea051c8516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:41.657046 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4c6e18b-b660-4c76-a341-72ea051c8516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:41.657560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4c6e18b-b660-4c76-a341-72ea051c8516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:41.658076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4c6e18b-b660-4c76-a341-72ea051c8516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:41.667545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c697370d-44e7-47eb-94ba-44b9b26d42c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:41.668192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c697370d-44e7-47eb-94ba-44b9b26d42c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:41.674218 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c697370d-44e7-47eb-94ba-44b9b26d42c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:41.674696 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c697370d-44e7-47eb-94ba-44b9b26d42c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:41.675124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c697370d-44e7-47eb-94ba-44b9b26d42c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:41.675835 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c697370d-44e7-47eb-94ba-44b9b26d42c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:41.677021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c697370d-44e7-47eb-94ba-44b9b26d42c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:41.677347 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c697370d-44e7-47eb-94ba-44b9b26d42c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:41.726713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b4c6e18b-b660-4c76-a341-72ea051c8516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:41.736581 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b4c6e18b-b660-4c76-a341-72ea051c8516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:41.738027 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b4c6e18b-b660-4c76-a341-72ea051c8516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:41.739183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b4c6e18b-b660-4c76-a341-72ea051c8516 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.095664 Aug 30 15:00:41.740047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 765/1535] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:41 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:41.813847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c697370d-44e7-47eb-94ba-44b9b26d42c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:41.814111 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-46cb5bb3-20e5-47e8-ac49-49a89a996d3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:41.814530 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-46cb5bb3-20e5-47e8-ac49-49a89a996d3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:41.821823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46cb5bb3-20e5-47e8-ac49-49a89a996d3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:41.822302 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46cb5bb3-20e5-47e8-ac49-49a89a996d3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:41.822732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46cb5bb3-20e5-47e8-ac49-49a89a996d3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:41.823421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c697370d-44e7-47eb-94ba-44b9b26d42c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.159907 Aug 30 15:00:41.823549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46cb5bb3-20e5-47e8-ac49-49a89a996d3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:41.823927 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46cb5bb3-20e5-47e8-ac49-49a89a996d3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:41.824044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 771/1536] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:41 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:41.824346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46cb5bb3-20e5-47e8-ac49-49a89a996d3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:41.958669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-46cb5bb3-20e5-47e8-ac49-49a89a996d3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:41.967280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-46cb5bb3-20e5-47e8-ac49-49a89a996d3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.157232 Aug 30 15:00:41.967842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 766/1537] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:41 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:42.762503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8a174b94-5b80-4cf5-8153-2037ad9a937c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:42.763107 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8a174b94-5b80-4cf5-8153-2037ad9a937c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:42.769474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a174b94-5b80-4cf5-8153-2037ad9a937c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:42.769950 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a174b94-5b80-4cf5-8153-2037ad9a937c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:42.770380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a174b94-5b80-4cf5-8153-2037ad9a937c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:42.771093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a174b94-5b80-4cf5-8153-2037ad9a937c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:42.771568 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a174b94-5b80-4cf5-8153-2037ad9a937c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:42.771990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a174b94-5b80-4cf5-8153-2037ad9a937c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:42.832128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8a174b94-5b80-4cf5-8153-2037ad9a937c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:42.841669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8a174b94-5b80-4cf5-8153-2037ad9a937c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:42.843104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8a174b94-5b80-4cf5-8153-2037ad9a937c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:42.844258 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8a174b94-5b80-4cf5-8153-2037ad9a937c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085720 Aug 30 15:00:42.844965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 772/1538] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:42 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:42.845405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4d45ef24-75f6-4909-9571-57d145ebe050 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:42.846016 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4d45ef24-75f6-4909-9571-57d145ebe050 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:42.852388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d45ef24-75f6-4909-9571-57d145ebe050 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:42.852863 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d45ef24-75f6-4909-9571-57d145ebe050 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:42.853289 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d45ef24-75f6-4909-9571-57d145ebe050 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:42.853974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d45ef24-75f6-4909-9571-57d145ebe050 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:42.854487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d45ef24-75f6-4909-9571-57d145ebe050 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:42.854911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d45ef24-75f6-4909-9571-57d145ebe050 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:42.984996 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4d45ef24-75f6-4909-9571-57d145ebe050 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:42.988837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b226bc17-d80a-47b5-9cdd-4e3f0b1ac1aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:42.989452 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b226bc17-d80a-47b5-9cdd-4e3f0b1ac1aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:42.993440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4d45ef24-75f6-4909-9571-57d145ebe050 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151822 Aug 30 15:00:42.994095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 767/1539] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:42 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:42.995515 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b226bc17-d80a-47b5-9cdd-4e3f0b1ac1aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:42.995996 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b226bc17-d80a-47b5-9cdd-4e3f0b1ac1aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:42.996429 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b226bc17-d80a-47b5-9cdd-4e3f0b1ac1aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:42.997126 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b226bc17-d80a-47b5-9cdd-4e3f0b1ac1aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:42.997577 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b226bc17-d80a-47b5-9cdd-4e3f0b1ac1aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:42.998000 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b226bc17-d80a-47b5-9cdd-4e3f0b1ac1aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:43.122511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b226bc17-d80a-47b5-9cdd-4e3f0b1ac1aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:43.130646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b226bc17-d80a-47b5-9cdd-4e3f0b1ac1aa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.145600 Aug 30 15:00:43.131226 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 773/1540] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:42 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:43.866550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-12664d35-649a-4678-a425-98f77b8d4c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:43.867880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-12664d35-649a-4678-a425-98f77b8d4c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:43.874136 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12664d35-649a-4678-a425-98f77b8d4c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:43.874608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12664d35-649a-4678-a425-98f77b8d4c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:43.875036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12664d35-649a-4678-a425-98f77b8d4c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:43.875750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12664d35-649a-4678-a425-98f77b8d4c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:43.876195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12664d35-649a-4678-a425-98f77b8d4c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:43.876609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-12664d35-649a-4678-a425-98f77b8d4c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:43.936540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-12664d35-649a-4678-a425-98f77b8d4c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:43.944983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-12664d35-649a-4678-a425-98f77b8d4c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:43.946827 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-12664d35-649a-4678-a425-98f77b8d4c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:43.947983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-12664d35-649a-4678-a425-98f77b8d4c19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085383 Aug 30 15:00:43.948542 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 768/1541] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:43 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:44.014032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-668b5536-d2b3-45eb-931a-96b577bc1068 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:44.014633 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-668b5536-d2b3-45eb-931a-96b577bc1068 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:44.021006 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-668b5536-d2b3-45eb-931a-96b577bc1068 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:44.021480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-668b5536-d2b3-45eb-931a-96b577bc1068 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:44.021906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-668b5536-d2b3-45eb-931a-96b577bc1068 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:44.022588 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-668b5536-d2b3-45eb-931a-96b577bc1068 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:44.023658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-668b5536-d2b3-45eb-931a-96b577bc1068 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:44.024395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-668b5536-d2b3-45eb-931a-96b577bc1068 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:44.153095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-34a0576e-e06d-4854-86f8-5570d1d7c598 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:44.153790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-34a0576e-e06d-4854-86f8-5570d1d7c598 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:44.160066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34a0576e-e06d-4854-86f8-5570d1d7c598 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:44.160557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34a0576e-e06d-4854-86f8-5570d1d7c598 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:44.160992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34a0576e-e06d-4854-86f8-5570d1d7c598 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:44.161695 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34a0576e-e06d-4854-86f8-5570d1d7c598 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:44.162147 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34a0576e-e06d-4854-86f8-5570d1d7c598 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:44.162571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34a0576e-e06d-4854-86f8-5570d1d7c598 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:44.299970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-34a0576e-e06d-4854-86f8-5570d1d7c598 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:44.309139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-34a0576e-e06d-4854-86f8-5570d1d7c598 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.160109 Aug 30 15:00:44.309713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 769/1542] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:44 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:44.376554 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-668b5536-d2b3-45eb-931a-96b577bc1068 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:44.384973 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-668b5536-d2b3-45eb-931a-96b577bc1068 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.374807 Aug 30 15:00:44.385528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 774/1543] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:44 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:44.971109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-91173eb5-9602-48d4-ba84-fa427b655594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:44.971718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-91173eb5-9602-48d4-ba84-fa427b655594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:44.978690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91173eb5-9602-48d4-ba84-fa427b655594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:44.979168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91173eb5-9602-48d4-ba84-fa427b655594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:44.979624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91173eb5-9602-48d4-ba84-fa427b655594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:44.980312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91173eb5-9602-48d4-ba84-fa427b655594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:44.980763 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91173eb5-9602-48d4-ba84-fa427b655594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:44.981185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-91173eb5-9602-48d4-ba84-fa427b655594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:45.044113 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-91173eb5-9602-48d4-ba84-fa427b655594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:45.052681 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-91173eb5-9602-48d4-ba84-fa427b655594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:45.054120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-91173eb5-9602-48d4-ba84-fa427b655594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:45.055339 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-91173eb5-9602-48d4-ba84-fa427b655594 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088224 Aug 30 15:00:45.055889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 770/1544] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:44 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:45.329752 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6c525e4e-8a63-42f8-8b2e-78a1c153b50a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:45.330386 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6c525e4e-8a63-42f8-8b2e-78a1c153b50a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:45.337467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c525e4e-8a63-42f8-8b2e-78a1c153b50a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:45.337943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c525e4e-8a63-42f8-8b2e-78a1c153b50a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:45.338383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c525e4e-8a63-42f8-8b2e-78a1c153b50a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:45.339073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c525e4e-8a63-42f8-8b2e-78a1c153b50a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:45.339584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c525e4e-8a63-42f8-8b2e-78a1c153b50a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:45.340004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c525e4e-8a63-42f8-8b2e-78a1c153b50a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:45.406074 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8ea64327-68ab-4d66-a68b-e8fce39a7b4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:45.406705 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8ea64327-68ab-4d66-a68b-e8fce39a7b4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:45.412682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ea64327-68ab-4d66-a68b-e8fce39a7b4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:45.413163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ea64327-68ab-4d66-a68b-e8fce39a7b4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:45.413639 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ea64327-68ab-4d66-a68b-e8fce39a7b4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:45.414429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ea64327-68ab-4d66-a68b-e8fce39a7b4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:45.414879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ea64327-68ab-4d66-a68b-e8fce39a7b4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:45.415329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ea64327-68ab-4d66-a68b-e8fce39a7b4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:45.434604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:45.469253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6c525e4e-8a63-42f8-8b2e-78a1c153b50a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:45.477462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6c525e4e-8a63-42f8-8b2e-78a1c153b50a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151536 Aug 30 15:00:45.478038 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 775/1545] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:45 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:45.550605 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8ea64327-68ab-4d66-a68b-e8fce39a7b4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:45.559816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8ea64327-68ab-4d66-a68b-e8fce39a7b4d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.157586 Aug 30 15:00:45.560378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 771/1546] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:45 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:46.078028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-df1c7239-9d79-42eb-a7cc-498ba86098cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:46.078634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-df1c7239-9d79-42eb-a7cc-498ba86098cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:46.084659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-df1c7239-9d79-42eb-a7cc-498ba86098cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:46.085134 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-df1c7239-9d79-42eb-a7cc-498ba86098cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:46.085568 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-df1c7239-9d79-42eb-a7cc-498ba86098cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:46.086407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-df1c7239-9d79-42eb-a7cc-498ba86098cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:46.086857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-df1c7239-9d79-42eb-a7cc-498ba86098cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:46.087302 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-df1c7239-9d79-42eb-a7cc-498ba86098cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:46.150336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-df1c7239-9d79-42eb-a7cc-498ba86098cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:46.158740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-df1c7239-9d79-42eb-a7cc-498ba86098cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:46.160235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-df1c7239-9d79-42eb-a7cc-498ba86098cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:46.161352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-df1c7239-9d79-42eb-a7cc-498ba86098cc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087303 Aug 30 15:00:46.161911 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 776/1547] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:46 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:46.497988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7cc66855-0e55-4467-8379-c3cf79d1da2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:46.498536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7cc66855-0e55-4467-8379-c3cf79d1da2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:46.504885 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cc66855-0e55-4467-8379-c3cf79d1da2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:46.505364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cc66855-0e55-4467-8379-c3cf79d1da2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:46.505797 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cc66855-0e55-4467-8379-c3cf79d1da2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:46.506480 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cc66855-0e55-4467-8379-c3cf79d1da2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:46.506952 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cc66855-0e55-4467-8379-c3cf79d1da2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:46.508023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cc66855-0e55-4467-8379-c3cf79d1da2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:46.581850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8c61b881-9631-450f-afd2-457be943f373 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:46.582607 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8c61b881-9631-450f-afd2-457be943f373 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:46.589831 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c61b881-9631-450f-afd2-457be943f373 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:46.590312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c61b881-9631-450f-afd2-457be943f373 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:46.590744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c61b881-9631-450f-afd2-457be943f373 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:46.591464 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c61b881-9631-450f-afd2-457be943f373 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:46.591917 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c61b881-9631-450f-afd2-457be943f373 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:46.592343 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c61b881-9631-450f-afd2-457be943f373 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:46.638955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7cc66855-0e55-4467-8379-c3cf79d1da2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:46.647115 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7cc66855-0e55-4467-8379-c3cf79d1da2c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153129 Aug 30 15:00:46.647722 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 772/1548] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:46 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:46.718735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8c61b881-9631-450f-afd2-457be943f373 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:46.722118 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:46.728408 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8c61b881-9631-450f-afd2-457be943f373 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150417 Aug 30 15:00:46.729010 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 777/1549] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:46 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:47.184620 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1078d9b6-f2cc-4e31-8a66-ed46bd03b6f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:47.185224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1078d9b6-f2cc-4e31-8a66-ed46bd03b6f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:47.191202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1078d9b6-f2cc-4e31-8a66-ed46bd03b6f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:47.191696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1078d9b6-f2cc-4e31-8a66-ed46bd03b6f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:47.192120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1078d9b6-f2cc-4e31-8a66-ed46bd03b6f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:47.192792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1078d9b6-f2cc-4e31-8a66-ed46bd03b6f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:47.193235 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1078d9b6-f2cc-4e31-8a66-ed46bd03b6f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:47.193648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1078d9b6-f2cc-4e31-8a66-ed46bd03b6f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:47.256808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1078d9b6-f2cc-4e31-8a66-ed46bd03b6f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:47.265922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1078d9b6-f2cc-4e31-8a66-ed46bd03b6f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:47.267403 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1078d9b6-f2cc-4e31-8a66-ed46bd03b6f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:47.268574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1078d9b6-f2cc-4e31-8a66-ed46bd03b6f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087853 Aug 30 15:00:47.269132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 773/1550] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:47 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:47.668802 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3a08a1bb-8367-4383-9e42-789631ca6555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:47.669401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3a08a1bb-8367-4383-9e42-789631ca6555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:47.675778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a08a1bb-8367-4383-9e42-789631ca6555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:47.676255 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a08a1bb-8367-4383-9e42-789631ca6555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:47.676687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a08a1bb-8367-4383-9e42-789631ca6555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:47.677381 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a08a1bb-8367-4383-9e42-789631ca6555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:47.677830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a08a1bb-8367-4383-9e42-789631ca6555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:47.678245 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a08a1bb-8367-4383-9e42-789631ca6555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:47.750006 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-af0b8774-906c-4b53-94cb-2a0a96db7794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:47.750625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-af0b8774-906c-4b53-94cb-2a0a96db7794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:47.757225 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af0b8774-906c-4b53-94cb-2a0a96db7794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:47.758396 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af0b8774-906c-4b53-94cb-2a0a96db7794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:47.758865 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af0b8774-906c-4b53-94cb-2a0a96db7794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:47.759634 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af0b8774-906c-4b53-94cb-2a0a96db7794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:47.760112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af0b8774-906c-4b53-94cb-2a0a96db7794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:47.760536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af0b8774-906c-4b53-94cb-2a0a96db7794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:47.807086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3a08a1bb-8367-4383-9e42-789631ca6555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:47.815235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3a08a1bb-8367-4383-9e42-789631ca6555 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150550 Aug 30 15:00:47.815807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 778/1551] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:47 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:47.889494 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-af0b8774-906c-4b53-94cb-2a0a96db7794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:47.897470 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-af0b8774-906c-4b53-94cb-2a0a96db7794 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151342 Aug 30 15:00:47.898589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 774/1552] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:47 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:48.291615 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c0fecc1c-83ec-4ed7-a438-b85d096de2b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:48.292227 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c0fecc1c-83ec-4ed7-a438-b85d096de2b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:48.298086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0fecc1c-83ec-4ed7-a438-b85d096de2b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:48.298566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0fecc1c-83ec-4ed7-a438-b85d096de2b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:48.298998 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0fecc1c-83ec-4ed7-a438-b85d096de2b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:48.299709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0fecc1c-83ec-4ed7-a438-b85d096de2b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:48.300187 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0fecc1c-83ec-4ed7-a438-b85d096de2b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:48.300635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0fecc1c-83ec-4ed7-a438-b85d096de2b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:48.363884 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c0fecc1c-83ec-4ed7-a438-b85d096de2b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:48.372663 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c0fecc1c-83ec-4ed7-a438-b85d096de2b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:48.374111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c0fecc1c-83ec-4ed7-a438-b85d096de2b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:48.375274 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c0fecc1c-83ec-4ed7-a438-b85d096de2b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087855 Aug 30 15:00:48.375834 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 779/1553] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:48 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:48.836509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8d2834dc-dc3a-4ad5-b426-438931f6f101 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:48.837147 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8d2834dc-dc3a-4ad5-b426-438931f6f101 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:48.843701 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2834dc-dc3a-4ad5-b426-438931f6f101 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:48.844214 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2834dc-dc3a-4ad5-b426-438931f6f101 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:48.844647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2834dc-dc3a-4ad5-b426-438931f6f101 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:48.845333 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2834dc-dc3a-4ad5-b426-438931f6f101 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:48.845780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2834dc-dc3a-4ad5-b426-438931f6f101 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:48.846200 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2834dc-dc3a-4ad5-b426-438931f6f101 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:48.918403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f4ded202-b41d-474d-a818-929844dec1c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:48.919012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f4ded202-b41d-474d-a818-929844dec1c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:48.925773 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4ded202-b41d-474d-a818-929844dec1c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:48.926152 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4ded202-b41d-474d-a818-929844dec1c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:48.926590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4ded202-b41d-474d-a818-929844dec1c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:48.927307 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4ded202-b41d-474d-a818-929844dec1c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:48.927764 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4ded202-b41d-474d-a818-929844dec1c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:48.928179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f4ded202-b41d-474d-a818-929844dec1c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:48.978156 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8d2834dc-dc3a-4ad5-b426-438931f6f101 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:48.986294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8d2834dc-dc3a-4ad5-b426-438931f6f101 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153964 Aug 30 15:00:48.986858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 775/1554] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:48 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:49.058240 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f4ded202-b41d-474d-a818-929844dec1c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:49.066368 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f4ded202-b41d-474d-a818-929844dec1c4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151829 Aug 30 15:00:49.066935 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 780/1555] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:48 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:49.398092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-58c4c2f1-39b7-4ef0-a46e-73cc14c98b3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:49.398789 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-58c4c2f1-39b7-4ef0-a46e-73cc14c98b3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:49.404734 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58c4c2f1-39b7-4ef0-a46e-73cc14c98b3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:49.405211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58c4c2f1-39b7-4ef0-a46e-73cc14c98b3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:49.405642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58c4c2f1-39b7-4ef0-a46e-73cc14c98b3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:49.406330 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58c4c2f1-39b7-4ef0-a46e-73cc14c98b3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:49.406784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58c4c2f1-39b7-4ef0-a46e-73cc14c98b3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:49.407232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58c4c2f1-39b7-4ef0-a46e-73cc14c98b3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:49.467161 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-58c4c2f1-39b7-4ef0-a46e-73cc14c98b3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:49.475620 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-58c4c2f1-39b7-4ef0-a46e-73cc14c98b3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:49.477071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-58c4c2f1-39b7-4ef0-a46e-73cc14c98b3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:49.478217 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-58c4c2f1-39b7-4ef0-a46e-73cc14c98b3b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084079 Aug 30 15:00:49.478780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 776/1556] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:49 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:50.007915 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9bcf7d83-7218-4bae-a9ea-ad03abf96f57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:50.008596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9bcf7d83-7218-4bae-a9ea-ad03abf96f57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:50.014471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9bcf7d83-7218-4bae-a9ea-ad03abf96f57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:50.014944 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9bcf7d83-7218-4bae-a9ea-ad03abf96f57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:50.015418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9bcf7d83-7218-4bae-a9ea-ad03abf96f57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:50.016127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9bcf7d83-7218-4bae-a9ea-ad03abf96f57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:50.016575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9bcf7d83-7218-4bae-a9ea-ad03abf96f57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:50.016999 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9bcf7d83-7218-4bae-a9ea-ad03abf96f57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:50.089248 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e62dbceb-348a-4698-a7b6-6efed872c04e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:50.089857 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e62dbceb-348a-4698-a7b6-6efed872c04e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:50.096125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e62dbceb-348a-4698-a7b6-6efed872c04e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:50.096601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e62dbceb-348a-4698-a7b6-6efed872c04e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:50.097027 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e62dbceb-348a-4698-a7b6-6efed872c04e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:50.097714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e62dbceb-348a-4698-a7b6-6efed872c04e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:50.098155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e62dbceb-348a-4698-a7b6-6efed872c04e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:50.098566 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e62dbceb-348a-4698-a7b6-6efed872c04e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:50.143462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9bcf7d83-7218-4bae-a9ea-ad03abf96f57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:50.152705 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9bcf7d83-7218-4bae-a9ea-ad03abf96f57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148767 Aug 30 15:00:50.153277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 781/1557] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:50 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:50.226964 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e62dbceb-348a-4698-a7b6-6efed872c04e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:50.235904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e62dbceb-348a-4698-a7b6-6efed872c04e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151320 Aug 30 15:00:50.236469 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 777/1558] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:50 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:50.501330 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6dec3744-e7ee-4e0c-8b1e-a34a41511e17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:50.501938 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6dec3744-e7ee-4e0c-8b1e-a34a41511e17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:50.507881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6dec3744-e7ee-4e0c-8b1e-a34a41511e17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:50.508354 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6dec3744-e7ee-4e0c-8b1e-a34a41511e17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:50.509519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6dec3744-e7ee-4e0c-8b1e-a34a41511e17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:50.510613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6dec3744-e7ee-4e0c-8b1e-a34a41511e17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:50.511173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6dec3744-e7ee-4e0c-8b1e-a34a41511e17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:50.511623 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6dec3744-e7ee-4e0c-8b1e-a34a41511e17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:50.576016 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6dec3744-e7ee-4e0c-8b1e-a34a41511e17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:50.584566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6dec3744-e7ee-4e0c-8b1e-a34a41511e17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:50.586004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6dec3744-e7ee-4e0c-8b1e-a34a41511e17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:50.587749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6dec3744-e7ee-4e0c-8b1e-a34a41511e17 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089841 Aug 30 15:00:50.588312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 782/1559] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:50 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:51.174423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-30692f0c-9848-49f7-ae35-5b03f587a257 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:51.175006 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-30692f0c-9848-49f7-ae35-5b03f587a257 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:51.176901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:51.182302 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30692f0c-9848-49f7-ae35-5b03f587a257 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:51.182773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30692f0c-9848-49f7-ae35-5b03f587a257 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:51.183201 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30692f0c-9848-49f7-ae35-5b03f587a257 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:51.183896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30692f0c-9848-49f7-ae35-5b03f587a257 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:51.184338 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30692f0c-9848-49f7-ae35-5b03f587a257 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:51.184752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30692f0c-9848-49f7-ae35-5b03f587a257 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:51.257018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-05cf67fe-24e6-4e9a-b718-51eda2633689 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:51.257638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-05cf67fe-24e6-4e9a-b718-51eda2633689 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:51.261597 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=70 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:51.265667 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-05cf67fe-24e6-4e9a-b718-51eda2633689 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:51.266156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-05cf67fe-24e6-4e9a-b718-51eda2633689 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:51.267054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-05cf67fe-24e6-4e9a-b718-51eda2633689 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:51.267323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-05cf67fe-24e6-4e9a-b718-51eda2633689 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:51.267784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-05cf67fe-24e6-4e9a-b718-51eda2633689 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:51.268201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-05cf67fe-24e6-4e9a-b718-51eda2633689 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:51.318203 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-30692f0c-9848-49f7-ae35-5b03f587a257 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:51.328882 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-30692f0c-9848-49f7-ae35-5b03f587a257 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.158126 Aug 30 15:00:51.330979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 778/1560] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:51 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:51.398721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-05cf67fe-24e6-4e9a-b718-51eda2633689 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:51.406960 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-05cf67fe-24e6-4e9a-b718-51eda2633689 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153902 Aug 30 15:00:51.407571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 783/1561] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:51 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:51.609986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-35d10cc2-f75a-4fcd-93eb-314d6892675d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:51.610599 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-35d10cc2-f75a-4fcd-93eb-314d6892675d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:51.616591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35d10cc2-f75a-4fcd-93eb-314d6892675d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:51.617071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35d10cc2-f75a-4fcd-93eb-314d6892675d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:51.617504 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35d10cc2-f75a-4fcd-93eb-314d6892675d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:51.618195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35d10cc2-f75a-4fcd-93eb-314d6892675d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:51.619255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35d10cc2-f75a-4fcd-93eb-314d6892675d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:51.619710 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35d10cc2-f75a-4fcd-93eb-314d6892675d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:51.678960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-35d10cc2-f75a-4fcd-93eb-314d6892675d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:51.688054 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-35d10cc2-f75a-4fcd-93eb-314d6892675d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:51.689497 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-35d10cc2-f75a-4fcd-93eb-314d6892675d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:51.690634 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-35d10cc2-f75a-4fcd-93eb-314d6892675d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084673 Aug 30 15:00:51.691197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 779/1562] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:51 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:52.351700 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2ab4f75a-c988-4a2b-bc8d-832d7dd79c57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:52.352340 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2ab4f75a-c988-4a2b-bc8d-832d7dd79c57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:52.359284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ab4f75a-c988-4a2b-bc8d-832d7dd79c57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:52.359762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ab4f75a-c988-4a2b-bc8d-832d7dd79c57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:52.360191 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ab4f75a-c988-4a2b-bc8d-832d7dd79c57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:52.360869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ab4f75a-c988-4a2b-bc8d-832d7dd79c57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:52.361316 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ab4f75a-c988-4a2b-bc8d-832d7dd79c57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:52.361735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ab4f75a-c988-4a2b-bc8d-832d7dd79c57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:52.428210 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-61823da9-59db-4fcd-afdd-1d3f6ee9d7c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:52.429055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-61823da9-59db-4fcd-afdd-1d3f6ee9d7c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:52.435796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61823da9-59db-4fcd-afdd-1d3f6ee9d7c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:52.436276 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61823da9-59db-4fcd-afdd-1d3f6ee9d7c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:52.436702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61823da9-59db-4fcd-afdd-1d3f6ee9d7c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:52.437539 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61823da9-59db-4fcd-afdd-1d3f6ee9d7c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:52.437816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61823da9-59db-4fcd-afdd-1d3f6ee9d7c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:52.438262 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61823da9-59db-4fcd-afdd-1d3f6ee9d7c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:52.490933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2ab4f75a-c988-4a2b-bc8d-832d7dd79c57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:52.499638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2ab4f75a-c988-4a2b-bc8d-832d7dd79c57 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151689 Aug 30 15:00:52.500440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 784/1563] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:52 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:52.565254 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-61823da9-59db-4fcd-afdd-1d3f6ee9d7c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:52.574368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-61823da9-59db-4fcd-afdd-1d3f6ee9d7c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150064 Aug 30 15:00:52.574941 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 780/1564] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:52 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:52.715014 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bc7a7fdf-fbd4-45fc-acb0-016247f920e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:52.715659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bc7a7fdf-fbd4-45fc-acb0-016247f920e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:52.721629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc7a7fdf-fbd4-45fc-acb0-016247f920e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:52.722113 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc7a7fdf-fbd4-45fc-acb0-016247f920e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:52.722547 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc7a7fdf-fbd4-45fc-acb0-016247f920e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:52.723263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc7a7fdf-fbd4-45fc-acb0-016247f920e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:52.723719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc7a7fdf-fbd4-45fc-acb0-016247f920e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:52.724146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc7a7fdf-fbd4-45fc-acb0-016247f920e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:52.789526 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bc7a7fdf-fbd4-45fc-acb0-016247f920e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:52.798079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bc7a7fdf-fbd4-45fc-acb0-016247f920e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:52.799545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bc7a7fdf-fbd4-45fc-acb0-016247f920e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:52.800676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bc7a7fdf-fbd4-45fc-acb0-016247f920e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090280 Aug 30 15:00:52.801221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 785/1565] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:52 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:53.520739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-eeec9459-4dbc-4971-9ea4-c2e7c4f980eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:53.521346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-eeec9459-4dbc-4971-9ea4-c2e7c4f980eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:53.527982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eeec9459-4dbc-4971-9ea4-c2e7c4f980eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:53.528466 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eeec9459-4dbc-4971-9ea4-c2e7c4f980eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:53.528893 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eeec9459-4dbc-4971-9ea4-c2e7c4f980eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:53.529566 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eeec9459-4dbc-4971-9ea4-c2e7c4f980eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:53.530012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eeec9459-4dbc-4971-9ea4-c2e7c4f980eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:53.530423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eeec9459-4dbc-4971-9ea4-c2e7c4f980eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:53.595522 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3f8d42a2-11a9-42e8-bf81-a6d934389213 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:53.596169 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3f8d42a2-11a9-42e8-bf81-a6d934389213 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:53.602571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f8d42a2-11a9-42e8-bf81-a6d934389213 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:53.603720 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f8d42a2-11a9-42e8-bf81-a6d934389213 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:53.604166 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f8d42a2-11a9-42e8-bf81-a6d934389213 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:53.604876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f8d42a2-11a9-42e8-bf81-a6d934389213 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:53.605340 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f8d42a2-11a9-42e8-bf81-a6d934389213 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:53.605765 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f8d42a2-11a9-42e8-bf81-a6d934389213 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:53.663814 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-eeec9459-4dbc-4971-9ea4-c2e7c4f980eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:53.673010 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-eeec9459-4dbc-4971-9ea4-c2e7c4f980eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.156093 Aug 30 15:00:53.673666 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 781/1566] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:53 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:53.735028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3f8d42a2-11a9-42e8-bf81-a6d934389213 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:53.743198 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3f8d42a2-11a9-42e8-bf81-a6d934389213 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151617 Aug 30 15:00:53.743892 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 786/1567] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:53 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:53.822222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c32407ac-f596-4fcd-8bef-0159ad7f195a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:53.822831 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c32407ac-f596-4fcd-8bef-0159ad7f195a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:53.828653 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c32407ac-f596-4fcd-8bef-0159ad7f195a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:53.829131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c32407ac-f596-4fcd-8bef-0159ad7f195a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:53.829561 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c32407ac-f596-4fcd-8bef-0159ad7f195a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:53.830240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c32407ac-f596-4fcd-8bef-0159ad7f195a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:53.830688 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c32407ac-f596-4fcd-8bef-0159ad7f195a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:53.831105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c32407ac-f596-4fcd-8bef-0159ad7f195a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:53.894070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c32407ac-f596-4fcd-8bef-0159ad7f195a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:53.903060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c32407ac-f596-4fcd-8bef-0159ad7f195a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:53.904519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c32407ac-f596-4fcd-8bef-0159ad7f195a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:53.905658 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c32407ac-f596-4fcd-8bef-0159ad7f195a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087786 Aug 30 15:00:53.906228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 782/1568] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:53 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:54.693726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6d71adac-052e-4202-ad0c-ed063ec2d21d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:54.694332 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6d71adac-052e-4202-ad0c-ed063ec2d21d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:54.701605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d71adac-052e-4202-ad0c-ed063ec2d21d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:54.702076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d71adac-052e-4202-ad0c-ed063ec2d21d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:54.702500 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d71adac-052e-4202-ad0c-ed063ec2d21d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:54.703186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d71adac-052e-4202-ad0c-ed063ec2d21d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:54.703666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d71adac-052e-4202-ad0c-ed063ec2d21d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:54.704081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d71adac-052e-4202-ad0c-ed063ec2d21d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:54.763889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e8ee170c-e9ca-4f4f-bb5a-b4e0058efad1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:54.764506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e8ee170c-e9ca-4f4f-bb5a-b4e0058efad1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:54.770874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8ee170c-e9ca-4f4f-bb5a-b4e0058efad1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:54.771387 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8ee170c-e9ca-4f4f-bb5a-b4e0058efad1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:54.771832 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8ee170c-e9ca-4f4f-bb5a-b4e0058efad1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:54.772522 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8ee170c-e9ca-4f4f-bb5a-b4e0058efad1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:54.772973 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8ee170c-e9ca-4f4f-bb5a-b4e0058efad1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:54.773394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e8ee170c-e9ca-4f4f-bb5a-b4e0058efad1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:54.833669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6d71adac-052e-4202-ad0c-ed063ec2d21d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:54.843007 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6d71adac-052e-4202-ad0c-ed063ec2d21d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153141 Aug 30 15:00:54.843620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 787/1569] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:54 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:54.904975 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e8ee170c-e9ca-4f4f-bb5a-b4e0058efad1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:54.913110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e8ee170c-e9ca-4f4f-bb5a-b4e0058efad1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153069 Aug 30 15:00:54.913672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 783/1570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:54 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:54.928787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0583d6b4-b060-4d45-a250-0a3d2fca1bc7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:54.929422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0583d6b4-b060-4d45-a250-0a3d2fca1bc7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:54.936124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0583d6b4-b060-4d45-a250-0a3d2fca1bc7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:54.936595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0583d6b4-b060-4d45-a250-0a3d2fca1bc7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:54.937024 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0583d6b4-b060-4d45-a250-0a3d2fca1bc7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:54.938418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0583d6b4-b060-4d45-a250-0a3d2fca1bc7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:54.938864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0583d6b4-b060-4d45-a250-0a3d2fca1bc7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:54.939338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0583d6b4-b060-4d45-a250-0a3d2fca1bc7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:55.003628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0583d6b4-b060-4d45-a250-0a3d2fca1bc7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:55.012719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0583d6b4-b060-4d45-a250-0a3d2fca1bc7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:55.014209 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0583d6b4-b060-4d45-a250-0a3d2fca1bc7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:55.015431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0583d6b4-b060-4d45-a250-0a3d2fca1bc7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090681 Aug 30 15:00:55.016021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 788/1571] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:54 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:55.864426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-51ccb398-c2db-41b8-9b5c-1a04b57fa622 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:55.865038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-51ccb398-c2db-41b8-9b5c-1a04b57fa622 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:55.872011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-51ccb398-c2db-41b8-9b5c-1a04b57fa622 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:55.872492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-51ccb398-c2db-41b8-9b5c-1a04b57fa622 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:55.872926 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-51ccb398-c2db-41b8-9b5c-1a04b57fa622 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:55.873616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-51ccb398-c2db-41b8-9b5c-1a04b57fa622 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:55.874066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-51ccb398-c2db-41b8-9b5c-1a04b57fa622 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:55.874497 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-51ccb398-c2db-41b8-9b5c-1a04b57fa622 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:55.936079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-46b3da7e-3db3-49cc-92ff-7fbd0328d68f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:55.936677 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-46b3da7e-3db3-49cc-92ff-7fbd0328d68f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:55.943298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46b3da7e-3db3-49cc-92ff-7fbd0328d68f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:55.943777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46b3da7e-3db3-49cc-92ff-7fbd0328d68f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:55.944204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46b3da7e-3db3-49cc-92ff-7fbd0328d68f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:55.944895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46b3da7e-3db3-49cc-92ff-7fbd0328d68f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:55.945341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46b3da7e-3db3-49cc-92ff-7fbd0328d68f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:55.945755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46b3da7e-3db3-49cc-92ff-7fbd0328d68f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:56.005159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-51ccb398-c2db-41b8-9b5c-1a04b57fa622 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:56.014102 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-51ccb398-c2db-41b8-9b5c-1a04b57fa622 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153564 Aug 30 15:00:56.014881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 784/1572] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:55 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:56.038255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-46f0f17d-4f47-449a-94a4-a48977869039 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:56.038866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-46f0f17d-4f47-449a-94a4-a48977869039 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:56.044905 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46f0f17d-4f47-449a-94a4-a48977869039 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:56.045390 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46f0f17d-4f47-449a-94a4-a48977869039 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:56.045821 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46f0f17d-4f47-449a-94a4-a48977869039 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:56.046516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46f0f17d-4f47-449a-94a4-a48977869039 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:56.046963 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46f0f17d-4f47-449a-94a4-a48977869039 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:56.047405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46f0f17d-4f47-449a-94a4-a48977869039 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:56.079735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-46b3da7e-3db3-49cc-92ff-7fbd0328d68f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:56.089173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-46b3da7e-3db3-49cc-92ff-7fbd0328d68f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.159133 Aug 30 15:00:56.089756 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 789/1573] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:55 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:56.108462 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-46f0f17d-4f47-449a-94a4-a48977869039 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:56.116920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-46f0f17d-4f47-449a-94a4-a48977869039 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:56.118826 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-46f0f17d-4f47-449a-94a4-a48977869039 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:56.120007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-46f0f17d-4f47-449a-94a4-a48977869039 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085670 Aug 30 15:00:56.120559 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 785/1574] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:56 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:00:57.034840 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-81b90c51-1d59-46cb-b270-5901839c670a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:57.035455 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-81b90c51-1d59-46cb-b270-5901839c670a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:57.041867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81b90c51-1d59-46cb-b270-5901839c670a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:57.042343 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81b90c51-1d59-46cb-b270-5901839c670a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:57.042773 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81b90c51-1d59-46cb-b270-5901839c670a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:57.043493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81b90c51-1d59-46cb-b270-5901839c670a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:57.043948 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81b90c51-1d59-46cb-b270-5901839c670a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:57.044369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81b90c51-1d59-46cb-b270-5901839c670a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:57.110448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-40a1f181-00e5-42a7-8d39-ff942d824234 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:57.111106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-40a1f181-00e5-42a7-8d39-ff942d824234 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:57.117626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40a1f181-00e5-42a7-8d39-ff942d824234 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:57.118103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40a1f181-00e5-42a7-8d39-ff942d824234 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:57.118559 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40a1f181-00e5-42a7-8d39-ff942d824234 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:57.119377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40a1f181-00e5-42a7-8d39-ff942d824234 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:57.119834 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40a1f181-00e5-42a7-8d39-ff942d824234 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:57.120255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40a1f181-00e5-42a7-8d39-ff942d824234 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:57.172578 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-81b90c51-1d59-46cb-b270-5901839c670a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:57.180861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-81b90c51-1d59-46cb-b270-5901839c670a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149801 Aug 30 15:00:57.181452 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 790/1575] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:57 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:57.186022 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fa984f94-e0ce-482f-8b12-5d4e9d2b83f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:57.186715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fa984f94-e0ce-482f-8b12-5d4e9d2b83f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:57.192558 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa984f94-e0ce-482f-8b12-5d4e9d2b83f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:57.193053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa984f94-e0ce-482f-8b12-5d4e9d2b83f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:57.193473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa984f94-e0ce-482f-8b12-5d4e9d2b83f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:57.194240 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa984f94-e0ce-482f-8b12-5d4e9d2b83f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:57.194699 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa984f94-e0ce-482f-8b12-5d4e9d2b83f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:57.195123 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa984f94-e0ce-482f-8b12-5d4e9d2b83f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:57.255907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-40a1f181-00e5-42a7-8d39-ff942d824234 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:57.262939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fa984f94-e0ce-482f-8b12-5d4e9d2b83f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:57.265434 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-40a1f181-00e5-42a7-8d39-ff942d824234 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.159309 Aug 30 15:00:57.266197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 786/1576] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:57 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:57.271604 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fa984f94-e0ce-482f-8b12-5d4e9d2b83f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:57.273055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fa984f94-e0ce-482f-8b12-5d4e9d2b83f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:57.274193 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fa984f94-e0ce-482f-8b12-5d4e9d2b83f5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091827 Aug 30 15:00:57.275356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 791/1577] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:57 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:58.202047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4abd832b-436c-483a-b982-60149465ac09 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:58.202669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4abd832b-436c-483a-b982-60149465ac09 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:58.209112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4abd832b-436c-483a-b982-60149465ac09 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:58.209598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4abd832b-436c-483a-b982-60149465ac09 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:58.210034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4abd832b-436c-483a-b982-60149465ac09 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:58.210728 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4abd832b-436c-483a-b982-60149465ac09 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:58.211185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4abd832b-436c-483a-b982-60149465ac09 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:58.212710 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4abd832b-436c-483a-b982-60149465ac09 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:58.287123 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d8ef0cff-512f-410f-b6e4-6c95d1924436 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:58.287890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d8ef0cff-512f-410f-b6e4-6c95d1924436 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:58.295340 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8ef0cff-512f-410f-b6e4-6c95d1924436 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:58.295819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8ef0cff-512f-410f-b6e4-6c95d1924436 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:58.296248 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8ef0cff-512f-410f-b6e4-6c95d1924436 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:58.296940 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8ef0cff-512f-410f-b6e4-6c95d1924436 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:58.297386 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8ef0cff-512f-410f-b6e4-6c95d1924436 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:58.297800 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d8ef0cff-512f-410f-b6e4-6c95d1924436 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:58.347393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4abd832b-436c-483a-b982-60149465ac09 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:58.356985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4abd832b-436c-483a-b982-60149465ac09 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.158810 Aug 30 15:00:58.357619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 787/1578] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:58 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:58.362310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3240b0b4-83f2-4dda-b15d-3933e7891868 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:58.362910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3240b0b4-83f2-4dda-b15d-3933e7891868 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:58.369289 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3240b0b4-83f2-4dda-b15d-3933e7891868 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:58.369776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3240b0b4-83f2-4dda-b15d-3933e7891868 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:58.370207 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3240b0b4-83f2-4dda-b15d-3933e7891868 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:58.370895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3240b0b4-83f2-4dda-b15d-3933e7891868 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:58.371363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3240b0b4-83f2-4dda-b15d-3933e7891868 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:58.371781 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3240b0b4-83f2-4dda-b15d-3933e7891868 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:58.376108 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:58.428001 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d8ef0cff-512f-410f-b6e4-6c95d1924436 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:58.434594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3240b0b4-83f2-4dda-b15d-3933e7891868 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:58.436246 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d8ef0cff-512f-410f-b6e4-6c95d1924436 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152897 Aug 30 15:00:58.437008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 792/1579] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:58 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:58.443694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3240b0b4-83f2-4dda-b15d-3933e7891868 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:58.445176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3240b0b4-83f2-4dda-b15d-3933e7891868 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:58.447296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3240b0b4-83f2-4dda-b15d-3933e7891868 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087808 Aug 30 15:00:58.447971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 788/1580] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:58 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:00:59.377780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8e22df0e-9e15-499d-bc0e-2526c7bcfb88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:59.378412 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8e22df0e-9e15-499d-bc0e-2526c7bcfb88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:59.384795 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8e22df0e-9e15-499d-bc0e-2526c7bcfb88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:59.385271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8e22df0e-9e15-499d-bc0e-2526c7bcfb88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:59.385702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8e22df0e-9e15-499d-bc0e-2526c7bcfb88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:59.386392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8e22df0e-9e15-499d-bc0e-2526c7bcfb88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:59.386841 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8e22df0e-9e15-499d-bc0e-2526c7bcfb88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:59.387289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8e22df0e-9e15-499d-bc0e-2526c7bcfb88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:59.458144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4204acb9-89ce-40a8-800e-42e03cf76242 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:59.458758 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4204acb9-89ce-40a8-800e-42e03cf76242 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:59.465772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4204acb9-89ce-40a8-800e-42e03cf76242 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:59.466862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4204acb9-89ce-40a8-800e-42e03cf76242 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:59.467334 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4204acb9-89ce-40a8-800e-42e03cf76242 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:59.468040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4204acb9-89ce-40a8-800e-42e03cf76242 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:59.468492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4204acb9-89ce-40a8-800e-42e03cf76242 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:59.468916 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4204acb9-89ce-40a8-800e-42e03cf76242 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:59.514747 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8e22df0e-9e15-499d-bc0e-2526c7bcfb88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:59.522884 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8e22df0e-9e15-499d-bc0e-2526c7bcfb88 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149036 Aug 30 15:00:59.523478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 793/1581] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:59 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:00:59.527891 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f74ac093-5f3b-40fb-bebe-13d1686a3fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:00:59.528489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f74ac093-5f3b-40fb-bebe-13d1686a3fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:00:59.534204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f74ac093-5f3b-40fb-bebe-13d1686a3fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:59.534680 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f74ac093-5f3b-40fb-bebe-13d1686a3fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:59.535103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f74ac093-5f3b-40fb-bebe-13d1686a3fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:59.535817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f74ac093-5f3b-40fb-bebe-13d1686a3fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:00:59.536267 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f74ac093-5f3b-40fb-bebe-13d1686a3fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:00:59.536679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f74ac093-5f3b-40fb-bebe-13d1686a3fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:00:59.555170 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:00:59.604293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f74ac093-5f3b-40fb-bebe-13d1686a3fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:59.605497 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4204acb9-89ce-40a8-800e-42e03cf76242 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:59.612995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f74ac093-5f3b-40fb-bebe-13d1686a3fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:59.613714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4204acb9-89ce-40a8-800e-42e03cf76242 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.159604 Aug 30 15:00:59.614285 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 789/1582] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:00:59 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:00:59.614410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f74ac093-5f3b-40fb-bebe-13d1686a3fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:00:59.615579 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f74ac093-5f3b-40fb-bebe-13d1686a3fa0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091169 Aug 30 15:00:59.616125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 794/1583] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:00:59 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:00.543753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c17189ef-a791-4175-b76d-179a3e3df6c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:00.544280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c17189ef-a791-4175-b76d-179a3e3df6c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:00.550577 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c17189ef-a791-4175-b76d-179a3e3df6c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:00.551050 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c17189ef-a791-4175-b76d-179a3e3df6c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:00.551526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c17189ef-a791-4175-b76d-179a3e3df6c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:00.552210 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c17189ef-a791-4175-b76d-179a3e3df6c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:00.552680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c17189ef-a791-4175-b76d-179a3e3df6c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:00.553096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c17189ef-a791-4175-b76d-179a3e3df6c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:00.634984 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9b8a2386-3295-49ff-a3e8-77c649c57518 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:00.635619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9b8a2386-3295-49ff-a3e8-77c649c57518 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:00.642174 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b8a2386-3295-49ff-a3e8-77c649c57518 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:00.642685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b8a2386-3295-49ff-a3e8-77c649c57518 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:00.643115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b8a2386-3295-49ff-a3e8-77c649c57518 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:00.643838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b8a2386-3295-49ff-a3e8-77c649c57518 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:00.644283 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b8a2386-3295-49ff-a3e8-77c649c57518 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:00.644700 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b8a2386-3295-49ff-a3e8-77c649c57518 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:00.680225 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c17189ef-a791-4175-b76d-179a3e3df6c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:00.689195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c17189ef-a791-4175-b76d-179a3e3df6c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149642 Aug 30 15:01:00.690072 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 790/1584] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:00 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:00.694457 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-57ba5a6c-4d9a-4b74-8bae-de4006d1d25c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:00.695122 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-57ba5a6c-4d9a-4b74-8bae-de4006d1d25c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:00.701869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57ba5a6c-4d9a-4b74-8bae-de4006d1d25c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:00.702423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57ba5a6c-4d9a-4b74-8bae-de4006d1d25c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:00.702948 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57ba5a6c-4d9a-4b74-8bae-de4006d1d25c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:00.703713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57ba5a6c-4d9a-4b74-8bae-de4006d1d25c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:00.704161 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57ba5a6c-4d9a-4b74-8bae-de4006d1d25c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:00.704578 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57ba5a6c-4d9a-4b74-8bae-de4006d1d25c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:00.765092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-57ba5a6c-4d9a-4b74-8bae-de4006d1d25c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:00.773710 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-57ba5a6c-4d9a-4b74-8bae-de4006d1d25c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:00.775254 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-57ba5a6c-4d9a-4b74-8bae-de4006d1d25c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:00.776401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-57ba5a6c-4d9a-4b74-8bae-de4006d1d25c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085576 Aug 30 15:01:00.776959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 791/1585] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:00 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:00.780801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9b8a2386-3295-49ff-a3e8-77c649c57518 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:00.789146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9b8a2386-3295-49ff-a3e8-77c649c57518 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.158547 Aug 30 15:01:00.789728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 795/1586] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:00 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:01.711505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9e227d53-ec90-4eb3-81c7-41e750e59cd3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:01.713121 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9e227d53-ec90-4eb3-81c7-41e750e59cd3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:01.719145 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e227d53-ec90-4eb3-81c7-41e750e59cd3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:01.719651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e227d53-ec90-4eb3-81c7-41e750e59cd3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:01.720084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e227d53-ec90-4eb3-81c7-41e750e59cd3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:01.720761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e227d53-ec90-4eb3-81c7-41e750e59cd3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:01.721207 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e227d53-ec90-4eb3-81c7-41e750e59cd3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:01.721625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e227d53-ec90-4eb3-81c7-41e750e59cd3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:01.799780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a0554e4c-120b-4cf5-a8d7-3d168407ce16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:01.800349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a0554e4c-120b-4cf5-a8d7-3d168407ce16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:01.806787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0554e4c-120b-4cf5-a8d7-3d168407ce16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:01.807298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0554e4c-120b-4cf5-a8d7-3d168407ce16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:01.807737 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0554e4c-120b-4cf5-a8d7-3d168407ce16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:01.808433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0554e4c-120b-4cf5-a8d7-3d168407ce16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:01.808885 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0554e4c-120b-4cf5-a8d7-3d168407ce16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:01.809303 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0554e4c-120b-4cf5-a8d7-3d168407ce16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:01.852816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9e227d53-ec90-4eb3-81c7-41e750e59cd3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:01.861078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9e227d53-ec90-4eb3-81c7-41e750e59cd3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153520 Aug 30 15:01:01.861759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 792/1587] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:01 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:01.866973 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-45b884b2-94de-41db-845d-d1c0aa0723d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:01.867782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-45b884b2-94de-41db-845d-d1c0aa0723d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:01.873755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a0554e4c-120b-4cf5-a8d7-3d168407ce16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:01.874387 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45b884b2-94de-41db-845d-d1c0aa0723d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:01.874865 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45b884b2-94de-41db-845d-d1c0aa0723d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:01.875314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45b884b2-94de-41db-845d-d1c0aa0723d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:01.876005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45b884b2-94de-41db-845d-d1c0aa0723d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:01.876447 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45b884b2-94de-41db-845d-d1c0aa0723d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:01.876858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45b884b2-94de-41db-845d-d1c0aa0723d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:01.882386 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a0554e4c-120b-4cf5-a8d7-3d168407ce16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:01.884055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a0554e4c-120b-4cf5-a8d7-3d168407ce16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:01.885627 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a0554e4c-120b-4cf5-a8d7-3d168407ce16 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090066 Aug 30 15:01:01.886173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 796/1588] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:01 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:01:02.001754 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45b884b2-94de-41db-845d-d1c0aa0723d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:02.010345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-45b884b2-94de-41db-845d-d1c0aa0723d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147587 Aug 30 15:01:02.010906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 793/1589] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:01 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:02.882321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-00fa6da4-5eeb-4dd0-9947-b02eccbdd773 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:02.882924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-00fa6da4-5eeb-4dd0-9947-b02eccbdd773 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:02.889562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00fa6da4-5eeb-4dd0-9947-b02eccbdd773 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:02.890036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00fa6da4-5eeb-4dd0-9947-b02eccbdd773 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:02.890467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00fa6da4-5eeb-4dd0-9947-b02eccbdd773 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:02.891153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00fa6da4-5eeb-4dd0-9947-b02eccbdd773 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:02.891628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00fa6da4-5eeb-4dd0-9947-b02eccbdd773 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:02.892044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00fa6da4-5eeb-4dd0-9947-b02eccbdd773 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:02.908485 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f644184a-7fdc-4ce8-8026-390bbf3f81b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:02.909093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f644184a-7fdc-4ce8-8026-390bbf3f81b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:02.915399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f644184a-7fdc-4ce8-8026-390bbf3f81b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:02.915881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f644184a-7fdc-4ce8-8026-390bbf3f81b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:02.916311 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f644184a-7fdc-4ce8-8026-390bbf3f81b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:02.917003 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f644184a-7fdc-4ce8-8026-390bbf3f81b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:02.918019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f644184a-7fdc-4ce8-8026-390bbf3f81b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:02.918627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f644184a-7fdc-4ce8-8026-390bbf3f81b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:02.982011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f644184a-7fdc-4ce8-8026-390bbf3f81b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:02.990780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f644184a-7fdc-4ce8-8026-390bbf3f81b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:02.992251 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f644184a-7fdc-4ce8-8026-390bbf3f81b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:02.993395 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f644184a-7fdc-4ce8-8026-390bbf3f81b3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088832 Aug 30 15:01:02.993953 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 794/1590] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:02 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:01:03.031343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8115f8c4-f0b6-486c-bd7d-b34c844078a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:03.031953 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8115f8c4-f0b6-486c-bd7d-b34c844078a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:03.037096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-00fa6da4-5eeb-4dd0-9947-b02eccbdd773 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:03.037951 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8115f8c4-f0b6-486c-bd7d-b34c844078a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:03.038427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8115f8c4-f0b6-486c-bd7d-b34c844078a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:03.038857 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8115f8c4-f0b6-486c-bd7d-b34c844078a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:03.039669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8115f8c4-f0b6-486c-bd7d-b34c844078a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:03.040112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8115f8c4-f0b6-486c-bd7d-b34c844078a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:03.040528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8115f8c4-f0b6-486c-bd7d-b34c844078a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:03.045482 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-00fa6da4-5eeb-4dd0-9947-b02eccbdd773 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.167033 Aug 30 15:01:03.046079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 797/1591] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:02 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:03.169949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8115f8c4-f0b6-486c-bd7d-b34c844078a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:03.178111 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8115f8c4-f0b6-486c-bd7d-b34c844078a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150591 Aug 30 15:01:03.178686 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 795/1592] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:03 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:04.016443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8f16bfaa-14ff-42a3-a691-2907dbbaa043 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:04.017046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8f16bfaa-14ff-42a3-a691-2907dbbaa043 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:04.023489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f16bfaa-14ff-42a3-a691-2907dbbaa043 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:04.023970 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f16bfaa-14ff-42a3-a691-2907dbbaa043 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:04.024402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f16bfaa-14ff-42a3-a691-2907dbbaa043 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:04.025087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f16bfaa-14ff-42a3-a691-2907dbbaa043 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:04.025535 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f16bfaa-14ff-42a3-a691-2907dbbaa043 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:04.025954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f16bfaa-14ff-42a3-a691-2907dbbaa043 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:04.065906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6757beb4-0728-4910-a24a-14296078b9da tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:04.066703 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6757beb4-0728-4910-a24a-14296078b9da tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:04.073310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6757beb4-0728-4910-a24a-14296078b9da tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:04.073814 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6757beb4-0728-4910-a24a-14296078b9da tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:04.074241 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6757beb4-0728-4910-a24a-14296078b9da tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:04.074929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6757beb4-0728-4910-a24a-14296078b9da tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:04.075413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6757beb4-0728-4910-a24a-14296078b9da tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:04.075833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6757beb4-0728-4910-a24a-14296078b9da tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:04.087799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8f16bfaa-14ff-42a3-a691-2907dbbaa043 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:04.096923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8f16bfaa-14ff-42a3-a691-2907dbbaa043 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:04.098372 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8f16bfaa-14ff-42a3-a691-2907dbbaa043 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:04.099528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8f16bfaa-14ff-42a3-a691-2907dbbaa043 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087023 Aug 30 15:01:04.100096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 798/1593] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:04 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:04.198914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-49dfd34d-158a-4058-b159-5a6b4bfc2164 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:04.199572 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-49dfd34d-158a-4058-b159-5a6b4bfc2164 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:04.203146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6757beb4-0728-4910-a24a-14296078b9da tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:04.205488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-49dfd34d-158a-4058-b159-5a6b4bfc2164 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:04.205969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-49dfd34d-158a-4058-b159-5a6b4bfc2164 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:04.206407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-49dfd34d-158a-4058-b159-5a6b4bfc2164 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:04.207100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-49dfd34d-158a-4058-b159-5a6b4bfc2164 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:04.207571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-49dfd34d-158a-4058-b159-5a6b4bfc2164 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:04.207989 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-49dfd34d-158a-4058-b159-5a6b4bfc2164 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:04.211541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6757beb4-0728-4910-a24a-14296078b9da tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149388 Aug 30 15:01:04.212353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 796/1594] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:04 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:04.336758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-49dfd34d-158a-4058-b159-5a6b4bfc2164 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:04.345354 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-49dfd34d-158a-4058-b159-5a6b4bfc2164 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150699 Aug 30 15:01:04.345910 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 799/1595] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:04 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:05.123886 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8f2f3de7-1348-4ba3-8030-e11121d63ba3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:05.124514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8f2f3de7-1348-4ba3-8030-e11121d63ba3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:05.130929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f2f3de7-1348-4ba3-8030-e11121d63ba3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:05.131440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f2f3de7-1348-4ba3-8030-e11121d63ba3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:05.131876 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f2f3de7-1348-4ba3-8030-e11121d63ba3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:05.132557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f2f3de7-1348-4ba3-8030-e11121d63ba3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:05.133005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f2f3de7-1348-4ba3-8030-e11121d63ba3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:05.133424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f2f3de7-1348-4ba3-8030-e11121d63ba3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:05.200393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8f2f3de7-1348-4ba3-8030-e11121d63ba3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:05.208878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8f2f3de7-1348-4ba3-8030-e11121d63ba3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:05.210320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8f2f3de7-1348-4ba3-8030-e11121d63ba3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:05.211490 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8f2f3de7-1348-4ba3-8030-e11121d63ba3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.092288 Aug 30 15:01:05.212047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 797/1596] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:05 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:05.233182 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0c2f1413-2093-4f67-be40-b6ab47666ffa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:05.233796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0c2f1413-2093-4f67-be40-b6ab47666ffa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:05.240367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c2f1413-2093-4f67-be40-b6ab47666ffa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:05.240849 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c2f1413-2093-4f67-be40-b6ab47666ffa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:05.241286 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c2f1413-2093-4f67-be40-b6ab47666ffa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:05.241977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c2f1413-2093-4f67-be40-b6ab47666ffa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:05.242430 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c2f1413-2093-4f67-be40-b6ab47666ffa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:05.242854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c2f1413-2093-4f67-be40-b6ab47666ffa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:05.365938 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1e528aa8-749e-48fd-871c-e167ed1ba8ac tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:05.366664 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1e528aa8-749e-48fd-871c-e167ed1ba8ac tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:05.373285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0c2f1413-2093-4f67-be40-b6ab47666ffa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:05.373452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e528aa8-749e-48fd-871c-e167ed1ba8ac tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:05.373982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e528aa8-749e-48fd-871c-e167ed1ba8ac tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:05.374361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e528aa8-749e-48fd-871c-e167ed1ba8ac tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:05.375057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e528aa8-749e-48fd-871c-e167ed1ba8ac tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:05.375544 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e528aa8-749e-48fd-871c-e167ed1ba8ac tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:05.375962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e528aa8-749e-48fd-871c-e167ed1ba8ac tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:05.381420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0c2f1413-2093-4f67-be40-b6ab47666ffa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152652 Aug 30 15:01:05.381992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 800/1597] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:05 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:05.502461 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1e528aa8-749e-48fd-871c-e167ed1ba8ac tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:05.511017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1e528aa8-749e-48fd-871c-e167ed1ba8ac tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148713 Aug 30 15:01:05.511774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 798/1598] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:05 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:06.234026 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ba8cb2f1-beb6-4f8e-b2be-1f13499ed72a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:06.234636 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ba8cb2f1-beb6-4f8e-b2be-1f13499ed72a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:06.241136 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba8cb2f1-beb6-4f8e-b2be-1f13499ed72a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:06.241611 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba8cb2f1-beb6-4f8e-b2be-1f13499ed72a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:06.242043 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba8cb2f1-beb6-4f8e-b2be-1f13499ed72a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:06.242728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba8cb2f1-beb6-4f8e-b2be-1f13499ed72a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:06.243176 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba8cb2f1-beb6-4f8e-b2be-1f13499ed72a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:06.243619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ba8cb2f1-beb6-4f8e-b2be-1f13499ed72a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:06.304562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ba8cb2f1-beb6-4f8e-b2be-1f13499ed72a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:06.314190 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ba8cb2f1-beb6-4f8e-b2be-1f13499ed72a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:06.315662 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ba8cb2f1-beb6-4f8e-b2be-1f13499ed72a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:06.316791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ba8cb2f1-beb6-4f8e-b2be-1f13499ed72a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086777 Aug 30 15:01:06.317423 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 801/1599] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:06 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:06.402197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b1c5fb43-385f-4d03-a438-e1b11a93ecb4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:06.402794 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b1c5fb43-385f-4d03-a438-e1b11a93ecb4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:06.409162 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1c5fb43-385f-4d03-a438-e1b11a93ecb4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:06.409633 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1c5fb43-385f-4d03-a438-e1b11a93ecb4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:06.410059 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1c5fb43-385f-4d03-a438-e1b11a93ecb4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:06.410734 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1c5fb43-385f-4d03-a438-e1b11a93ecb4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:06.411177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1c5fb43-385f-4d03-a438-e1b11a93ecb4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:06.411620 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1c5fb43-385f-4d03-a438-e1b11a93ecb4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:06.532382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-be4e4bf3-468d-49cf-9fb4-0d5539ea5e29 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:06.533017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-be4e4bf3-468d-49cf-9fb4-0d5539ea5e29 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:06.537150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b1c5fb43-385f-4d03-a438-e1b11a93ecb4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:06.538876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be4e4bf3-468d-49cf-9fb4-0d5539ea5e29 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:06.539413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be4e4bf3-468d-49cf-9fb4-0d5539ea5e29 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:06.539853 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be4e4bf3-468d-49cf-9fb4-0d5539ea5e29 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:06.540554 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be4e4bf3-468d-49cf-9fb4-0d5539ea5e29 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:06.541051 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be4e4bf3-468d-49cf-9fb4-0d5539ea5e29 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:06.541473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-be4e4bf3-468d-49cf-9fb4-0d5539ea5e29 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:06.545528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b1c5fb43-385f-4d03-a438-e1b11a93ecb4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147129 Aug 30 15:01:06.546105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 799/1600] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:06 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:06.668795 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-be4e4bf3-468d-49cf-9fb4-0d5539ea5e29 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:06.677017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-be4e4bf3-468d-49cf-9fb4-0d5539ea5e29 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148496 Aug 30 15:01:06.677580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 802/1601] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:06 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:07.341130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1f493858-9f7d-46a1-a9b3-5a57d098c8a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:07.341741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1f493858-9f7d-46a1-a9b3-5a57d098c8a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:07.347714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1f493858-9f7d-46a1-a9b3-5a57d098c8a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:07.348192 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1f493858-9f7d-46a1-a9b3-5a57d098c8a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:07.348628 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1f493858-9f7d-46a1-a9b3-5a57d098c8a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:07.349312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1f493858-9f7d-46a1-a9b3-5a57d098c8a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:07.349758 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1f493858-9f7d-46a1-a9b3-5a57d098c8a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:07.350177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1f493858-9f7d-46a1-a9b3-5a57d098c8a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:07.412232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1f493858-9f7d-46a1-a9b3-5a57d098c8a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:07.421450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1f493858-9f7d-46a1-a9b3-5a57d098c8a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:07.422883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1f493858-9f7d-46a1-a9b3-5a57d098c8a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:07.424054 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1f493858-9f7d-46a1-a9b3-5a57d098c8a5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087514 Aug 30 15:01:07.424614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 800/1602] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:07 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:07.566008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5a0d68a2-8fea-4332-99fd-fca61267e45f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:07.566618 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5a0d68a2-8fea-4332-99fd-fca61267e45f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:07.573863 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a0d68a2-8fea-4332-99fd-fca61267e45f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:07.574433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a0d68a2-8fea-4332-99fd-fca61267e45f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:07.574865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a0d68a2-8fea-4332-99fd-fca61267e45f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:07.575579 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a0d68a2-8fea-4332-99fd-fca61267e45f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:07.576027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a0d68a2-8fea-4332-99fd-fca61267e45f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:07.576442 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a0d68a2-8fea-4332-99fd-fca61267e45f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:07.698706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6f1e7607-e252-44e6-878a-9d270648b2ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:07.699352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6f1e7607-e252-44e6-878a-9d270648b2ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:07.705184 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f1e7607-e252-44e6-878a-9d270648b2ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:07.705661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f1e7607-e252-44e6-878a-9d270648b2ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:07.706090 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f1e7607-e252-44e6-878a-9d270648b2ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:07.706779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f1e7607-e252-44e6-878a-9d270648b2ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:07.707230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5a0d68a2-8fea-4332-99fd-fca61267e45f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:07.707375 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f1e7607-e252-44e6-878a-9d270648b2ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:07.707654 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f1e7607-e252-44e6-878a-9d270648b2ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:07.716172 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5a0d68a2-8fea-4332-99fd-fca61267e45f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153957 Aug 30 15:01:07.716748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 803/1603] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:07 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:07.834864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6f1e7607-e252-44e6-878a-9d270648b2ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:07.843126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6f1e7607-e252-44e6-878a-9d270648b2ee tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149106 Aug 30 15:01:07.843871 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 801/1604] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:07 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:08.447015 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8f1a4b40-725d-4dab-b2fc-ce8ea3d00aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:08.447645 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8f1a4b40-725d-4dab-b2fc-ce8ea3d00aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:08.453631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f1a4b40-725d-4dab-b2fc-ce8ea3d00aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:08.454108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f1a4b40-725d-4dab-b2fc-ce8ea3d00aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:08.454543 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f1a4b40-725d-4dab-b2fc-ce8ea3d00aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:08.455243 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f1a4b40-725d-4dab-b2fc-ce8ea3d00aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:08.455698 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f1a4b40-725d-4dab-b2fc-ce8ea3d00aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:08.456123 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f1a4b40-725d-4dab-b2fc-ce8ea3d00aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:08.515774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8f1a4b40-725d-4dab-b2fc-ce8ea3d00aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:08.524172 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8f1a4b40-725d-4dab-b2fc-ce8ea3d00aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:08.525609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8f1a4b40-725d-4dab-b2fc-ce8ea3d00aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:08.526783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8f1a4b40-725d-4dab-b2fc-ce8ea3d00aba tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.083965 Aug 30 15:01:08.527361 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 804/1605] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:08 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:08.737645 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d2fa8a31-e14e-4a54-a379-04ba178afa3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:08.738244 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d2fa8a31-e14e-4a54-a379-04ba178afa3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:08.744597 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2fa8a31-e14e-4a54-a379-04ba178afa3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:08.745077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2fa8a31-e14e-4a54-a379-04ba178afa3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:08.745499 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2fa8a31-e14e-4a54-a379-04ba178afa3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:08.746171 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2fa8a31-e14e-4a54-a379-04ba178afa3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:08.746611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2fa8a31-e14e-4a54-a379-04ba178afa3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:08.747024 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2fa8a31-e14e-4a54-a379-04ba178afa3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:08.864716 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b327c8c3-f155-45a0-84ed-af405c46d4da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:08.865313 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b327c8c3-f155-45a0-84ed-af405c46d4da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:08.871761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b327c8c3-f155-45a0-84ed-af405c46d4da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:08.872244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b327c8c3-f155-45a0-84ed-af405c46d4da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:08.872675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b327c8c3-f155-45a0-84ed-af405c46d4da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:08.873376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b327c8c3-f155-45a0-84ed-af405c46d4da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:08.873809 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b327c8c3-f155-45a0-84ed-af405c46d4da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:08.874237 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b327c8c3-f155-45a0-84ed-af405c46d4da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:08.876389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d2fa8a31-e14e-4a54-a379-04ba178afa3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:08.884476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d2fa8a31-e14e-4a54-a379-04ba178afa3d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150606 Aug 30 15:01:08.885300 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 802/1606] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:08 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:09.004714 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b327c8c3-f155-45a0-84ed-af405c46d4da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:09.013352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b327c8c3-f155-45a0-84ed-af405c46d4da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152596 Aug 30 15:01:09.013914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 805/1607] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:08 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:09.549117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-caddc893-4a26-4682-aef1-655ec57bff68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:09.549670 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-caddc893-4a26-4682-aef1-655ec57bff68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:09.555597 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-caddc893-4a26-4682-aef1-655ec57bff68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:09.556069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-caddc893-4a26-4682-aef1-655ec57bff68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:09.556496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-caddc893-4a26-4682-aef1-655ec57bff68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:09.557671 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-caddc893-4a26-4682-aef1-655ec57bff68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:09.558110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-caddc893-4a26-4682-aef1-655ec57bff68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:09.558642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-caddc893-4a26-4682-aef1-655ec57bff68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:09.622450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-caddc893-4a26-4682-aef1-655ec57bff68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:09.632272 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-caddc893-4a26-4682-aef1-655ec57bff68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:09.633784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-caddc893-4a26-4682-aef1-655ec57bff68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:09.637006 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-caddc893-4a26-4682-aef1-655ec57bff68 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091292 Aug 30 15:01:09.637569 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 803/1608] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:09 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:09.905765 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-968c3efc-49a2-41d8-9607-af017cb9a0a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:09.906382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-968c3efc-49a2-41d8-9607-af017cb9a0a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:09.912788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-968c3efc-49a2-41d8-9607-af017cb9a0a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:09.913263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-968c3efc-49a2-41d8-9607-af017cb9a0a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:09.913695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-968c3efc-49a2-41d8-9607-af017cb9a0a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:09.914375 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-968c3efc-49a2-41d8-9607-af017cb9a0a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:09.914822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-968c3efc-49a2-41d8-9607-af017cb9a0a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:09.915264 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-968c3efc-49a2-41d8-9607-af017cb9a0a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:10.035363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cb47fa25-22e4-4f2f-bd91-9800183200d6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:10.036040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cb47fa25-22e4-4f2f-bd91-9800183200d6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:10.043657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb47fa25-22e4-4f2f-bd91-9800183200d6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:10.044139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb47fa25-22e4-4f2f-bd91-9800183200d6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:10.044574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb47fa25-22e4-4f2f-bd91-9800183200d6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:10.045264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb47fa25-22e4-4f2f-bd91-9800183200d6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:10.045707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb47fa25-22e4-4f2f-bd91-9800183200d6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:10.046153 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb47fa25-22e4-4f2f-bd91-9800183200d6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:10.046860 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-968c3efc-49a2-41d8-9607-af017cb9a0a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:10.055058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-968c3efc-49a2-41d8-9607-af017cb9a0a4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153192 Aug 30 15:01:10.055899 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 806/1609] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:09 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:10.173563 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cb47fa25-22e4-4f2f-bd91-9800183200d6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:10.176941 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:10.182416 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cb47fa25-22e4-4f2f-bd91-9800183200d6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150848 Aug 30 15:01:10.182990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 804/1610] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:10 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:10.658607 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4bab8282-1340-49b7-85f9-8ffbf8b38911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:10.659236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4bab8282-1340-49b7-85f9-8ffbf8b38911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:10.665195 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bab8282-1340-49b7-85f9-8ffbf8b38911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:10.665669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bab8282-1340-49b7-85f9-8ffbf8b38911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:10.666106 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bab8282-1340-49b7-85f9-8ffbf8b38911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:10.666787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bab8282-1340-49b7-85f9-8ffbf8b38911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:10.667255 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bab8282-1340-49b7-85f9-8ffbf8b38911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:10.667677 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4bab8282-1340-49b7-85f9-8ffbf8b38911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:10.728408 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4bab8282-1340-49b7-85f9-8ffbf8b38911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:10.737055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4bab8282-1340-49b7-85f9-8ffbf8b38911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:10.738541 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4bab8282-1340-49b7-85f9-8ffbf8b38911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:10.739747 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4bab8282-1340-49b7-85f9-8ffbf8b38911 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085164 Aug 30 15:01:10.740299 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 807/1611] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:10 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:11.077031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-26fb7134-bec1-45aa-b446-65f3f052bc06 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:11.077636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-26fb7134-bec1-45aa-b446-65f3f052bc06 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:11.084104 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-26fb7134-bec1-45aa-b446-65f3f052bc06 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:11.084577 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-26fb7134-bec1-45aa-b446-65f3f052bc06 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:11.085001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-26fb7134-bec1-45aa-b446-65f3f052bc06 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:11.085675 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-26fb7134-bec1-45aa-b446-65f3f052bc06 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:11.086114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-26fb7134-bec1-45aa-b446-65f3f052bc06 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:11.086528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-26fb7134-bec1-45aa-b446-65f3f052bc06 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:11.203424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-41e90e9d-002f-4a62-9c3e-b30863472bdd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:11.204148 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-41e90e9d-002f-4a62-9c3e-b30863472bdd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:11.210736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-41e90e9d-002f-4a62-9c3e-b30863472bdd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:11.211292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-41e90e9d-002f-4a62-9c3e-b30863472bdd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:11.211840 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-41e90e9d-002f-4a62-9c3e-b30863472bdd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:11.212540 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-41e90e9d-002f-4a62-9c3e-b30863472bdd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:11.212985 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-41e90e9d-002f-4a62-9c3e-b30863472bdd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:11.213591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-41e90e9d-002f-4a62-9c3e-b30863472bdd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:11.216758 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-26fb7134-bec1-45aa-b446-65f3f052bc06 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:11.225711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-26fb7134-bec1-45aa-b446-65f3f052bc06 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153041 Aug 30 15:01:11.226293 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 805/1612] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:11 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:11.345574 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-41e90e9d-002f-4a62-9c3e-b30863472bdd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:11.353697 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-41e90e9d-002f-4a62-9c3e-b30863472bdd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.154195 Aug 30 15:01:11.354935 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 808/1613] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:11 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:11.764251 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-67637db7-d8ab-4f7f-aa63-6c4482829a19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:11.764764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-67637db7-d8ab-4f7f-aa63-6c4482829a19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:11.770633 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67637db7-d8ab-4f7f-aa63-6c4482829a19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:11.771103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67637db7-d8ab-4f7f-aa63-6c4482829a19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:11.771627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67637db7-d8ab-4f7f-aa63-6c4482829a19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:11.772303 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67637db7-d8ab-4f7f-aa63-6c4482829a19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:11.772745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67637db7-d8ab-4f7f-aa63-6c4482829a19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:11.773161 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67637db7-d8ab-4f7f-aa63-6c4482829a19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:11.837564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-67637db7-d8ab-4f7f-aa63-6c4482829a19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:11.846708 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-67637db7-d8ab-4f7f-aa63-6c4482829a19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:11.848157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-67637db7-d8ab-4f7f-aa63-6c4482829a19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:11.849286 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-67637db7-d8ab-4f7f-aa63-6c4482829a19 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089364 Aug 30 15:01:11.849833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 806/1614] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:11 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:12.247573 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7208da45-60df-489e-bdf5-f89f1ef30a7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:12.248273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7208da45-60df-489e-bdf5-f89f1ef30a7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:12.256070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7208da45-60df-489e-bdf5-f89f1ef30a7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:12.256560 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7208da45-60df-489e-bdf5-f89f1ef30a7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:12.256998 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7208da45-60df-489e-bdf5-f89f1ef30a7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:12.257700 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7208da45-60df-489e-bdf5-f89f1ef30a7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:12.258155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7208da45-60df-489e-bdf5-f89f1ef30a7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:12.258579 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7208da45-60df-489e-bdf5-f89f1ef30a7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:12.375636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-328f5030-8202-4057-a719-b6cd16bdef91 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:12.376318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-328f5030-8202-4057-a719-b6cd16bdef91 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:12.382774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-328f5030-8202-4057-a719-b6cd16bdef91 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:12.383286 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-328f5030-8202-4057-a719-b6cd16bdef91 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:12.383723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-328f5030-8202-4057-a719-b6cd16bdef91 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:12.384475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-328f5030-8202-4057-a719-b6cd16bdef91 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:12.384862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-328f5030-8202-4057-a719-b6cd16bdef91 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:12.385872 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-328f5030-8202-4057-a719-b6cd16bdef91 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:12.387716 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7208da45-60df-489e-bdf5-f89f1ef30a7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:12.395810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7208da45-60df-489e-bdf5-f89f1ef30a7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152440 Aug 30 15:01:12.396383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 809/1615] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:12 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:12.512739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-328f5030-8202-4057-a719-b6cd16bdef91 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:12.520783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-328f5030-8202-4057-a719-b6cd16bdef91 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149080 Aug 30 15:01:12.521338 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 807/1616] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:12 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:12.873288 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7091bc5b-8831-4c52-8cf2-7e8a5735b2ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:12.873897 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7091bc5b-8831-4c52-8cf2-7e8a5735b2ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:12.879875 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7091bc5b-8831-4c52-8cf2-7e8a5735b2ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:12.880359 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7091bc5b-8831-4c52-8cf2-7e8a5735b2ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:12.880788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7091bc5b-8831-4c52-8cf2-7e8a5735b2ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:12.881476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7091bc5b-8831-4c52-8cf2-7e8a5735b2ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:12.881923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7091bc5b-8831-4c52-8cf2-7e8a5735b2ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:12.882343 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7091bc5b-8831-4c52-8cf2-7e8a5735b2ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:12.943657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7091bc5b-8831-4c52-8cf2-7e8a5735b2ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:12.952469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7091bc5b-8831-4c52-8cf2-7e8a5735b2ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:12.953923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7091bc5b-8831-4c52-8cf2-7e8a5735b2ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:12.955061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7091bc5b-8831-4c52-8cf2-7e8a5735b2ac tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086637 Aug 30 15:01:12.955648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 810/1617] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:12 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:13.415980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8c10f32c-c6e8-49ab-9e57-386fd2fed92e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:13.417401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8c10f32c-c6e8-49ab-9e57-386fd2fed92e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:13.423744 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c10f32c-c6e8-49ab-9e57-386fd2fed92e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:13.424219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c10f32c-c6e8-49ab-9e57-386fd2fed92e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:13.424648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c10f32c-c6e8-49ab-9e57-386fd2fed92e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:13.425357 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c10f32c-c6e8-49ab-9e57-386fd2fed92e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:13.425803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c10f32c-c6e8-49ab-9e57-386fd2fed92e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:13.426222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c10f32c-c6e8-49ab-9e57-386fd2fed92e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:13.541864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-96af33a8-1573-405c-bbc6-f0e32cc02039 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:13.542472 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-96af33a8-1573-405c-bbc6-f0e32cc02039 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:13.548741 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-96af33a8-1573-405c-bbc6-f0e32cc02039 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:13.549221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-96af33a8-1573-405c-bbc6-f0e32cc02039 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:13.549647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-96af33a8-1573-405c-bbc6-f0e32cc02039 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:13.550347 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-96af33a8-1573-405c-bbc6-f0e32cc02039 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:13.550788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-96af33a8-1573-405c-bbc6-f0e32cc02039 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:13.551234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-96af33a8-1573-405c-bbc6-f0e32cc02039 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:13.552889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8c10f32c-c6e8-49ab-9e57-386fd2fed92e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:13.555296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:13.561527 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8c10f32c-c6e8-49ab-9e57-386fd2fed92e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149368 Aug 30 15:01:13.562101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 808/1618] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:13 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:13.680893 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-96af33a8-1573-405c-bbc6-f0e32cc02039 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:13.689263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-96af33a8-1573-405c-bbc6-f0e32cc02039 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151298 Aug 30 15:01:13.689818 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 811/1619] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:13 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:13.981901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4078cede-8621-4bbe-90b8-7cdbb1866ac0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:13.982535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4078cede-8621-4bbe-90b8-7cdbb1866ac0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:13.988471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4078cede-8621-4bbe-90b8-7cdbb1866ac0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:13.988948 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4078cede-8621-4bbe-90b8-7cdbb1866ac0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:13.989376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4078cede-8621-4bbe-90b8-7cdbb1866ac0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:13.990055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4078cede-8621-4bbe-90b8-7cdbb1866ac0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:13.990503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4078cede-8621-4bbe-90b8-7cdbb1866ac0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:13.990923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4078cede-8621-4bbe-90b8-7cdbb1866ac0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:14.054281 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4078cede-8621-4bbe-90b8-7cdbb1866ac0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:14.063274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4078cede-8621-4bbe-90b8-7cdbb1866ac0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:14.064717 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4078cede-8621-4bbe-90b8-7cdbb1866ac0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:14.065861 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4078cede-8621-4bbe-90b8-7cdbb1866ac0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088138 Aug 30 15:01:14.066415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 809/1620] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:13 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:14.583153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2ca1073d-cf58-49cd-b3fc-24a3ca50fcea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:14.583813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2ca1073d-cf58-49cd-b3fc-24a3ca50fcea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:14.590930 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ca1073d-cf58-49cd-b3fc-24a3ca50fcea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:14.591430 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ca1073d-cf58-49cd-b3fc-24a3ca50fcea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:14.591865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ca1073d-cf58-49cd-b3fc-24a3ca50fcea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:14.592546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ca1073d-cf58-49cd-b3fc-24a3ca50fcea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:14.592989 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ca1073d-cf58-49cd-b3fc-24a3ca50fcea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:14.593408 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2ca1073d-cf58-49cd-b3fc-24a3ca50fcea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:14.711342 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fe3dfafc-3f84-4631-bc70-f75300d3d435 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:14.712066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fe3dfafc-3f84-4631-bc70-f75300d3d435 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:14.719131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe3dfafc-3f84-4631-bc70-f75300d3d435 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:14.719745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe3dfafc-3f84-4631-bc70-f75300d3d435 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:14.720180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe3dfafc-3f84-4631-bc70-f75300d3d435 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:14.720871 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe3dfafc-3f84-4631-bc70-f75300d3d435 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:14.721327 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe3dfafc-3f84-4631-bc70-f75300d3d435 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:14.721748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe3dfafc-3f84-4631-bc70-f75300d3d435 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:14.721854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2ca1073d-cf58-49cd-b3fc-24a3ca50fcea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:14.730621 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2ca1073d-cf58-49cd-b3fc-24a3ca50fcea tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151304 Aug 30 15:01:14.731229 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 812/1621] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:14 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:14.849168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fe3dfafc-3f84-4631-bc70-f75300d3d435 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:14.858464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fe3dfafc-3f84-4631-bc70-f75300d3d435 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151068 Aug 30 15:01:14.859035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 810/1622] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:14 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:15.089800 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e328a9f5-5fef-45d3-b6b3-72746d3dbd6d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:15.090411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e328a9f5-5fef-45d3-b6b3-72746d3dbd6d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:15.096389 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e328a9f5-5fef-45d3-b6b3-72746d3dbd6d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:15.096925 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e328a9f5-5fef-45d3-b6b3-72746d3dbd6d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:15.097309 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e328a9f5-5fef-45d3-b6b3-72746d3dbd6d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:15.098006 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e328a9f5-5fef-45d3-b6b3-72746d3dbd6d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:15.098460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e328a9f5-5fef-45d3-b6b3-72746d3dbd6d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:15.098881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e328a9f5-5fef-45d3-b6b3-72746d3dbd6d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:15.160864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e328a9f5-5fef-45d3-b6b3-72746d3dbd6d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:15.169470 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e328a9f5-5fef-45d3-b6b3-72746d3dbd6d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:15.170919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e328a9f5-5fef-45d3-b6b3-72746d3dbd6d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:15.172077 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e328a9f5-5fef-45d3-b6b3-72746d3dbd6d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086844 Aug 30 15:01:15.172634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 813/1623] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:15 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:15.751066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a9a9a298-f963-4b4d-a478-eaedb4ee19a6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:15.751708 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a9a9a298-f963-4b4d-a478-eaedb4ee19a6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:15.758114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9a9a298-f963-4b4d-a478-eaedb4ee19a6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:15.758592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9a9a298-f963-4b4d-a478-eaedb4ee19a6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:15.759024 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9a9a298-f963-4b4d-a478-eaedb4ee19a6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:15.759735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9a9a298-f963-4b4d-a478-eaedb4ee19a6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:15.760368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9a9a298-f963-4b4d-a478-eaedb4ee19a6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:15.760804 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9a9a298-f963-4b4d-a478-eaedb4ee19a6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:15.879607 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cb8b2568-f1ba-4c9f-88b1-f29eeb993bc6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:15.880324 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cb8b2568-f1ba-4c9f-88b1-f29eeb993bc6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:15.885367 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a9a9a298-f963-4b4d-a478-eaedb4ee19a6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:15.887048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb8b2568-f1ba-4c9f-88b1-f29eeb993bc6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:15.887562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb8b2568-f1ba-4c9f-88b1-f29eeb993bc6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:15.887990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb8b2568-f1ba-4c9f-88b1-f29eeb993bc6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:15.888682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb8b2568-f1ba-4c9f-88b1-f29eeb993bc6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:15.889125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb8b2568-f1ba-4c9f-88b1-f29eeb993bc6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:15.889544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb8b2568-f1ba-4c9f-88b1-f29eeb993bc6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:15.893661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a9a9a298-f963-4b4d-a478-eaedb4ee19a6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.146445 Aug 30 15:01:15.894236 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 811/1624] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:15 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:16.019538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cb8b2568-f1ba-4c9f-88b1-f29eeb993bc6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:16.027653 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cb8b2568-f1ba-4c9f-88b1-f29eeb993bc6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151789 Aug 30 15:01:16.028225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 814/1625] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:15 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:16.194278 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-522b2fb5-df51-46c1-9a65-6d609a8891df tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:16.194886 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-522b2fb5-df51-46c1-9a65-6d609a8891df tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:16.201169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-522b2fb5-df51-46c1-9a65-6d609a8891df tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:16.201701 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-522b2fb5-df51-46c1-9a65-6d609a8891df tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:16.202171 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-522b2fb5-df51-46c1-9a65-6d609a8891df tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:16.202861 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-522b2fb5-df51-46c1-9a65-6d609a8891df tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:16.203337 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-522b2fb5-df51-46c1-9a65-6d609a8891df tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:16.203761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-522b2fb5-df51-46c1-9a65-6d609a8891df tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:16.269435 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-522b2fb5-df51-46c1-9a65-6d609a8891df tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:16.278743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-522b2fb5-df51-46c1-9a65-6d609a8891df tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:16.280309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-522b2fb5-df51-46c1-9a65-6d609a8891df tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:16.281455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-522b2fb5-df51-46c1-9a65-6d609a8891df tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091103 Aug 30 15:01:16.282013 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 812/1626] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:16 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:16.913936 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a1a1cd96-02d6-4730-9e98-05e2784e0944 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:16.914533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a1a1cd96-02d6-4730-9e98-05e2784e0944 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:16.921894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a1a1cd96-02d6-4730-9e98-05e2784e0944 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:16.922375 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a1a1cd96-02d6-4730-9e98-05e2784e0944 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:16.922811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a1a1cd96-02d6-4730-9e98-05e2784e0944 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:16.923534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a1a1cd96-02d6-4730-9e98-05e2784e0944 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:16.923989 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a1a1cd96-02d6-4730-9e98-05e2784e0944 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:16.924412 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a1a1cd96-02d6-4730-9e98-05e2784e0944 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:17.048818 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c6366a8d-8174-4967-9577-aefb89edb34c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:17.049374 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c6366a8d-8174-4967-9577-aefb89edb34c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:17.051092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a1a1cd96-02d6-4730-9e98-05e2784e0944 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:17.055683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6366a8d-8174-4967-9577-aefb89edb34c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:17.056167 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6366a8d-8174-4967-9577-aefb89edb34c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:17.056617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6366a8d-8174-4967-9577-aefb89edb34c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:17.057393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6366a8d-8174-4967-9577-aefb89edb34c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:17.057850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6366a8d-8174-4967-9577-aefb89edb34c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:17.058270 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6366a8d-8174-4967-9577-aefb89edb34c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:17.059544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a1a1cd96-02d6-4730-9e98-05e2784e0944 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149493 Aug 30 15:01:17.060108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 815/1627] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:16 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:17.192880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c6366a8d-8174-4967-9577-aefb89edb34c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:17.201726 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c6366a8d-8174-4967-9577-aefb89edb34c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156965 Aug 30 15:01:17.202288 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 813/1628] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:17 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:17.304278 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f17c5026-8752-4f61-9802-be816b43a86e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:17.304884 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f17c5026-8752-4f61-9802-be816b43a86e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:17.311132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f17c5026-8752-4f61-9802-be816b43a86e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:17.311653 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f17c5026-8752-4f61-9802-be816b43a86e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:17.312089 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f17c5026-8752-4f61-9802-be816b43a86e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:17.312774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f17c5026-8752-4f61-9802-be816b43a86e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:17.313224 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f17c5026-8752-4f61-9802-be816b43a86e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:17.313645 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f17c5026-8752-4f61-9802-be816b43a86e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:17.375310 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f17c5026-8752-4f61-9802-be816b43a86e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:17.383847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f17c5026-8752-4f61-9802-be816b43a86e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:17.385323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f17c5026-8752-4f61-9802-be816b43a86e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:17.387000 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f17c5026-8752-4f61-9802-be816b43a86e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086185 Aug 30 15:01:17.388213 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 816/1629] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:17 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:18.080820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-728b9a59-e0a1-46c6-b4f0-e25dedf3fe6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:18.081437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-728b9a59-e0a1-46c6-b4f0-e25dedf3fe6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:18.087928 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-728b9a59-e0a1-46c6-b4f0-e25dedf3fe6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:18.088408 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-728b9a59-e0a1-46c6-b4f0-e25dedf3fe6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:18.088842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-728b9a59-e0a1-46c6-b4f0-e25dedf3fe6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:18.089534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-728b9a59-e0a1-46c6-b4f0-e25dedf3fe6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:18.089988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-728b9a59-e0a1-46c6-b4f0-e25dedf3fe6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:18.090408 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-728b9a59-e0a1-46c6-b4f0-e25dedf3fe6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:18.216121 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-728b9a59-e0a1-46c6-b4f0-e25dedf3fe6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:18.224448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-728b9a59-e0a1-46c6-b4f0-e25dedf3fe6f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147443 Aug 30 15:01:18.225031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 814/1630] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:18 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:18.226377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6d9791a4-6b3a-42de-ad16-8510b17bf659 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:18.226999 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6d9791a4-6b3a-42de-ad16-8510b17bf659 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:18.233744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d9791a4-6b3a-42de-ad16-8510b17bf659 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:18.234222 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d9791a4-6b3a-42de-ad16-8510b17bf659 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:18.234651 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d9791a4-6b3a-42de-ad16-8510b17bf659 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:18.235369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d9791a4-6b3a-42de-ad16-8510b17bf659 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:18.235816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d9791a4-6b3a-42de-ad16-8510b17bf659 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:18.236228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d9791a4-6b3a-42de-ad16-8510b17bf659 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:18.369899 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6d9791a4-6b3a-42de-ad16-8510b17bf659 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:18.378075 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6d9791a4-6b3a-42de-ad16-8510b17bf659 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.158903 Aug 30 15:01:18.378644 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 817/1631] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:18 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:18.411051 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ec0c66a6-7444-4f33-b915-8a5bed4070c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:18.411683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ec0c66a6-7444-4f33-b915-8a5bed4070c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:18.417552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec0c66a6-7444-4f33-b915-8a5bed4070c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:18.418671 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec0c66a6-7444-4f33-b915-8a5bed4070c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:18.419127 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec0c66a6-7444-4f33-b915-8a5bed4070c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:18.419841 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec0c66a6-7444-4f33-b915-8a5bed4070c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:18.420294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec0c66a6-7444-4f33-b915-8a5bed4070c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:18.420717 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec0c66a6-7444-4f33-b915-8a5bed4070c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:18.484027 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ec0c66a6-7444-4f33-b915-8a5bed4070c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:18.492425 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ec0c66a6-7444-4f33-b915-8a5bed4070c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:18.493853 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ec0c66a6-7444-4f33-b915-8a5bed4070c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:18.495010 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ec0c66a6-7444-4f33-b915-8a5bed4070c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087853 Aug 30 15:01:18.495599 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 815/1632] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:18 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:19.246050 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-10eb3e33-88d7-48cd-a20c-c70abee048d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:19.246747 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-10eb3e33-88d7-48cd-a20c-c70abee048d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:19.253310 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-10eb3e33-88d7-48cd-a20c-c70abee048d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:19.253831 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-10eb3e33-88d7-48cd-a20c-c70abee048d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:19.254267 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-10eb3e33-88d7-48cd-a20c-c70abee048d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:19.254966 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-10eb3e33-88d7-48cd-a20c-c70abee048d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:19.255456 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-10eb3e33-88d7-48cd-a20c-c70abee048d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:19.255886 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-10eb3e33-88d7-48cd-a20c-c70abee048d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:19.382986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-10eb3e33-88d7-48cd-a20c-c70abee048d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:19.391946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-10eb3e33-88d7-48cd-a20c-c70abee048d3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149847 Aug 30 15:01:19.392521 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 818/1633] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:19 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:19.399402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-11d99eac-4e98-4e70-9b33-1a90bcf559d8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:19.400011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-11d99eac-4e98-4e70-9b33-1a90bcf559d8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:19.407183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11d99eac-4e98-4e70-9b33-1a90bcf559d8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:19.407697 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11d99eac-4e98-4e70-9b33-1a90bcf559d8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:19.408128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11d99eac-4e98-4e70-9b33-1a90bcf559d8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:19.408816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11d99eac-4e98-4e70-9b33-1a90bcf559d8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:19.409265 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11d99eac-4e98-4e70-9b33-1a90bcf559d8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:19.409683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11d99eac-4e98-4e70-9b33-1a90bcf559d8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:19.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2b913a41-eb8d-4f02-833a-4e6547d53081 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:19.519229 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2b913a41-eb8d-4f02-833a-4e6547d53081 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:19.525181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2b913a41-eb8d-4f02-833a-4e6547d53081 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:19.525666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2b913a41-eb8d-4f02-833a-4e6547d53081 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:19.526105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2b913a41-eb8d-4f02-833a-4e6547d53081 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:19.526803 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2b913a41-eb8d-4f02-833a-4e6547d53081 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:19.528032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2b913a41-eb8d-4f02-833a-4e6547d53081 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:19.528471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2b913a41-eb8d-4f02-833a-4e6547d53081 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:19.538067 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-11d99eac-4e98-4e70-9b33-1a90bcf559d8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:19.547138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-11d99eac-4e98-4e70-9b33-1a90bcf559d8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151530 Aug 30 15:01:19.547784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 816/1634] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:19 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:19.590720 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2b913a41-eb8d-4f02-833a-4e6547d53081 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:19.599282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2b913a41-eb8d-4f02-833a-4e6547d53081 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:19.600730 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2b913a41-eb8d-4f02-833a-4e6547d53081 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:19.601854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2b913a41-eb8d-4f02-833a-4e6547d53081 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087278 Aug 30 15:01:19.602408 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 819/1635] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:19 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:01:20.415524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-50856b01-035a-421d-bac9-3e7364f4306d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:20.416163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-50856b01-035a-421d-bac9-3e7364f4306d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:20.422791 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50856b01-035a-421d-bac9-3e7364f4306d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:20.423301 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50856b01-035a-421d-bac9-3e7364f4306d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:20.423743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50856b01-035a-421d-bac9-3e7364f4306d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:20.424426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50856b01-035a-421d-bac9-3e7364f4306d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:20.424877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50856b01-035a-421d-bac9-3e7364f4306d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:20.425299 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50856b01-035a-421d-bac9-3e7364f4306d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:20.551700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-50856b01-035a-421d-bac9-3e7364f4306d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:20.559815 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-50856b01-035a-421d-bac9-3e7364f4306d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148256 Aug 30 15:01:20.560378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 817/1636] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:20 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:20.568535 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1ced721a-2b1d-49c6-9752-81133b7fa6d5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:20.569151 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1ced721a-2b1d-49c6-9752-81133b7fa6d5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:20.575792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ced721a-2b1d-49c6-9752-81133b7fa6d5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:20.576272 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ced721a-2b1d-49c6-9752-81133b7fa6d5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:20.576733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ced721a-2b1d-49c6-9752-81133b7fa6d5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:20.578010 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ced721a-2b1d-49c6-9752-81133b7fa6d5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:20.578461 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ced721a-2b1d-49c6-9752-81133b7fa6d5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:20.578879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ced721a-2b1d-49c6-9752-81133b7fa6d5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:20.625130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4e298799-2eed-444d-9cd3-ab72b07d7faf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:20.625732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4e298799-2eed-444d-9cd3-ab72b07d7faf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:20.631512 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e298799-2eed-444d-9cd3-ab72b07d7faf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:20.631989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e298799-2eed-444d-9cd3-ab72b07d7faf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:20.632417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e298799-2eed-444d-9cd3-ab72b07d7faf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:20.633094 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e298799-2eed-444d-9cd3-ab72b07d7faf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:20.633534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e298799-2eed-444d-9cd3-ab72b07d7faf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:20.633945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e298799-2eed-444d-9cd3-ab72b07d7faf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:20.697783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4e298799-2eed-444d-9cd3-ab72b07d7faf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:20.707616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4e298799-2eed-444d-9cd3-ab72b07d7faf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:20.709055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4e298799-2eed-444d-9cd3-ab72b07d7faf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:20.710198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4e298799-2eed-444d-9cd3-ab72b07d7faf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089431 Aug 30 15:01:20.710750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 818/1637] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:20 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:01:20.715900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1ced721a-2b1d-49c6-9752-81133b7fa6d5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:20.724666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1ced721a-2b1d-49c6-9752-81133b7fa6d5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.159964 Aug 30 15:01:20.725220 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 820/1638] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:20 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:21.581237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-95130d85-f564-4892-8b91-693457c13071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:21.581840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-95130d85-f564-4892-8b91-693457c13071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:21.583907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=82 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:21.589173 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95130d85-f564-4892-8b91-693457c13071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:21.589650 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95130d85-f564-4892-8b91-693457c13071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:21.590081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95130d85-f564-4892-8b91-693457c13071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:21.590807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95130d85-f564-4892-8b91-693457c13071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:21.591340 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95130d85-f564-4892-8b91-693457c13071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:21.591748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95130d85-f564-4892-8b91-693457c13071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:21.719125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-95130d85-f564-4892-8b91-693457c13071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:21.729035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-95130d85-f564-4892-8b91-693457c13071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152080 Aug 30 15:01:21.729606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 819/1639] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:21 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:21.732548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cd1454df-f144-44d4-a99a-25b88717943e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:21.733153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cd1454df-f144-44d4-a99a-25b88717943e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:21.735492 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=76 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:21.740793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cd1454df-f144-44d4-a99a-25b88717943e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:21.741263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cd1454df-f144-44d4-a99a-25b88717943e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:21.741691 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cd1454df-f144-44d4-a99a-25b88717943e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:21.742410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cd1454df-f144-44d4-a99a-25b88717943e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:21.742865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cd1454df-f144-44d4-a99a-25b88717943e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:21.743307 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cd1454df-f144-44d4-a99a-25b88717943e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:21.748829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3f796392-954d-4390-b8d0-c0f5dde7b792 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:21.749435 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3f796392-954d-4390-b8d0-c0f5dde7b792 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:21.755160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f796392-954d-4390-b8d0-c0f5dde7b792 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:21.755739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f796392-954d-4390-b8d0-c0f5dde7b792 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:21.756168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f796392-954d-4390-b8d0-c0f5dde7b792 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:21.756855 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f796392-954d-4390-b8d0-c0f5dde7b792 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:21.757306 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f796392-954d-4390-b8d0-c0f5dde7b792 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:21.757724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f796392-954d-4390-b8d0-c0f5dde7b792 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:21.807293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cd1454df-f144-44d4-a99a-25b88717943e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:21.816453 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cd1454df-f144-44d4-a99a-25b88717943e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:21.817920 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cd1454df-f144-44d4-a99a-25b88717943e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:21.819068 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cd1454df-f144-44d4-a99a-25b88717943e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090429 Aug 30 15:01:21.819665 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 821/1640] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:21 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:01:21.885305 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3f796392-954d-4390-b8d0-c0f5dde7b792 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:21.893590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3f796392-954d-4390-b8d0-c0f5dde7b792 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148539 Aug 30 15:01:21.894158 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 820/1641] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:21 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:22.751700 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-477d80ee-590a-4734-aab8-cd7171310e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:22.752311 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-477d80ee-590a-4734-aab8-cd7171310e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:22.758657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-477d80ee-590a-4734-aab8-cd7171310e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:22.759132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-477d80ee-590a-4734-aab8-cd7171310e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:22.759593 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-477d80ee-590a-4734-aab8-cd7171310e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:22.760285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-477d80ee-590a-4734-aab8-cd7171310e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:22.760729 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-477d80ee-590a-4734-aab8-cd7171310e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:22.761148 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-477d80ee-590a-4734-aab8-cd7171310e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:22.841068 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b81537bc-74bb-4ea8-80e0-218bfcb0b03e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:22.841789 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b81537bc-74bb-4ea8-80e0-218bfcb0b03e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:22.848492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b81537bc-74bb-4ea8-80e0-218bfcb0b03e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:22.848974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b81537bc-74bb-4ea8-80e0-218bfcb0b03e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:22.849407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b81537bc-74bb-4ea8-80e0-218bfcb0b03e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:22.850099 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b81537bc-74bb-4ea8-80e0-218bfcb0b03e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:22.850549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b81537bc-74bb-4ea8-80e0-218bfcb0b03e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:22.850970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b81537bc-74bb-4ea8-80e0-218bfcb0b03e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:22.872567 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:22.899971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-477d80ee-590a-4734-aab8-cd7171310e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:22.908692 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-477d80ee-590a-4734-aab8-cd7171310e6c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.161571 Aug 30 15:01:22.909502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 822/1642] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:22 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:22.914688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-afc630b9-485f-4208-86b3-7d2db4d8296b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:22.915309 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-afc630b9-485f-4208-86b3-7d2db4d8296b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:22.921552 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afc630b9-485f-4208-86b3-7d2db4d8296b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:22.922214 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afc630b9-485f-4208-86b3-7d2db4d8296b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:22.922586 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afc630b9-485f-4208-86b3-7d2db4d8296b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:22.923321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afc630b9-485f-4208-86b3-7d2db4d8296b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:22.923804 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afc630b9-485f-4208-86b3-7d2db4d8296b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:22.924228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afc630b9-485f-4208-86b3-7d2db4d8296b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:22.925284 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b81537bc-74bb-4ea8-80e0-218bfcb0b03e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:22.933912 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b81537bc-74bb-4ea8-80e0-218bfcb0b03e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:22.935390 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b81537bc-74bb-4ea8-80e0-218bfcb0b03e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:22.937623 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b81537bc-74bb-4ea8-80e0-218bfcb0b03e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.099564 Aug 30 15:01:22.943864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 821/1643] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:22 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:23.055682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-afc630b9-485f-4208-86b3-7d2db4d8296b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:23.064399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-afc630b9-485f-4208-86b3-7d2db4d8296b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153422 Aug 30 15:01:23.064973 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 823/1644] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:22 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:23.929803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b653f023-53cb-4019-b95d-e0f2d4e040f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:23.930395 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b653f023-53cb-4019-b95d-e0f2d4e040f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:23.936962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b653f023-53cb-4019-b95d-e0f2d4e040f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:23.937428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b653f023-53cb-4019-b95d-e0f2d4e040f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:23.937866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b653f023-53cb-4019-b95d-e0f2d4e040f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:23.938555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b653f023-53cb-4019-b95d-e0f2d4e040f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:23.939041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b653f023-53cb-4019-b95d-e0f2d4e040f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:23.939518 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b653f023-53cb-4019-b95d-e0f2d4e040f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:23.960193 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d3c7948e-f71d-494a-b522-5a2f49f5f927 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:23.960798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d3c7948e-f71d-494a-b522-5a2f49f5f927 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:23.967083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d3c7948e-f71d-494a-b522-5a2f49f5f927 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:23.968212 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d3c7948e-f71d-494a-b522-5a2f49f5f927 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:23.968639 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d3c7948e-f71d-494a-b522-5a2f49f5f927 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:23.969346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d3c7948e-f71d-494a-b522-5a2f49f5f927 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:23.969799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d3c7948e-f71d-494a-b522-5a2f49f5f927 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:23.970224 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d3c7948e-f71d-494a-b522-5a2f49f5f927 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:24.032077 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d3c7948e-f71d-494a-b522-5a2f49f5f927 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:24.040997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d3c7948e-f71d-494a-b522-5a2f49f5f927 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:24.042431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d3c7948e-f71d-494a-b522-5a2f49f5f927 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:24.043629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d3c7948e-f71d-494a-b522-5a2f49f5f927 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087365 Aug 30 15:01:24.044182 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 824/1645] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:23 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:01:24.077595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b653f023-53cb-4019-b95d-e0f2d4e040f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:24.084806 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-97350438-da78-49ec-9648-9e14136c428d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:24.085420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-97350438-da78-49ec-9648-9e14136c428d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:24.085799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b653f023-53cb-4019-b95d-e0f2d4e040f6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.159856 Aug 30 15:01:24.086363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 822/1646] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:23 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:24.091464 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-97350438-da78-49ec-9648-9e14136c428d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:24.091944 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-97350438-da78-49ec-9648-9e14136c428d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:24.092379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-97350438-da78-49ec-9648-9e14136c428d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:24.093808 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-97350438-da78-49ec-9648-9e14136c428d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:24.094262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-97350438-da78-49ec-9648-9e14136c428d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:24.094681 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-97350438-da78-49ec-9648-9e14136c428d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:24.222733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-97350438-da78-49ec-9648-9e14136c428d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:24.230890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-97350438-da78-49ec-9648-9e14136c428d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149829 Aug 30 15:01:24.231494 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 825/1647] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:24 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:25.065881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9b556702-b74c-4eec-b7fd-a5c6c3d95c50 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:25.066517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9b556702-b74c-4eec-b7fd-a5c6c3d95c50 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:25.073390 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b556702-b74c-4eec-b7fd-a5c6c3d95c50 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:25.073875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b556702-b74c-4eec-b7fd-a5c6c3d95c50 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:25.074312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b556702-b74c-4eec-b7fd-a5c6c3d95c50 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:25.075001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b556702-b74c-4eec-b7fd-a5c6c3d95c50 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:25.075484 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b556702-b74c-4eec-b7fd-a5c6c3d95c50 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:25.075911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b556702-b74c-4eec-b7fd-a5c6c3d95c50 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:25.107623 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cc4a4532-91e8-4ccb-9dbb-9db09a922a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:25.108979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cc4a4532-91e8-4ccb-9dbb-9db09a922a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:25.115766 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc4a4532-91e8-4ccb-9dbb-9db09a922a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:25.116298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc4a4532-91e8-4ccb-9dbb-9db09a922a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:25.116733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc4a4532-91e8-4ccb-9dbb-9db09a922a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:25.117438 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc4a4532-91e8-4ccb-9dbb-9db09a922a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:25.117890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc4a4532-91e8-4ccb-9dbb-9db09a922a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:25.118310 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc4a4532-91e8-4ccb-9dbb-9db09a922a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:25.136753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b556702-b74c-4eec-b7fd-a5c6c3d95c50 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:25.145686 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b556702-b74c-4eec-b7fd-a5c6c3d95c50 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:25.147065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b556702-b74c-4eec-b7fd-a5c6c3d95c50 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:25.148246 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9b556702-b74c-4eec-b7fd-a5c6c3d95c50 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086334 Aug 30 15:01:25.149024 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 823/1648] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:25 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:25.246783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cc4a4532-91e8-4ccb-9dbb-9db09a922a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:25.251862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-14261c80-ecaa-4e01-950c-2743daef0329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:25.252477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-14261c80-ecaa-4e01-950c-2743daef0329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:25.256575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cc4a4532-91e8-4ccb-9dbb-9db09a922a40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152733 Aug 30 15:01:25.257150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 826/1649] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:25 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:25.258420 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14261c80-ecaa-4e01-950c-2743daef0329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:25.258911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14261c80-ecaa-4e01-950c-2743daef0329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:25.259429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14261c80-ecaa-4e01-950c-2743daef0329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:25.260129 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14261c80-ecaa-4e01-950c-2743daef0329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:25.260600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14261c80-ecaa-4e01-950c-2743daef0329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:25.261010 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14261c80-ecaa-4e01-950c-2743daef0329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:25.393492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-14261c80-ecaa-4e01-950c-2743daef0329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:25.401697 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-14261c80-ecaa-4e01-950c-2743daef0329 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153731 Aug 30 15:01:25.402213 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 824/1650] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:25 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:26.172119 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0332d6a1-fd52-427b-9d61-7848ae5bc98a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:26.172735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0332d6a1-fd52-427b-9d61-7848ae5bc98a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:26.179107 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0332d6a1-fd52-427b-9d61-7848ae5bc98a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:26.179617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0332d6a1-fd52-427b-9d61-7848ae5bc98a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:26.180054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0332d6a1-fd52-427b-9d61-7848ae5bc98a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:26.180751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0332d6a1-fd52-427b-9d61-7848ae5bc98a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:26.181205 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0332d6a1-fd52-427b-9d61-7848ae5bc98a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:26.181629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0332d6a1-fd52-427b-9d61-7848ae5bc98a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:26.245681 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0332d6a1-fd52-427b-9d61-7848ae5bc98a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:26.249876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:26.255876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0332d6a1-fd52-427b-9d61-7848ae5bc98a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:26.257327 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0332d6a1-fd52-427b-9d61-7848ae5bc98a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:26.258461 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0332d6a1-fd52-427b-9d61-7848ae5bc98a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090788 Aug 30 15:01:26.259025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 827/1651] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:26 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:26.277476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-123be1a3-f005-4fb0-86c4-37b0250503b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:26.278115 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-123be1a3-f005-4fb0-86c4-37b0250503b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:26.284623 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-123be1a3-f005-4fb0-86c4-37b0250503b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:26.285096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-123be1a3-f005-4fb0-86c4-37b0250503b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:26.285526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-123be1a3-f005-4fb0-86c4-37b0250503b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:26.286204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-123be1a3-f005-4fb0-86c4-37b0250503b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:26.286656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-123be1a3-f005-4fb0-86c4-37b0250503b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:26.287071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-123be1a3-f005-4fb0-86c4-37b0250503b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:26.422771 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-123be1a3-f005-4fb0-86c4-37b0250503b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:26.426070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-35c52235-0977-4be9-bdcd-50fd4d41fecc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:26.426679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-35c52235-0977-4be9-bdcd-50fd4d41fecc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:26.431096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-123be1a3-f005-4fb0-86c4-37b0250503b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.157425 Aug 30 15:01:26.431760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 825/1652] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:26 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:26.432740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35c52235-0977-4be9-bdcd-50fd4d41fecc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:26.433229 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35c52235-0977-4be9-bdcd-50fd4d41fecc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:26.433667 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35c52235-0977-4be9-bdcd-50fd4d41fecc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:26.434377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35c52235-0977-4be9-bdcd-50fd4d41fecc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:26.434827 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35c52235-0977-4be9-bdcd-50fd4d41fecc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:26.435273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-35c52235-0977-4be9-bdcd-50fd4d41fecc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:26.582913 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-35c52235-0977-4be9-bdcd-50fd4d41fecc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:26.592152 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-35c52235-0977-4be9-bdcd-50fd4d41fecc tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.169988 Aug 30 15:01:26.593694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 828/1653] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:26 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:27.280771 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-41f46e19-b2c1-484e-952c-27df99f8a42a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:27.281383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-41f46e19-b2c1-484e-952c-27df99f8a42a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:27.287865 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41f46e19-b2c1-484e-952c-27df99f8a42a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:27.288345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41f46e19-b2c1-484e-952c-27df99f8a42a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:27.288778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41f46e19-b2c1-484e-952c-27df99f8a42a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:27.289504 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41f46e19-b2c1-484e-952c-27df99f8a42a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:27.289955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41f46e19-b2c1-484e-952c-27df99f8a42a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:27.290376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-41f46e19-b2c1-484e-952c-27df99f8a42a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:27.351572 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-41f46e19-b2c1-484e-952c-27df99f8a42a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:27.360535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-41f46e19-b2c1-484e-952c-27df99f8a42a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:27.361983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-41f46e19-b2c1-484e-952c-27df99f8a42a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:27.363173 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-41f46e19-b2c1-484e-952c-27df99f8a42a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086429 Aug 30 15:01:27.364605 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 826/1654] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:27 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:27.454821 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-55ebb688-5908-4a34-8535-1f9d21909b67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:27.455473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-55ebb688-5908-4a34-8535-1f9d21909b67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:27.462023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55ebb688-5908-4a34-8535-1f9d21909b67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:27.462447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55ebb688-5908-4a34-8535-1f9d21909b67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:27.462881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55ebb688-5908-4a34-8535-1f9d21909b67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:27.463603 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55ebb688-5908-4a34-8535-1f9d21909b67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:27.464054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55ebb688-5908-4a34-8535-1f9d21909b67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:27.464477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55ebb688-5908-4a34-8535-1f9d21909b67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:27.591686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-55ebb688-5908-4a34-8535-1f9d21909b67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:27.599863 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-55ebb688-5908-4a34-8535-1f9d21909b67 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150000 Aug 30 15:01:27.600426 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 829/1655] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:27 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:27.615068 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-038346ba-461f-4e44-9d08-490029adcd03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:27.615704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-038346ba-461f-4e44-9d08-490029adcd03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:27.621552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-038346ba-461f-4e44-9d08-490029adcd03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:27.622002 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-038346ba-461f-4e44-9d08-490029adcd03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:27.622428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-038346ba-461f-4e44-9d08-490029adcd03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:27.623100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-038346ba-461f-4e44-9d08-490029adcd03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:27.623574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-038346ba-461f-4e44-9d08-490029adcd03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:27.624690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-038346ba-461f-4e44-9d08-490029adcd03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:27.755274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-038346ba-461f-4e44-9d08-490029adcd03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:27.763242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-038346ba-461f-4e44-9d08-490029adcd03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152062 Aug 30 15:01:27.763803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 827/1656] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:27 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:28.386203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f203f464-c0ce-4fbe-bd62-c7931d13ae57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:28.386822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f203f464-c0ce-4fbe-bd62-c7931d13ae57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:28.393492 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f203f464-c0ce-4fbe-bd62-c7931d13ae57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:28.393988 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f203f464-c0ce-4fbe-bd62-c7931d13ae57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:28.394408 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f203f464-c0ce-4fbe-bd62-c7931d13ae57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:28.395100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f203f464-c0ce-4fbe-bd62-c7931d13ae57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:28.395585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f203f464-c0ce-4fbe-bd62-c7931d13ae57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:28.396013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f203f464-c0ce-4fbe-bd62-c7931d13ae57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:28.455899 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f203f464-c0ce-4fbe-bd62-c7931d13ae57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:28.465149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f203f464-c0ce-4fbe-bd62-c7931d13ae57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:28.466523 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f203f464-c0ce-4fbe-bd62-c7931d13ae57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:28.469082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f203f464-c0ce-4fbe-bd62-c7931d13ae57 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086256 Aug 30 15:01:28.469705 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 830/1657] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:28 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:28.621008 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c1575b07-c7da-45d5-831a-d34c1dea68f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:28.621615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c1575b07-c7da-45d5-831a-d34c1dea68f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:28.628685 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1575b07-c7da-45d5-831a-d34c1dea68f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:28.629162 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1575b07-c7da-45d5-831a-d34c1dea68f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:28.629592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1575b07-c7da-45d5-831a-d34c1dea68f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:28.630275 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1575b07-c7da-45d5-831a-d34c1dea68f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:28.630724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1575b07-c7da-45d5-831a-d34c1dea68f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:28.631142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1575b07-c7da-45d5-831a-d34c1dea68f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:28.759907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c1575b07-c7da-45d5-831a-d34c1dea68f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:28.767984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c1575b07-c7da-45d5-831a-d34c1dea68f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150781 Aug 30 15:01:28.768556 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 828/1658] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:28 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:28.784531 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4567446d-9702-4b2b-b129-45488bc5fbc4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:28.785160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4567446d-9702-4b2b-b129-45488bc5fbc4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:28.791023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4567446d-9702-4b2b-b129-45488bc5fbc4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:28.791537 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4567446d-9702-4b2b-b129-45488bc5fbc4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:28.791972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4567446d-9702-4b2b-b129-45488bc5fbc4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:28.792663 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4567446d-9702-4b2b-b129-45488bc5fbc4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:28.793117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4567446d-9702-4b2b-b129-45488bc5fbc4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:28.793541 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4567446d-9702-4b2b-b129-45488bc5fbc4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:28.924652 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4567446d-9702-4b2b-b129-45488bc5fbc4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:28.932859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4567446d-9702-4b2b-b129-45488bc5fbc4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152679 Aug 30 15:01:28.933427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 831/1659] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:28 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:29.492318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6cb1c0ff-9e5b-448b-8eeb-6bc179d2dc5f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:29.492838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6cb1c0ff-9e5b-448b-8eeb-6bc179d2dc5f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:29.498927 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6cb1c0ff-9e5b-448b-8eeb-6bc179d2dc5f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:29.499503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6cb1c0ff-9e5b-448b-8eeb-6bc179d2dc5f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:29.499915 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6cb1c0ff-9e5b-448b-8eeb-6bc179d2dc5f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:29.500583 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6cb1c0ff-9e5b-448b-8eeb-6bc179d2dc5f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:29.501028 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6cb1c0ff-9e5b-448b-8eeb-6bc179d2dc5f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:29.501444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6cb1c0ff-9e5b-448b-8eeb-6bc179d2dc5f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:29.561688 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6cb1c0ff-9e5b-448b-8eeb-6bc179d2dc5f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:29.570132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6cb1c0ff-9e5b-448b-8eeb-6bc179d2dc5f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:29.571857 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6cb1c0ff-9e5b-448b-8eeb-6bc179d2dc5f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:29.572983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6cb1c0ff-9e5b-448b-8eeb-6bc179d2dc5f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084717 Aug 30 15:01:29.573535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 829/1660] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:29 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:29.789506 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2083e7c0-e898-46a2-8f34-ea4e54593ba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:29.790049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2083e7c0-e898-46a2-8f34-ea4e54593ba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:29.798696 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2083e7c0-e898-46a2-8f34-ea4e54593ba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:29.799317 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2083e7c0-e898-46a2-8f34-ea4e54593ba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:29.799643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2083e7c0-e898-46a2-8f34-ea4e54593ba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:29.800361 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2083e7c0-e898-46a2-8f34-ea4e54593ba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:29.800975 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2083e7c0-e898-46a2-8f34-ea4e54593ba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:29.801402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2083e7c0-e898-46a2-8f34-ea4e54593ba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:29.927871 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2083e7c0-e898-46a2-8f34-ea4e54593ba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:29.936016 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2083e7c0-e898-46a2-8f34-ea4e54593ba3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150484 Aug 30 15:01:29.936721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 832/1661] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:29 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:29.955606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8dbe2066-e2bf-49b3-bc1e-e58360653454 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:29.956222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8dbe2066-e2bf-49b3-bc1e-e58360653454 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:29.962489 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dbe2066-e2bf-49b3-bc1e-e58360653454 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:29.962960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dbe2066-e2bf-49b3-bc1e-e58360653454 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:29.963431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dbe2066-e2bf-49b3-bc1e-e58360653454 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:29.964113 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dbe2066-e2bf-49b3-bc1e-e58360653454 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:29.964558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dbe2066-e2bf-49b3-bc1e-e58360653454 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:29.964982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8dbe2066-e2bf-49b3-bc1e-e58360653454 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:30.095959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8dbe2066-e2bf-49b3-bc1e-e58360653454 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:30.104058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8dbe2066-e2bf-49b3-bc1e-e58360653454 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152998 Aug 30 15:01:30.104624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 830/1662] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:29 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:30.595805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-28e19ff5-3eb2-423f-9157-fae1a4d71a73 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:30.596414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-28e19ff5-3eb2-423f-9157-fae1a4d71a73 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:30.602235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-28e19ff5-3eb2-423f-9157-fae1a4d71a73 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:30.602706 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-28e19ff5-3eb2-423f-9157-fae1a4d71a73 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:30.603138 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-28e19ff5-3eb2-423f-9157-fae1a4d71a73 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:30.603836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-28e19ff5-3eb2-423f-9157-fae1a4d71a73 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:30.604281 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-28e19ff5-3eb2-423f-9157-fae1a4d71a73 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:30.604697 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-28e19ff5-3eb2-423f-9157-fae1a4d71a73 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:30.664470 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-28e19ff5-3eb2-423f-9157-fae1a4d71a73 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:30.672911 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-28e19ff5-3eb2-423f-9157-fae1a4d71a73 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:30.674964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-28e19ff5-3eb2-423f-9157-fae1a4d71a73 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:30.676123 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-28e19ff5-3eb2-423f-9157-fae1a4d71a73 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084921 Aug 30 15:01:30.676673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 833/1663] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:30 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:30.959137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-59773ddb-1352-4693-b615-e36bf5e33a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:30.959736 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-59773ddb-1352-4693-b615-e36bf5e33a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:30.965961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59773ddb-1352-4693-b615-e36bf5e33a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:30.966430 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59773ddb-1352-4693-b615-e36bf5e33a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:30.966916 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59773ddb-1352-4693-b615-e36bf5e33a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:30.968610 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59773ddb-1352-4693-b615-e36bf5e33a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:30.969068 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59773ddb-1352-4693-b615-e36bf5e33a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:30.969487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59773ddb-1352-4693-b615-e36bf5e33a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:31.096015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-59773ddb-1352-4693-b615-e36bf5e33a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:31.104137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-59773ddb-1352-4693-b615-e36bf5e33a81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148929 Aug 30 15:01:31.104710 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 831/1664] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:30 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:31.125712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0a7b3b77-7521-4daf-a9b9-2c83b0fd69f5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:31.126326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0a7b3b77-7521-4daf-a9b9-2c83b0fd69f5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:31.132712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a7b3b77-7521-4daf-a9b9-2c83b0fd69f5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:31.133188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a7b3b77-7521-4daf-a9b9-2c83b0fd69f5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:31.133619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a7b3b77-7521-4daf-a9b9-2c83b0fd69f5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:31.134309 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a7b3b77-7521-4daf-a9b9-2c83b0fd69f5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:31.134762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a7b3b77-7521-4daf-a9b9-2c83b0fd69f5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:31.135182 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a7b3b77-7521-4daf-a9b9-2c83b0fd69f5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:31.265258 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0a7b3b77-7521-4daf-a9b9-2c83b0fd69f5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:31.273415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0a7b3b77-7521-4daf-a9b9-2c83b0fd69f5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151847 Aug 30 15:01:31.273979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 834/1665] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:31 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:31.698296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8080fe8d-1f1e-4d0c-ab1f-e3887df4e975 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:31.698901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8080fe8d-1f1e-4d0c-ab1f-e3887df4e975 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:31.704890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8080fe8d-1f1e-4d0c-ab1f-e3887df4e975 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:31.705366 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8080fe8d-1f1e-4d0c-ab1f-e3887df4e975 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:31.705796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8080fe8d-1f1e-4d0c-ab1f-e3887df4e975 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:31.706474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8080fe8d-1f1e-4d0c-ab1f-e3887df4e975 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:31.706921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8080fe8d-1f1e-4d0c-ab1f-e3887df4e975 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:31.707367 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8080fe8d-1f1e-4d0c-ab1f-e3887df4e975 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:31.767135 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8080fe8d-1f1e-4d0c-ab1f-e3887df4e975 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:31.775544 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8080fe8d-1f1e-4d0c-ab1f-e3887df4e975 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:31.776978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8080fe8d-1f1e-4d0c-ab1f-e3887df4e975 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:31.778109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8080fe8d-1f1e-4d0c-ab1f-e3887df4e975 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084049 Aug 30 15:01:31.778666 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 832/1666] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:31 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:32.126153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-53e8ac26-4541-483e-a016-1cc9ff26b371 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:32.126763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-53e8ac26-4541-483e-a016-1cc9ff26b371 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:32.132820 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53e8ac26-4541-483e-a016-1cc9ff26b371 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:32.133296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53e8ac26-4541-483e-a016-1cc9ff26b371 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:32.133724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53e8ac26-4541-483e-a016-1cc9ff26b371 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:32.134405 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53e8ac26-4541-483e-a016-1cc9ff26b371 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:32.134851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53e8ac26-4541-483e-a016-1cc9ff26b371 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:32.135296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53e8ac26-4541-483e-a016-1cc9ff26b371 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:32.266896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-53e8ac26-4541-483e-a016-1cc9ff26b371 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:32.275177 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-53e8ac26-4541-483e-a016-1cc9ff26b371 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153751 Aug 30 15:01:32.275767 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 835/1667] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:32 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:32.293807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-17bd4bec-ac6e-4f9d-8bf0-fae8177c774a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:32.294417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-17bd4bec-ac6e-4f9d-8bf0-fae8177c774a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:32.301690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17bd4bec-ac6e-4f9d-8bf0-fae8177c774a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:32.302171 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17bd4bec-ac6e-4f9d-8bf0-fae8177c774a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:32.302598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17bd4bec-ac6e-4f9d-8bf0-fae8177c774a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:32.303309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17bd4bec-ac6e-4f9d-8bf0-fae8177c774a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:32.303760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17bd4bec-ac6e-4f9d-8bf0-fae8177c774a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:32.304179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17bd4bec-ac6e-4f9d-8bf0-fae8177c774a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:32.433923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-17bd4bec-ac6e-4f9d-8bf0-fae8177c774a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:32.442690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-17bd4bec-ac6e-4f9d-8bf0-fae8177c774a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152678 Aug 30 15:01:32.443357 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 833/1668] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:32 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:32.802164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3c7376d6-5eeb-4583-acbe-9a9e9b59730c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:32.802685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3c7376d6-5eeb-4583-acbe-9a9e9b59730c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:32.808560 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c7376d6-5eeb-4583-acbe-9a9e9b59730c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:32.809034 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c7376d6-5eeb-4583-acbe-9a9e9b59730c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:32.809457 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c7376d6-5eeb-4583-acbe-9a9e9b59730c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:32.810134 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c7376d6-5eeb-4583-acbe-9a9e9b59730c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:32.810609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c7376d6-5eeb-4583-acbe-9a9e9b59730c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:32.812097 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c7376d6-5eeb-4583-acbe-9a9e9b59730c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:32.876942 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3c7376d6-5eeb-4583-acbe-9a9e9b59730c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:32.885362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3c7376d6-5eeb-4583-acbe-9a9e9b59730c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:32.886812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3c7376d6-5eeb-4583-acbe-9a9e9b59730c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:32.887985 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3c7376d6-5eeb-4583-acbe-9a9e9b59730c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090261 Aug 30 15:01:32.888532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 836/1669] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:32 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:33.297624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-34543627-25c9-4773-a4f5-a4a40e2793fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:33.298199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-34543627-25c9-4773-a4f5-a4a40e2793fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:33.304402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34543627-25c9-4773-a4f5-a4a40e2793fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:33.304882 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34543627-25c9-4773-a4f5-a4a40e2793fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:33.305326 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34543627-25c9-4773-a4f5-a4a40e2793fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:33.306012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34543627-25c9-4773-a4f5-a4a40e2793fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:33.306466 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34543627-25c9-4773-a4f5-a4a40e2793fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:33.306889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34543627-25c9-4773-a4f5-a4a40e2793fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:33.433238 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-34543627-25c9-4773-a4f5-a4a40e2793fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:33.441646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-34543627-25c9-4773-a4f5-a4a40e2793fb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148778 Aug 30 15:01:33.442212 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 834/1670] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:33 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:33.464335 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cee5b89f-1414-42c5-b165-50755860d2f0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:33.464880 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cee5b89f-1414-42c5-b165-50755860d2f0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:33.471958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cee5b89f-1414-42c5-b165-50755860d2f0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:33.472428 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cee5b89f-1414-42c5-b165-50755860d2f0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:33.472853 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cee5b89f-1414-42c5-b165-50755860d2f0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:33.473538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cee5b89f-1414-42c5-b165-50755860d2f0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:33.473980 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cee5b89f-1414-42c5-b165-50755860d2f0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:33.474394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cee5b89f-1414-42c5-b165-50755860d2f0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:33.603656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cee5b89f-1414-42c5-b165-50755860d2f0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:33.611994 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cee5b89f-1414-42c5-b165-50755860d2f0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151441 Aug 30 15:01:33.612565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 837/1671] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:33 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:33.910613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-636d5bec-1078-40bc-ae3f-a131e62e956b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:33.911244 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-636d5bec-1078-40bc-ae3f-a131e62e956b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:33.917171 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636d5bec-1078-40bc-ae3f-a131e62e956b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:33.917645 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636d5bec-1078-40bc-ae3f-a131e62e956b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:33.918073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636d5bec-1078-40bc-ae3f-a131e62e956b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:33.918754 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636d5bec-1078-40bc-ae3f-a131e62e956b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:33.919200 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636d5bec-1078-40bc-ae3f-a131e62e956b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:33.919642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636d5bec-1078-40bc-ae3f-a131e62e956b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:33.983780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-636d5bec-1078-40bc-ae3f-a131e62e956b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:33.992183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-636d5bec-1078-40bc-ae3f-a131e62e956b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:33.993616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-636d5bec-1078-40bc-ae3f-a131e62e956b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:33.994786 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-636d5bec-1078-40bc-ae3f-a131e62e956b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088683 Aug 30 15:01:33.995377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 835/1672] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:33 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:34.463257 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c7f2f941-c03a-4f8a-aa6f-7ae32add90c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:34.463813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c7f2f941-c03a-4f8a-aa6f-7ae32add90c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:34.470402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c7f2f941-c03a-4f8a-aa6f-7ae32add90c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:34.471112 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c7f2f941-c03a-4f8a-aa6f-7ae32add90c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:34.471334 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c7f2f941-c03a-4f8a-aa6f-7ae32add90c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:34.472026 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c7f2f941-c03a-4f8a-aa6f-7ae32add90c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:34.472478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c7f2f941-c03a-4f8a-aa6f-7ae32add90c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:34.472904 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c7f2f941-c03a-4f8a-aa6f-7ae32add90c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:34.598899 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c7f2f941-c03a-4f8a-aa6f-7ae32add90c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:34.606947 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c7f2f941-c03a-4f8a-aa6f-7ae32add90c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147645 Aug 30 15:01:34.607545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 838/1673] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:34 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:34.632742 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-49889908-1b40-4330-9a0c-222385dc3f19 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:34.633343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-49889908-1b40-4330-9a0c-222385dc3f19 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:34.639594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49889908-1b40-4330-9a0c-222385dc3f19 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:34.640062 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49889908-1b40-4330-9a0c-222385dc3f19 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:34.641159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49889908-1b40-4330-9a0c-222385dc3f19 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:34.641840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49889908-1b40-4330-9a0c-222385dc3f19 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:34.642285 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49889908-1b40-4330-9a0c-222385dc3f19 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:34.642700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49889908-1b40-4330-9a0c-222385dc3f19 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:34.769611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-49889908-1b40-4330-9a0c-222385dc3f19 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:34.777625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-49889908-1b40-4330-9a0c-222385dc3f19 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148689 Aug 30 15:01:34.778196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 836/1674] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:34 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:35.019144 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-04be309d-a707-4dda-b560-2f9b6ad57a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:35.019778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-04be309d-a707-4dda-b560-2f9b6ad57a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:35.025668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04be309d-a707-4dda-b560-2f9b6ad57a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:35.026142 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04be309d-a707-4dda-b560-2f9b6ad57a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:35.026568 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04be309d-a707-4dda-b560-2f9b6ad57a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:35.027273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04be309d-a707-4dda-b560-2f9b6ad57a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:35.027720 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04be309d-a707-4dda-b560-2f9b6ad57a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:35.028133 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04be309d-a707-4dda-b560-2f9b6ad57a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:35.091992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-04be309d-a707-4dda-b560-2f9b6ad57a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:35.100900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-04be309d-a707-4dda-b560-2f9b6ad57a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:35.102426 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-04be309d-a707-4dda-b560-2f9b6ad57a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:35.103584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-04be309d-a707-4dda-b560-2f9b6ad57a8b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089500 Aug 30 15:01:35.104144 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 839/1675] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:35 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:35.628178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-52db9d9e-1db6-4516-a065-b641e90a5abd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:35.628789 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-52db9d9e-1db6-4516-a065-b641e90a5abd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:35.634764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52db9d9e-1db6-4516-a065-b641e90a5abd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:35.635344 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52db9d9e-1db6-4516-a065-b641e90a5abd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:35.635692 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52db9d9e-1db6-4516-a065-b641e90a5abd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:35.636374 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52db9d9e-1db6-4516-a065-b641e90a5abd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:35.636839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52db9d9e-1db6-4516-a065-b641e90a5abd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:35.637242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52db9d9e-1db6-4516-a065-b641e90a5abd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:35.762507 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-52db9d9e-1db6-4516-a065-b641e90a5abd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:35.771417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-52db9d9e-1db6-4516-a065-b641e90a5abd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147252 Aug 30 15:01:35.771986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 837/1676] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:35 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:35.799024 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-eeded038-27a3-43e8-a84c-993b710e4ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:35.799689 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-eeded038-27a3-43e8-a84c-993b710e4ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:35.805969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eeded038-27a3-43e8-a84c-993b710e4ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:35.806445 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eeded038-27a3-43e8-a84c-993b710e4ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:35.806874 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eeded038-27a3-43e8-a84c-993b710e4ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:35.807603 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eeded038-27a3-43e8-a84c-993b710e4ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:35.808052 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eeded038-27a3-43e8-a84c-993b710e4ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:35.808469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eeded038-27a3-43e8-a84c-993b710e4ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:35.934819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-eeded038-27a3-43e8-a84c-993b710e4ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:35.943153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-eeded038-27a3-43e8-a84c-993b710e4ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147927 Aug 30 15:01:35.943743 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 840/1677] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:35 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:36.127261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6a9910f6-90d5-49c0-a0ea-7c8e2b13a186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:36.127875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6a9910f6-90d5-49c0-a0ea-7c8e2b13a186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:36.133691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9910f6-90d5-49c0-a0ea-7c8e2b13a186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:36.134172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9910f6-90d5-49c0-a0ea-7c8e2b13a186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:36.134674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9910f6-90d5-49c0-a0ea-7c8e2b13a186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:36.135322 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9910f6-90d5-49c0-a0ea-7c8e2b13a186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:36.135780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9910f6-90d5-49c0-a0ea-7c8e2b13a186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:36.136204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a9910f6-90d5-49c0-a0ea-7c8e2b13a186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:36.140145 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:36.200777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6a9910f6-90d5-49c0-a0ea-7c8e2b13a186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:36.209501 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6a9910f6-90d5-49c0-a0ea-7c8e2b13a186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:36.210961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6a9910f6-90d5-49c0-a0ea-7c8e2b13a186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:36.212181 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6a9910f6-90d5-49c0-a0ea-7c8e2b13a186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089393 Aug 30 15:01:36.212674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 838/1678] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:36 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:36.792658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9550eaa5-d7f4-46f3-9afe-56d8fea8cbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:36.793259 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9550eaa5-d7f4-46f3-9afe-56d8fea8cbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:36.799691 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9550eaa5-d7f4-46f3-9afe-56d8fea8cbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:36.800307 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9550eaa5-d7f4-46f3-9afe-56d8fea8cbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:36.800579 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9550eaa5-d7f4-46f3-9afe-56d8fea8cbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:36.801469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9550eaa5-d7f4-46f3-9afe-56d8fea8cbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:36.801916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9550eaa5-d7f4-46f3-9afe-56d8fea8cbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:36.802335 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9550eaa5-d7f4-46f3-9afe-56d8fea8cbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:36.929158 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9550eaa5-d7f4-46f3-9afe-56d8fea8cbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:36.937232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9550eaa5-d7f4-46f3-9afe-56d8fea8cbc8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148436 Aug 30 15:01:36.937798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 841/1679] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:36 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:36.964612 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c81040a2-a62d-4194-a038-3f005995da0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:36.965221 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c81040a2-a62d-4194-a038-3f005995da0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:36.971852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c81040a2-a62d-4194-a038-3f005995da0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:36.972331 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c81040a2-a62d-4194-a038-3f005995da0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:36.972762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c81040a2-a62d-4194-a038-3f005995da0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:36.973445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c81040a2-a62d-4194-a038-3f005995da0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:36.973891 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c81040a2-a62d-4194-a038-3f005995da0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:36.974309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c81040a2-a62d-4194-a038-3f005995da0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:37.100764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c81040a2-a62d-4194-a038-3f005995da0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:37.115195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c81040a2-a62d-4194-a038-3f005995da0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.154310 Aug 30 15:01:37.116140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 839/1680] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:36 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:37.236079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fd2fce93-80f0-4c02-8913-543c26e6474a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:37.236686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fd2fce93-80f0-4c02-8913-543c26e6474a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:37.242581 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd2fce93-80f0-4c02-8913-543c26e6474a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:37.243054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd2fce93-80f0-4c02-8913-543c26e6474a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:37.243582 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd2fce93-80f0-4c02-8913-543c26e6474a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:37.244266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd2fce93-80f0-4c02-8913-543c26e6474a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:37.244709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd2fce93-80f0-4c02-8913-543c26e6474a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:37.245128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd2fce93-80f0-4c02-8913-543c26e6474a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:37.311845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fd2fce93-80f0-4c02-8913-543c26e6474a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:37.321125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fd2fce93-80f0-4c02-8913-543c26e6474a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:37.322814 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fd2fce93-80f0-4c02-8913-543c26e6474a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:37.323970 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fd2fce93-80f0-4c02-8913-543c26e6474a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.092262 Aug 30 15:01:37.324520 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 842/1681] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:37 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:37.958782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c22eb70d-c834-4505-a0cc-ef5be1c4087d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:37.959428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c22eb70d-c834-4505-a0cc-ef5be1c4087d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:37.965317 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c22eb70d-c834-4505-a0cc-ef5be1c4087d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:37.965886 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c22eb70d-c834-4505-a0cc-ef5be1c4087d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:37.966205 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c22eb70d-c834-4505-a0cc-ef5be1c4087d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:37.966880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c22eb70d-c834-4505-a0cc-ef5be1c4087d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:37.967353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c22eb70d-c834-4505-a0cc-ef5be1c4087d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:37.967779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c22eb70d-c834-4505-a0cc-ef5be1c4087d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:38.094259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c22eb70d-c834-4505-a0cc-ef5be1c4087d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:38.103163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c22eb70d-c834-4505-a0cc-ef5be1c4087d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148228 Aug 30 15:01:38.103743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 840/1682] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:37 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:38.136847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c00ee7b0-7f54-4393-82aa-021cdbf7c632 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:38.137481 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c00ee7b0-7f54-4393-82aa-021cdbf7c632 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:38.144660 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c00ee7b0-7f54-4393-82aa-021cdbf7c632 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:38.145149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c00ee7b0-7f54-4393-82aa-021cdbf7c632 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:38.145562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c00ee7b0-7f54-4393-82aa-021cdbf7c632 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:38.146235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c00ee7b0-7f54-4393-82aa-021cdbf7c632 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:38.146680 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c00ee7b0-7f54-4393-82aa-021cdbf7c632 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:38.147095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c00ee7b0-7f54-4393-82aa-021cdbf7c632 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:38.257217 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:01:38.257455 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:01:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 (ip 10.222.0.30) !!! Aug 30 15:01:38.258770 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:01:38.259003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:01:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 (ip 10.222.0.30) !!! Aug 30 15:01:38.260718 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:01:38.260841 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:01:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 (ip 10.222.0.30) !!! Aug 30 15:01:38.276983 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c00ee7b0-7f54-4393-82aa-021cdbf7c632 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:38.285567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c00ee7b0-7f54-4393-82aa-021cdbf7c632 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152529 Aug 30 15:01:38.286120 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 843/1683] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:38 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:38.346828 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-28452025-d537-4260-bc68-e537b4fe700c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:38.347447 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-28452025-d537-4260-bc68-e537b4fe700c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:38.353255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28452025-d537-4260-bc68-e537b4fe700c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:38.353725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28452025-d537-4260-bc68-e537b4fe700c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:38.354148 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28452025-d537-4260-bc68-e537b4fe700c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:38.354820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28452025-d537-4260-bc68-e537b4fe700c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:38.355282 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28452025-d537-4260-bc68-e537b4fe700c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:38.355698 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28452025-d537-4260-bc68-e537b4fe700c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:38.419313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-28452025-d537-4260-bc68-e537b4fe700c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:38.427710 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-28452025-d537-4260-bc68-e537b4fe700c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:38.429142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-28452025-d537-4260-bc68-e537b4fe700c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:38.430263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-28452025-d537-4260-bc68-e537b4fe700c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087998 Aug 30 15:01:38.430816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 841/1684] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:38 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:39.123965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c56d0563-8372-4f21-8c36-0a9b6fcc0382 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:39.124567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c56d0563-8372-4f21-8c36-0a9b6fcc0382 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:39.131165 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c56d0563-8372-4f21-8c36-0a9b6fcc0382 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:39.132040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c56d0563-8372-4f21-8c36-0a9b6fcc0382 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:39.132466 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c56d0563-8372-4f21-8c36-0a9b6fcc0382 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:39.133150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c56d0563-8372-4f21-8c36-0a9b6fcc0382 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:39.133596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c56d0563-8372-4f21-8c36-0a9b6fcc0382 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:39.134013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c56d0563-8372-4f21-8c36-0a9b6fcc0382 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:39.152912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:39.269047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c56d0563-8372-4f21-8c36-0a9b6fcc0382 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:39.277821 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c56d0563-8372-4f21-8c36-0a9b6fcc0382 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.157676 Aug 30 15:01:39.278378 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 844/1685] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:39 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:39.305986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-18cdd37c-2bed-4e5a-b735-42a43243e1ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:39.306595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-18cdd37c-2bed-4e5a-b735-42a43243e1ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:39.308819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:01:39.308949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 15:01:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 (ip 10.222.0.30) !!! Aug 30 15:01:39.309955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:01:39.310069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 15:01:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 (ip 10.222.0.30) !!! Aug 30 15:01:39.317663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18cdd37c-2bed-4e5a-b735-42a43243e1ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:39.318144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18cdd37c-2bed-4e5a-b735-42a43243e1ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:39.318575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18cdd37c-2bed-4e5a-b735-42a43243e1ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:39.319330 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18cdd37c-2bed-4e5a-b735-42a43243e1ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:39.319780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18cdd37c-2bed-4e5a-b735-42a43243e1ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:39.320202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-18cdd37c-2bed-4e5a-b735-42a43243e1ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:39.453474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b7ab31ad-160f-42f6-8b63-02f63f23ea00 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:39.453990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b7ab31ad-160f-42f6-8b63-02f63f23ea00 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:39.460759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7ab31ad-160f-42f6-8b63-02f63f23ea00 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:39.461239 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7ab31ad-160f-42f6-8b63-02f63f23ea00 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:39.461746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7ab31ad-160f-42f6-8b63-02f63f23ea00 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:39.462450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7ab31ad-160f-42f6-8b63-02f63f23ea00 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:39.462894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7ab31ad-160f-42f6-8b63-02f63f23ea00 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:39.463332 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7ab31ad-160f-42f6-8b63-02f63f23ea00 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:39.530747 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b7ab31ad-160f-42f6-8b63-02f63f23ea00 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:39.540163 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b7ab31ad-160f-42f6-8b63-02f63f23ea00 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:39.541617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b7ab31ad-160f-42f6-8b63-02f63f23ea00 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:39.542800 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b7ab31ad-160f-42f6-8b63-02f63f23ea00 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.093420 Aug 30 15:01:39.543379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 845/1686] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:39 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:01:39.687391 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-18cdd37c-2bed-4e5a-b735-42a43243e1ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:39.696231 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-18cdd37c-2bed-4e5a-b735-42a43243e1ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.394205 Aug 30 15:01:39.697163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 842/1687] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:39 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:40.300625 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8d13a0c4-0da8-42ff-934a-6358de07fbe2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:40.301242 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8d13a0c4-0da8-42ff-934a-6358de07fbe2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:40.307865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d13a0c4-0da8-42ff-934a-6358de07fbe2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:40.308342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d13a0c4-0da8-42ff-934a-6358de07fbe2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:40.308772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d13a0c4-0da8-42ff-934a-6358de07fbe2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:40.309465 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d13a0c4-0da8-42ff-934a-6358de07fbe2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:40.309912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d13a0c4-0da8-42ff-934a-6358de07fbe2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:40.310325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8d13a0c4-0da8-42ff-934a-6358de07fbe2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:40.441862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8d13a0c4-0da8-42ff-934a-6358de07fbe2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:40.450552 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8d13a0c4-0da8-42ff-934a-6358de07fbe2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.154956 Aug 30 15:01:40.451113 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 846/1688] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:40 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:40.566827 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5769a118-61b1-4cd0-aa21-e85df3c782d9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:40.567481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5769a118-61b1-4cd0-aa21-e85df3c782d9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:40.574268 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5769a118-61b1-4cd0-aa21-e85df3c782d9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:40.574738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5769a118-61b1-4cd0-aa21-e85df3c782d9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:40.575168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5769a118-61b1-4cd0-aa21-e85df3c782d9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:40.575874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5769a118-61b1-4cd0-aa21-e85df3c782d9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:40.576318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5769a118-61b1-4cd0-aa21-e85df3c782d9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:40.576733 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5769a118-61b1-4cd0-aa21-e85df3c782d9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:40.637237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5769a118-61b1-4cd0-aa21-e85df3c782d9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:40.646226 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5769a118-61b1-4cd0-aa21-e85df3c782d9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:40.647714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5769a118-61b1-4cd0-aa21-e85df3c782d9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:40.648879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5769a118-61b1-4cd0-aa21-e85df3c782d9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086955 Aug 30 15:01:40.649431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 843/1689] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:40 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:40.717812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-32b86c51-4572-42df-a8e7-f084298bbf81 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:40.718423 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-32b86c51-4572-42df-a8e7-f084298bbf81 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:40.724809 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32b86c51-4572-42df-a8e7-f084298bbf81 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:40.725289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32b86c51-4572-42df-a8e7-f084298bbf81 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:40.725725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32b86c51-4572-42df-a8e7-f084298bbf81 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:40.726411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32b86c51-4572-42df-a8e7-f084298bbf81 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:40.726858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32b86c51-4572-42df-a8e7-f084298bbf81 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:40.727300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32b86c51-4572-42df-a8e7-f084298bbf81 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:40.856734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-32b86c51-4572-42df-a8e7-f084298bbf81 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:40.864830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-32b86c51-4572-42df-a8e7-f084298bbf81 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150830 Aug 30 15:01:40.865400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 847/1690] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:40 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:41.471938 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1eb98f2d-25b2-4f4f-9811-1b33fd25fe4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:41.472470 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1eb98f2d-25b2-4f4f-9811-1b33fd25fe4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:41.478330 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1eb98f2d-25b2-4f4f-9811-1b33fd25fe4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:41.478840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1eb98f2d-25b2-4f4f-9811-1b33fd25fe4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:41.479309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1eb98f2d-25b2-4f4f-9811-1b33fd25fe4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:41.479999 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1eb98f2d-25b2-4f4f-9811-1b33fd25fe4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:41.480449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1eb98f2d-25b2-4f4f-9811-1b33fd25fe4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:41.480873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1eb98f2d-25b2-4f4f-9811-1b33fd25fe4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:41.607570 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1eb98f2d-25b2-4f4f-9811-1b33fd25fe4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:41.616182 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1eb98f2d-25b2-4f4f-9811-1b33fd25fe4e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149001 Aug 30 15:01:41.616744 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 844/1691] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:41 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:41.671912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f53fa959-7fd5-4829-a76b-d19332af584b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:41.672554 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f53fa959-7fd5-4829-a76b-d19332af584b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:41.679782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f53fa959-7fd5-4829-a76b-d19332af584b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:41.680287 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f53fa959-7fd5-4829-a76b-d19332af584b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:41.680723 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f53fa959-7fd5-4829-a76b-d19332af584b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:41.681412 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f53fa959-7fd5-4829-a76b-d19332af584b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:41.681865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f53fa959-7fd5-4829-a76b-d19332af584b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:41.682288 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f53fa959-7fd5-4829-a76b-d19332af584b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:41.746374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f53fa959-7fd5-4829-a76b-d19332af584b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:41.754968 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f53fa959-7fd5-4829-a76b-d19332af584b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:41.756460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f53fa959-7fd5-4829-a76b-d19332af584b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:41.757597 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f53fa959-7fd5-4829-a76b-d19332af584b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089578 Aug 30 15:01:41.758158 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 848/1692] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:41 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:41.886040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-70da6bef-64fc-46bc-bef3-69e4d02afd20 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:41.886650 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-70da6bef-64fc-46bc-bef3-69e4d02afd20 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:41.893276 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70da6bef-64fc-46bc-bef3-69e4d02afd20 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:41.893754 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70da6bef-64fc-46bc-bef3-69e4d02afd20 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:41.894189 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70da6bef-64fc-46bc-bef3-69e4d02afd20 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:41.894872 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70da6bef-64fc-46bc-bef3-69e4d02afd20 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:41.895353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70da6bef-64fc-46bc-bef3-69e4d02afd20 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:41.895777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70da6bef-64fc-46bc-bef3-69e4d02afd20 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:42.021197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-70da6bef-64fc-46bc-bef3-69e4d02afd20 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:42.029344 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-70da6bef-64fc-46bc-bef3-69e4d02afd20 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147127 Aug 30 15:01:42.029903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 845/1693] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:41 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:42.637870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a5b825eb-6c0b-4533-9113-6cadd05cb847 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:42.638482 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a5b825eb-6c0b-4533-9113-6cadd05cb847 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:42.644720 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5b825eb-6c0b-4533-9113-6cadd05cb847 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:42.645710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5b825eb-6c0b-4533-9113-6cadd05cb847 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:42.646203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5b825eb-6c0b-4533-9113-6cadd05cb847 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:42.647167 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5b825eb-6c0b-4533-9113-6cadd05cb847 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:42.647653 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5b825eb-6c0b-4533-9113-6cadd05cb847 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:42.648082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5b825eb-6c0b-4533-9113-6cadd05cb847 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:42.778269 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a5b825eb-6c0b-4533-9113-6cadd05cb847 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:42.781877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7cb7e867-21d2-4c77-ae2f-76b5d20ee80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:42.782522 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7cb7e867-21d2-4c77-ae2f-76b5d20ee80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:42.786639 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a5b825eb-6c0b-4533-9113-6cadd05cb847 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152848 Aug 30 15:01:42.787220 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 849/1694] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:42 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:42.788738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cb7e867-21d2-4c77-ae2f-76b5d20ee80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:42.789345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cb7e867-21d2-4c77-ae2f-76b5d20ee80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:42.790194 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cb7e867-21d2-4c77-ae2f-76b5d20ee80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:42.790898 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cb7e867-21d2-4c77-ae2f-76b5d20ee80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:42.791551 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cb7e867-21d2-4c77-ae2f-76b5d20ee80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:42.792142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cb7e867-21d2-4c77-ae2f-76b5d20ee80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:42.857209 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7cb7e867-21d2-4c77-ae2f-76b5d20ee80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:42.866682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7cb7e867-21d2-4c77-ae2f-76b5d20ee80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:42.868145 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7cb7e867-21d2-4c77-ae2f-76b5d20ee80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:42.869305 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7cb7e867-21d2-4c77-ae2f-76b5d20ee80d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091269 Aug 30 15:01:42.869869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 846/1695] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:42 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:01:43.049758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6c83398c-4708-427d-82a8-2ea63128324a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:43.050369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6c83398c-4708-427d-82a8-2ea63128324a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:43.056239 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c83398c-4708-427d-82a8-2ea63128324a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:43.056716 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c83398c-4708-427d-82a8-2ea63128324a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:43.057149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c83398c-4708-427d-82a8-2ea63128324a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:43.057832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c83398c-4708-427d-82a8-2ea63128324a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:43.058282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c83398c-4708-427d-82a8-2ea63128324a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:43.058720 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c83398c-4708-427d-82a8-2ea63128324a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:43.191495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6c83398c-4708-427d-82a8-2ea63128324a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:43.199865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6c83398c-4708-427d-82a8-2ea63128324a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153992 Aug 30 15:01:43.200427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 850/1696] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:43 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:43.807029 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c8ef7836-5f7e-47fd-87e9-5900858be8a1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:43.807662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c8ef7836-5f7e-47fd-87e9-5900858be8a1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:43.814172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8ef7836-5f7e-47fd-87e9-5900858be8a1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:43.814654 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8ef7836-5f7e-47fd-87e9-5900858be8a1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:43.815092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8ef7836-5f7e-47fd-87e9-5900858be8a1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:43.815819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8ef7836-5f7e-47fd-87e9-5900858be8a1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:43.816273 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8ef7836-5f7e-47fd-87e9-5900858be8a1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:43.816698 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8ef7836-5f7e-47fd-87e9-5900858be8a1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:43.892920 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9a77132d-ac9c-49a7-8fbf-229bb92b4d20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:43.893532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9a77132d-ac9c-49a7-8fbf-229bb92b4d20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:43.900161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a77132d-ac9c-49a7-8fbf-229bb92b4d20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:43.900641 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a77132d-ac9c-49a7-8fbf-229bb92b4d20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:43.901074 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a77132d-ac9c-49a7-8fbf-229bb92b4d20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:43.901770 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a77132d-ac9c-49a7-8fbf-229bb92b4d20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:43.902219 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a77132d-ac9c-49a7-8fbf-229bb92b4d20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:43.902639 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a77132d-ac9c-49a7-8fbf-229bb92b4d20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:43.950570 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c8ef7836-5f7e-47fd-87e9-5900858be8a1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:43.959307 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c8ef7836-5f7e-47fd-87e9-5900858be8a1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.156168 Aug 30 15:01:43.959881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 847/1697] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:43 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:43.970902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9a77132d-ac9c-49a7-8fbf-229bb92b4d20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:43.979563 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9a77132d-ac9c-49a7-8fbf-229bb92b4d20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:43.981017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9a77132d-ac9c-49a7-8fbf-229bb92b4d20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:43.982160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9a77132d-ac9c-49a7-8fbf-229bb92b4d20 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.093435 Aug 30 15:01:43.982709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 851/1698] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:43 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:01:44.221157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-49afb177-4774-4365-9134-e446abc9f5ce tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:44.221761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-49afb177-4774-4365-9134-e446abc9f5ce tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:44.227705 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49afb177-4774-4365-9134-e446abc9f5ce tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:44.228224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49afb177-4774-4365-9134-e446abc9f5ce tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:44.228640 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49afb177-4774-4365-9134-e446abc9f5ce tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:44.229358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49afb177-4774-4365-9134-e446abc9f5ce tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:44.229807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49afb177-4774-4365-9134-e446abc9f5ce tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:44.230227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49afb177-4774-4365-9134-e446abc9f5ce tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:44.358562 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-49afb177-4774-4365-9134-e446abc9f5ce tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:44.367349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-49afb177-4774-4365-9134-e446abc9f5ce tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150059 Aug 30 15:01:44.367921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 848/1699] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:44 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:44.979973 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f2589d78-69bd-480f-940c-e036009c97a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:44.980582 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f2589d78-69bd-480f-940c-e036009c97a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:44.987131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2589d78-69bd-480f-940c-e036009c97a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:44.987645 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2589d78-69bd-480f-940c-e036009c97a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:44.988080 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2589d78-69bd-480f-940c-e036009c97a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:44.988770 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2589d78-69bd-480f-940c-e036009c97a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:44.989220 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2589d78-69bd-480f-940c-e036009c97a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:44.989637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f2589d78-69bd-480f-940c-e036009c97a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:45.005221 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ffbd1495-00dc-440f-bfca-8614d6e76eb1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:45.005881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ffbd1495-00dc-440f-bfca-8614d6e76eb1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:45.012097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffbd1495-00dc-440f-bfca-8614d6e76eb1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:45.012569 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffbd1495-00dc-440f-bfca-8614d6e76eb1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:45.012997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffbd1495-00dc-440f-bfca-8614d6e76eb1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:45.013673 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffbd1495-00dc-440f-bfca-8614d6e76eb1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:45.014118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffbd1495-00dc-440f-bfca-8614d6e76eb1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:45.014534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffbd1495-00dc-440f-bfca-8614d6e76eb1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:45.076819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ffbd1495-00dc-440f-bfca-8614d6e76eb1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:45.086023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ffbd1495-00dc-440f-bfca-8614d6e76eb1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:45.087483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ffbd1495-00dc-440f-bfca-8614d6e76eb1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:45.088667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ffbd1495-00dc-440f-bfca-8614d6e76eb1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087568 Aug 30 15:01:45.089226 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 849/1700] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:45 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:01:45.120499 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f2589d78-69bd-480f-940c-e036009c97a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:45.129217 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f2589d78-69bd-480f-940c-e036009c97a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153110 Aug 30 15:01:45.129777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 852/1701] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:44 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:45.388207 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f4dc61ad-9718-4743-a3ee-5a9eadd6f12a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:45.388810 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f4dc61ad-9718-4743-a3ee-5a9eadd6f12a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:45.395445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4dc61ad-9718-4743-a3ee-5a9eadd6f12a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:45.395921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4dc61ad-9718-4743-a3ee-5a9eadd6f12a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:45.396349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4dc61ad-9718-4743-a3ee-5a9eadd6f12a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:45.397027 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4dc61ad-9718-4743-a3ee-5a9eadd6f12a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:45.397473 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4dc61ad-9718-4743-a3ee-5a9eadd6f12a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:45.397888 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4dc61ad-9718-4743-a3ee-5a9eadd6f12a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:45.530811 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f4dc61ad-9718-4743-a3ee-5a9eadd6f12a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:45.539420 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f4dc61ad-9718-4743-a3ee-5a9eadd6f12a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.155013 Aug 30 15:01:45.539991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 850/1702] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:45 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:46.112407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-565fb672-00db-464b-be05-502795c95197 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:46.113054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-565fb672-00db-464b-be05-502795c95197 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:46.119464 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-565fb672-00db-464b-be05-502795c95197 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:46.120019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-565fb672-00db-464b-be05-502795c95197 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:46.120376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-565fb672-00db-464b-be05-502795c95197 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:46.121064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-565fb672-00db-464b-be05-502795c95197 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:46.121513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-565fb672-00db-464b-be05-502795c95197 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:46.121930 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-565fb672-00db-464b-be05-502795c95197 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:46.150168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-34c04bdd-e7c5-4a89-81a6-c007305691eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:46.150775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-34c04bdd-e7c5-4a89-81a6-c007305691eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:46.157253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34c04bdd-e7c5-4a89-81a6-c007305691eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:46.157732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34c04bdd-e7c5-4a89-81a6-c007305691eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:46.158164 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34c04bdd-e7c5-4a89-81a6-c007305691eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:46.158852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34c04bdd-e7c5-4a89-81a6-c007305691eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:46.159870 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34c04bdd-e7c5-4a89-81a6-c007305691eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:46.160378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-34c04bdd-e7c5-4a89-81a6-c007305691eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:46.184105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-565fb672-00db-464b-be05-502795c95197 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:46.192584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-565fb672-00db-464b-be05-502795c95197 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:46.194044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-565fb672-00db-464b-be05-502795c95197 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:46.195231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-565fb672-00db-464b-be05-502795c95197 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087358 Aug 30 15:01:46.195796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 853/1703] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:46 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:46.288212 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-34c04bdd-e7c5-4a89-81a6-c007305691eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:46.296453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-34c04bdd-e7c5-4a89-81a6-c007305691eb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150198 Aug 30 15:01:46.297018 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 851/1704] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:46 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:01:46.560648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fdfe77e7-bc4c-49d8-8a87-c9d9c9990b30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:46.561281 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fdfe77e7-bc4c-49d8-8a87-c9d9c9990b30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:46.567737 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fdfe77e7-bc4c-49d8-8a87-c9d9c9990b30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:46.568214 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fdfe77e7-bc4c-49d8-8a87-c9d9c9990b30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:46.568641 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fdfe77e7-bc4c-49d8-8a87-c9d9c9990b30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:46.569339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fdfe77e7-bc4c-49d8-8a87-c9d9c9990b30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:46.569771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fdfe77e7-bc4c-49d8-8a87-c9d9c9990b30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:46.570186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fdfe77e7-bc4c-49d8-8a87-c9d9c9990b30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:46.699380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fdfe77e7-bc4c-49d8-8a87-c9d9c9990b30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:46.708152 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fdfe77e7-bc4c-49d8-8a87-c9d9c9990b30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151374 Aug 30 15:01:46.708722 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 854/1705] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:46 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:47.217902 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-795cf861-398f-406b-92db-7eac092c44cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:47.218508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-795cf861-398f-406b-92db-7eac092c44cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:47.225010 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-795cf861-398f-406b-92db-7eac092c44cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:47.225479 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-795cf861-398f-406b-92db-7eac092c44cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:47.225904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-795cf861-398f-406b-92db-7eac092c44cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:47.226580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-795cf861-398f-406b-92db-7eac092c44cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:47.227038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-795cf861-398f-406b-92db-7eac092c44cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:47.227535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-795cf861-398f-406b-92db-7eac092c44cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:47.290998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-795cf861-398f-406b-92db-7eac092c44cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:47.299470 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-795cf861-398f-406b-92db-7eac092c44cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:47.301444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-795cf861-398f-406b-92db-7eac092c44cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:47.302575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-795cf861-398f-406b-92db-7eac092c44cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088591 Aug 30 15:01:47.303132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 852/1706] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:47 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:47.319167 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fe5c253b-584e-4b38-b14c-6fcfc21594fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:47.319823 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fe5c253b-584e-4b38-b14c-6fcfc21594fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:47.326520 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe5c253b-584e-4b38-b14c-6fcfc21594fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:47.326994 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe5c253b-584e-4b38-b14c-6fcfc21594fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:47.327537 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe5c253b-584e-4b38-b14c-6fcfc21594fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:47.328224 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe5c253b-584e-4b38-b14c-6fcfc21594fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:47.328671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe5c253b-584e-4b38-b14c-6fcfc21594fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:47.329118 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe5c253b-584e-4b38-b14c-6fcfc21594fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:47.454169 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fe5c253b-584e-4b38-b14c-6fcfc21594fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:47.462248 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fe5c253b-584e-4b38-b14c-6fcfc21594fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147974 Aug 30 15:01:47.462754 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 855/1707] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:47 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:47.728770 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-96979064-488e-43d8-bf56-f2dc4fae61ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:47.729302 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-96979064-488e-43d8-bf56-f2dc4fae61ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:47.735196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96979064-488e-43d8-bf56-f2dc4fae61ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:47.735702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96979064-488e-43d8-bf56-f2dc4fae61ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:47.736137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96979064-488e-43d8-bf56-f2dc4fae61ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:47.736829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96979064-488e-43d8-bf56-f2dc4fae61ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:47.737312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96979064-488e-43d8-bf56-f2dc4fae61ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:47.737731 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96979064-488e-43d8-bf56-f2dc4fae61ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:47.861943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-96979064-488e-43d8-bf56-f2dc4fae61ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:47.870135 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-96979064-488e-43d8-bf56-f2dc4fae61ab tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.145308 Aug 30 15:01:47.870707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 853/1708] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:47 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:48.325593 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a0025ec0-4ba7-4a6e-9cbf-e8ed1404fbab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:48.326209 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a0025ec0-4ba7-4a6e-9cbf-e8ed1404fbab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:48.333416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0025ec0-4ba7-4a6e-9cbf-e8ed1404fbab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:48.333901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0025ec0-4ba7-4a6e-9cbf-e8ed1404fbab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:48.334339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0025ec0-4ba7-4a6e-9cbf-e8ed1404fbab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:48.335033 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0025ec0-4ba7-4a6e-9cbf-e8ed1404fbab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:48.335527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0025ec0-4ba7-4a6e-9cbf-e8ed1404fbab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:48.335955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a0025ec0-4ba7-4a6e-9cbf-e8ed1404fbab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:48.402710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a0025ec0-4ba7-4a6e-9cbf-e8ed1404fbab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:48.411227 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a0025ec0-4ba7-4a6e-9cbf-e8ed1404fbab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:48.412682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a0025ec0-4ba7-4a6e-9cbf-e8ed1404fbab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:48.413819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a0025ec0-4ba7-4a6e-9cbf-e8ed1404fbab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.092415 Aug 30 15:01:48.414380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 856/1709] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:48 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:48.483591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0cdf8c4a-9118-4d2d-935d-8de17422d40b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:48.484149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0cdf8c4a-9118-4d2d-935d-8de17422d40b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:48.491180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cdf8c4a-9118-4d2d-935d-8de17422d40b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:48.491697 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cdf8c4a-9118-4d2d-935d-8de17422d40b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:48.492124 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cdf8c4a-9118-4d2d-935d-8de17422d40b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:48.492799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cdf8c4a-9118-4d2d-935d-8de17422d40b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:48.493243 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cdf8c4a-9118-4d2d-935d-8de17422d40b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:48.493658 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cdf8c4a-9118-4d2d-935d-8de17422d40b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:48.619829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0cdf8c4a-9118-4d2d-935d-8de17422d40b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:48.623187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:48.629905 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0cdf8c4a-9118-4d2d-935d-8de17422d40b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150249 Aug 30 15:01:48.630485 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 854/1710] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:48 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:48.891640 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d5ab9531-3d5b-40a6-a94e-ce6a79beebb3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:48.892253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d5ab9531-3d5b-40a6-a94e-ce6a79beebb3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:48.898140 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5ab9531-3d5b-40a6-a94e-ce6a79beebb3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:48.898618 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5ab9531-3d5b-40a6-a94e-ce6a79beebb3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:48.899053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5ab9531-3d5b-40a6-a94e-ce6a79beebb3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:48.899788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5ab9531-3d5b-40a6-a94e-ce6a79beebb3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:48.900236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5ab9531-3d5b-40a6-a94e-ce6a79beebb3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:48.900654 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d5ab9531-3d5b-40a6-a94e-ce6a79beebb3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:49.029318 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d5ab9531-3d5b-40a6-a94e-ce6a79beebb3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:49.038169 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d5ab9531-3d5b-40a6-a94e-ce6a79beebb3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150440 Aug 30 15:01:49.038738 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 857/1711] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:48 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:49.435500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7378280a-88cf-42a9-bac8-4d277665baed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:49.436106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7378280a-88cf-42a9-bac8-4d277665baed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:49.442657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7378280a-88cf-42a9-bac8-4d277665baed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:49.443131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7378280a-88cf-42a9-bac8-4d277665baed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:49.443583 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7378280a-88cf-42a9-bac8-4d277665baed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:49.444256 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7378280a-88cf-42a9-bac8-4d277665baed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:49.444697 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7378280a-88cf-42a9-bac8-4d277665baed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:49.445110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7378280a-88cf-42a9-bac8-4d277665baed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:49.509358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7378280a-88cf-42a9-bac8-4d277665baed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:49.517926 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7378280a-88cf-42a9-bac8-4d277665baed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:49.520235 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7378280a-88cf-42a9-bac8-4d277665baed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:49.521394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7378280a-88cf-42a9-bac8-4d277665baed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090152 Aug 30 15:01:49.521962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 855/1712] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:49 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:49.650515 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-44b53c85-d4dd-491d-9505-7da32f93c311 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:49.651154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-44b53c85-d4dd-491d-9505-7da32f93c311 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:49.657412 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44b53c85-d4dd-491d-9505-7da32f93c311 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:49.657890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44b53c85-d4dd-491d-9505-7da32f93c311 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:49.658319 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44b53c85-d4dd-491d-9505-7da32f93c311 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:49.659648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44b53c85-d4dd-491d-9505-7da32f93c311 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:49.660334 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44b53c85-d4dd-491d-9505-7da32f93c311 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:49.660786 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44b53c85-d4dd-491d-9505-7da32f93c311 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:49.790927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-44b53c85-d4dd-491d-9505-7da32f93c311 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:49.799293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-44b53c85-d4dd-491d-9505-7da32f93c311 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152453 Aug 30 15:01:49.799744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 858/1713] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:49 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:50.059262 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-479f75c1-f234-4b06-9a1b-6b203c581931 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:50.059877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-479f75c1-f234-4b06-9a1b-6b203c581931 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:50.066359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479f75c1-f234-4b06-9a1b-6b203c581931 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:50.066877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479f75c1-f234-4b06-9a1b-6b203c581931 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:50.067409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479f75c1-f234-4b06-9a1b-6b203c581931 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:50.068100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479f75c1-f234-4b06-9a1b-6b203c581931 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:50.068548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479f75c1-f234-4b06-9a1b-6b203c581931 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:50.068968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479f75c1-f234-4b06-9a1b-6b203c581931 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:50.193197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-479f75c1-f234-4b06-9a1b-6b203c581931 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:50.201775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-479f75c1-f234-4b06-9a1b-6b203c581931 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.146342 Aug 30 15:01:50.202377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 856/1714] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:50 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:50.544965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-81e608ac-5c01-4612-8314-6c85eb5404a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:50.545706 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-81e608ac-5c01-4612-8314-6c85eb5404a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:50.552130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81e608ac-5c01-4612-8314-6c85eb5404a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:50.552603 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81e608ac-5c01-4612-8314-6c85eb5404a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:50.553027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81e608ac-5c01-4612-8314-6c85eb5404a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:50.553706 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81e608ac-5c01-4612-8314-6c85eb5404a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:50.554146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81e608ac-5c01-4612-8314-6c85eb5404a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:50.554563 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81e608ac-5c01-4612-8314-6c85eb5404a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:50.615906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-81e608ac-5c01-4612-8314-6c85eb5404a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:50.624344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-81e608ac-5c01-4612-8314-6c85eb5404a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:50.625777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-81e608ac-5c01-4612-8314-6c85eb5404a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:50.626901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-81e608ac-5c01-4612-8314-6c85eb5404a0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086043 Aug 30 15:01:50.627487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 859/1715] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:50 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:50.820441 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cffc9c7c-5f74-4101-b1a4-88365d199ee7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:50.821050 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cffc9c7c-5f74-4101-b1a4-88365d199ee7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:50.827202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cffc9c7c-5f74-4101-b1a4-88365d199ee7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:50.827708 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cffc9c7c-5f74-4101-b1a4-88365d199ee7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:50.828141 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cffc9c7c-5f74-4101-b1a4-88365d199ee7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:50.828826 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cffc9c7c-5f74-4101-b1a4-88365d199ee7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:50.829274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cffc9c7c-5f74-4101-b1a4-88365d199ee7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:50.829693 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cffc9c7c-5f74-4101-b1a4-88365d199ee7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:50.958161 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cffc9c7c-5f74-4101-b1a4-88365d199ee7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:50.966266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cffc9c7c-5f74-4101-b1a4-88365d199ee7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150046 Aug 30 15:01:50.966828 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 857/1716] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:50 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:51.224740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1b2003b0-cd06-40b2-b489-c6e4b6b22b0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:51.225352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1b2003b0-cd06-40b2-b489-c6e4b6b22b0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:51.231760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b2003b0-cd06-40b2-b489-c6e4b6b22b0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:51.232234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b2003b0-cd06-40b2-b489-c6e4b6b22b0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:51.232663 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b2003b0-cd06-40b2-b489-c6e4b6b22b0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:51.233349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b2003b0-cd06-40b2-b489-c6e4b6b22b0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:51.233798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b2003b0-cd06-40b2-b489-c6e4b6b22b0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:51.234219 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1b2003b0-cd06-40b2-b489-c6e4b6b22b0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:51.366094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1b2003b0-cd06-40b2-b489-c6e4b6b22b0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:51.374237 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1b2003b0-cd06-40b2-b489-c6e4b6b22b0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153975 Aug 30 15:01:51.374811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 860/1717] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:51 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:51.650477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9331ca40-10a8-42c6-bcf0-2359cff5ecdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:51.651086 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9331ca40-10a8-42c6-bcf0-2359cff5ecdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:51.652977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=78 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:51.658062 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9331ca40-10a8-42c6-bcf0-2359cff5ecdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:51.658580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9331ca40-10a8-42c6-bcf0-2359cff5ecdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:51.659015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9331ca40-10a8-42c6-bcf0-2359cff5ecdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:51.659746 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9331ca40-10a8-42c6-bcf0-2359cff5ecdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:51.660197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9331ca40-10a8-42c6-bcf0-2359cff5ecdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:51.660616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9331ca40-10a8-42c6-bcf0-2359cff5ecdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:51.724467 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9331ca40-10a8-42c6-bcf0-2359cff5ecdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:51.732953 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9331ca40-10a8-42c6-bcf0-2359cff5ecdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:51.734388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9331ca40-10a8-42c6-bcf0-2359cff5ecdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:51.735591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9331ca40-10a8-42c6-bcf0-2359cff5ecdc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089065 Aug 30 15:01:51.736159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 858/1718] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:51 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:51.988491 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bdfc0629-b095-4d83-8c84-96e1281aa29f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:51.989020 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bdfc0629-b095-4d83-8c84-96e1281aa29f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:51.990881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=80 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:51.996375 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdfc0629-b095-4d83-8c84-96e1281aa29f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:51.996855 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdfc0629-b095-4d83-8c84-96e1281aa29f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:51.997283 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdfc0629-b095-4d83-8c84-96e1281aa29f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:51.997971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdfc0629-b095-4d83-8c84-96e1281aa29f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:51.998417 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdfc0629-b095-4d83-8c84-96e1281aa29f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:51.998830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdfc0629-b095-4d83-8c84-96e1281aa29f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:52.002887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:01:52.126203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bdfc0629-b095-4d83-8c84-96e1281aa29f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:52.135296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bdfc0629-b095-4d83-8c84-96e1281aa29f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151321 Aug 30 15:01:52.135859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 861/1719] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:51 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:52.395589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f9d4232a-dd57-41a3-8bd2-b55e1d20f4b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:52.396196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f9d4232a-dd57-41a3-8bd2-b55e1d20f4b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:52.402529 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9d4232a-dd57-41a3-8bd2-b55e1d20f4b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:52.403005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9d4232a-dd57-41a3-8bd2-b55e1d20f4b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:52.403477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9d4232a-dd57-41a3-8bd2-b55e1d20f4b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:52.404161 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9d4232a-dd57-41a3-8bd2-b55e1d20f4b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:52.404606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9d4232a-dd57-41a3-8bd2-b55e1d20f4b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:52.405029 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9d4232a-dd57-41a3-8bd2-b55e1d20f4b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:52.532488 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f9d4232a-dd57-41a3-8bd2-b55e1d20f4b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:52.541273 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f9d4232a-dd57-41a3-8bd2-b55e1d20f4b6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149686 Aug 30 15:01:52.541840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 859/1720] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:52 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:52.758420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2fbae818-b8d3-4a51-85c8-fb570d6afd6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:52.759007 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2fbae818-b8d3-4a51-85c8-fb570d6afd6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:52.765292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2fbae818-b8d3-4a51-85c8-fb570d6afd6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:52.765756 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2fbae818-b8d3-4a51-85c8-fb570d6afd6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:52.766176 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2fbae818-b8d3-4a51-85c8-fb570d6afd6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:52.766850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2fbae818-b8d3-4a51-85c8-fb570d6afd6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:52.767325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2fbae818-b8d3-4a51-85c8-fb570d6afd6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:52.767742 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2fbae818-b8d3-4a51-85c8-fb570d6afd6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:52.828995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2fbae818-b8d3-4a51-85c8-fb570d6afd6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:52.838045 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2fbae818-b8d3-4a51-85c8-fb570d6afd6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:52.839518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2fbae818-b8d3-4a51-85c8-fb570d6afd6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:52.840646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2fbae818-b8d3-4a51-85c8-fb570d6afd6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086215 Aug 30 15:01:52.841203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 862/1721] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:52 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:01:53.156902 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-324ecba6-c6f8-4308-a124-f499477ad808 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:53.157616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-324ecba6-c6f8-4308-a124-f499477ad808 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:53.163849 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-324ecba6-c6f8-4308-a124-f499477ad808 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:53.164321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-324ecba6-c6f8-4308-a124-f499477ad808 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:53.164748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-324ecba6-c6f8-4308-a124-f499477ad808 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:53.165497 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-324ecba6-c6f8-4308-a124-f499477ad808 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:53.165940 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-324ecba6-c6f8-4308-a124-f499477ad808 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:53.166355 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-324ecba6-c6f8-4308-a124-f499477ad808 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:53.295055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-324ecba6-c6f8-4308-a124-f499477ad808 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:53.303854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-324ecba6-c6f8-4308-a124-f499477ad808 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150831 Aug 30 15:01:53.304427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 860/1722] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:53 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:53.562562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-696ed248-37d1-437a-b8fe-6945a4099216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:53.563181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-696ed248-37d1-437a-b8fe-6945a4099216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:53.569177 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-696ed248-37d1-437a-b8fe-6945a4099216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:53.569653 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-696ed248-37d1-437a-b8fe-6945a4099216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:53.570086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-696ed248-37d1-437a-b8fe-6945a4099216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:53.570776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-696ed248-37d1-437a-b8fe-6945a4099216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:53.571243 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-696ed248-37d1-437a-b8fe-6945a4099216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:53.571940 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-696ed248-37d1-437a-b8fe-6945a4099216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:53.700713 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-696ed248-37d1-437a-b8fe-6945a4099216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:53.709527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-696ed248-37d1-437a-b8fe-6945a4099216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150821 Aug 30 15:01:53.710103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 863/1723] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:53 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:53.864150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-22cacd06-5fd3-489a-9c35-29c9b8bab216 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:53.864674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-22cacd06-5fd3-489a-9c35-29c9b8bab216 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:53.871345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22cacd06-5fd3-489a-9c35-29c9b8bab216 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:53.871822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22cacd06-5fd3-489a-9c35-29c9b8bab216 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:53.872249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22cacd06-5fd3-489a-9c35-29c9b8bab216 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:53.872930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22cacd06-5fd3-489a-9c35-29c9b8bab216 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:53.873439 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22cacd06-5fd3-489a-9c35-29c9b8bab216 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:53.873859 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22cacd06-5fd3-489a-9c35-29c9b8bab216 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:53.939169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-22cacd06-5fd3-489a-9c35-29c9b8bab216 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:53.948941 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-22cacd06-5fd3-489a-9c35-29c9b8bab216 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:53.950409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-22cacd06-5fd3-489a-9c35-29c9b8bab216 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:53.951627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-22cacd06-5fd3-489a-9c35-29c9b8bab216 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091957 Aug 30 15:01:53.952183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 861/1724] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:53 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:54.325681 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0c10afe5-ef38-428f-af13-f32aa2fcad51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:54.326287 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0c10afe5-ef38-428f-af13-f32aa2fcad51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:54.333392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c10afe5-ef38-428f-af13-f32aa2fcad51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:54.333870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c10afe5-ef38-428f-af13-f32aa2fcad51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:54.334299 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c10afe5-ef38-428f-af13-f32aa2fcad51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:54.334982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c10afe5-ef38-428f-af13-f32aa2fcad51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:54.335457 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c10afe5-ef38-428f-af13-f32aa2fcad51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:54.335875 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c10afe5-ef38-428f-af13-f32aa2fcad51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:54.461036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0c10afe5-ef38-428f-af13-f32aa2fcad51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:54.469261 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0c10afe5-ef38-428f-af13-f32aa2fcad51 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147654 Aug 30 15:01:54.469775 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 864/1725] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:54 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:54.731570 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f5706f35-89bb-45c8-bc62-cef8378732f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:54.732101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f5706f35-89bb-45c8-bc62-cef8378732f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:54.738646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5706f35-89bb-45c8-bc62-cef8378732f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:54.739149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5706f35-89bb-45c8-bc62-cef8378732f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:54.739608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5706f35-89bb-45c8-bc62-cef8378732f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:54.740283 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5706f35-89bb-45c8-bc62-cef8378732f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:54.740734 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5706f35-89bb-45c8-bc62-cef8378732f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:54.741158 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5706f35-89bb-45c8-bc62-cef8378732f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:54.867847 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f5706f35-89bb-45c8-bc62-cef8378732f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:54.876397 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f5706f35-89bb-45c8-bc62-cef8378732f9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149016 Aug 30 15:01:54.876958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 862/1726] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:54 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:54.975168 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ea17bf56-60d7-4129-beb3-3881a131cd53 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:54.975812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ea17bf56-60d7-4129-beb3-3881a131cd53 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:54.981798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ea17bf56-60d7-4129-beb3-3881a131cd53 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:54.982221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ea17bf56-60d7-4129-beb3-3881a131cd53 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:54.982697 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ea17bf56-60d7-4129-beb3-3881a131cd53 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:54.983425 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ea17bf56-60d7-4129-beb3-3881a131cd53 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:54.983882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ea17bf56-60d7-4129-beb3-3881a131cd53 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:54.984304 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ea17bf56-60d7-4129-beb3-3881a131cd53 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:55.047374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ea17bf56-60d7-4129-beb3-3881a131cd53 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:55.056728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ea17bf56-60d7-4129-beb3-3881a131cd53 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:55.058183 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ea17bf56-60d7-4129-beb3-3881a131cd53 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:55.059379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ea17bf56-60d7-4129-beb3-3881a131cd53 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088581 Aug 30 15:01:55.059942 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 865/1727] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:54 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:55.489748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3832f376-08ab-4b54-a991-706a971918a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:55.490349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3832f376-08ab-4b54-a991-706a971918a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:55.496330 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3832f376-08ab-4b54-a991-706a971918a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:55.496800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3832f376-08ab-4b54-a991-706a971918a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:55.497228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3832f376-08ab-4b54-a991-706a971918a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:55.497902 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3832f376-08ab-4b54-a991-706a971918a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:55.498346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3832f376-08ab-4b54-a991-706a971918a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:55.498759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3832f376-08ab-4b54-a991-706a971918a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:55.627102 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3832f376-08ab-4b54-a991-706a971918a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:55.635985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3832f376-08ab-4b54-a991-706a971918a9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150647 Aug 30 15:01:55.636553 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 863/1728] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:55 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:55.898363 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8b16c9ac-b108-4ff4-8a5a-dc2788fcb244 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:55.898971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8b16c9ac-b108-4ff4-8a5a-dc2788fcb244 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:55.905383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b16c9ac-b108-4ff4-8a5a-dc2788fcb244 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:55.905861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b16c9ac-b108-4ff4-8a5a-dc2788fcb244 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:55.906284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b16c9ac-b108-4ff4-8a5a-dc2788fcb244 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:55.906967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b16c9ac-b108-4ff4-8a5a-dc2788fcb244 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:55.907439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b16c9ac-b108-4ff4-8a5a-dc2788fcb244 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:55.907857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b16c9ac-b108-4ff4-8a5a-dc2788fcb244 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:56.036644 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8b16c9ac-b108-4ff4-8a5a-dc2788fcb244 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:56.045149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8b16c9ac-b108-4ff4-8a5a-dc2788fcb244 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151481 Aug 30 15:01:56.045725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 866/1729] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:55 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:56.081015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7ee9a2ac-570d-4cf4-8e24-1e174ab92b85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:56.082219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7ee9a2ac-570d-4cf4-8e24-1e174ab92b85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:56.087984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ee9a2ac-570d-4cf4-8e24-1e174ab92b85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:56.088455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ee9a2ac-570d-4cf4-8e24-1e174ab92b85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:56.088887 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ee9a2ac-570d-4cf4-8e24-1e174ab92b85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:56.089556 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ee9a2ac-570d-4cf4-8e24-1e174ab92b85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:56.089999 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ee9a2ac-570d-4cf4-8e24-1e174ab92b85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:56.090411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ee9a2ac-570d-4cf4-8e24-1e174ab92b85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:56.153982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7ee9a2ac-570d-4cf4-8e24-1e174ab92b85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:56.162590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7ee9a2ac-570d-4cf4-8e24-1e174ab92b85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:56.164032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7ee9a2ac-570d-4cf4-8e24-1e174ab92b85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:56.165157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7ee9a2ac-570d-4cf4-8e24-1e174ab92b85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088088 Aug 30 15:01:56.165709 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 864/1730] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:56 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:56.657329 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c3f22240-a993-4fdd-93b3-4ac908124cd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:56.657941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c3f22240-a993-4fdd-93b3-4ac908124cd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:56.664371 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3f22240-a993-4fdd-93b3-4ac908124cd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:56.664853 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3f22240-a993-4fdd-93b3-4ac908124cd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:56.665286 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3f22240-a993-4fdd-93b3-4ac908124cd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:56.665975 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3f22240-a993-4fdd-93b3-4ac908124cd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:56.666424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3f22240-a993-4fdd-93b3-4ac908124cd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:56.666843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3f22240-a993-4fdd-93b3-4ac908124cd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:56.793020 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c3f22240-a993-4fdd-93b3-4ac908124cd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:56.801320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c3f22240-a993-4fdd-93b3-4ac908124cd4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147897 Aug 30 15:01:56.801893 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 867/1731] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:56 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:57.067434 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-54dd6f48-8be1-4a28-8de1-a1567eff377b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:57.068042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-54dd6f48-8be1-4a28-8de1-a1567eff377b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:57.074198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54dd6f48-8be1-4a28-8de1-a1567eff377b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:57.074674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54dd6f48-8be1-4a28-8de1-a1567eff377b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:57.075105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54dd6f48-8be1-4a28-8de1-a1567eff377b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:57.075813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54dd6f48-8be1-4a28-8de1-a1567eff377b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:57.076261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54dd6f48-8be1-4a28-8de1-a1567eff377b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:57.076678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-54dd6f48-8be1-4a28-8de1-a1567eff377b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:57.188589 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2bbb1bce-b593-40eb-895c-37d62ea740b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:57.189171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2bbb1bce-b593-40eb-895c-37d62ea740b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:57.196427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bbb1bce-b593-40eb-895c-37d62ea740b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:57.197156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bbb1bce-b593-40eb-895c-37d62ea740b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:57.197584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bbb1bce-b593-40eb-895c-37d62ea740b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:57.198649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bbb1bce-b593-40eb-895c-37d62ea740b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:57.199112 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bbb1bce-b593-40eb-895c-37d62ea740b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:57.199555 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bbb1bce-b593-40eb-895c-37d62ea740b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:57.210906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-54dd6f48-8be1-4a28-8de1-a1567eff377b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:57.217623 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-54dd6f48-8be1-4a28-8de1-a1567eff377b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.154491 Aug 30 15:01:57.218516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 865/1732] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:57 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:57.269178 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2bbb1bce-b593-40eb-895c-37d62ea740b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:57.278343 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2bbb1bce-b593-40eb-895c-37d62ea740b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:57.279830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2bbb1bce-b593-40eb-895c-37d62ea740b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:57.280980 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2bbb1bce-b593-40eb-895c-37d62ea740b8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.096300 Aug 30 15:01:57.281541 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 868/1733] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:57 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:01:57.822923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-30c29c3a-84d3-4889-9145-748c683feac4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:57.823598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-30c29c3a-84d3-4889-9145-748c683feac4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:57.829598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30c29c3a-84d3-4889-9145-748c683feac4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:57.830079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30c29c3a-84d3-4889-9145-748c683feac4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:57.830546 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30c29c3a-84d3-4889-9145-748c683feac4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:57.831371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30c29c3a-84d3-4889-9145-748c683feac4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:57.831936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30c29c3a-84d3-4889-9145-748c683feac4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:57.832346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30c29c3a-84d3-4889-9145-748c683feac4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:57.957955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-30c29c3a-84d3-4889-9145-748c683feac4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:57.966103 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-30c29c3a-84d3-4889-9145-748c683feac4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147314 Aug 30 15:01:57.966669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 866/1734] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:57 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:58.239755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-de285d03-de7e-4c56-b773-cff08d911073 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:58.240369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-de285d03-de7e-4c56-b773-cff08d911073 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:58.246710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-de285d03-de7e-4c56-b773-cff08d911073 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:58.247179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-de285d03-de7e-4c56-b773-cff08d911073 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:58.247638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-de285d03-de7e-4c56-b773-cff08d911073 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:58.248317 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-de285d03-de7e-4c56-b773-cff08d911073 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:58.248761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-de285d03-de7e-4c56-b773-cff08d911073 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:58.249173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-de285d03-de7e-4c56-b773-cff08d911073 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:58.303364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-eeaa77c9-8d74-44ce-82ff-9e5f2d145774 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:58.304102 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-eeaa77c9-8d74-44ce-82ff-9e5f2d145774 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:58.311126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eeaa77c9-8d74-44ce-82ff-9e5f2d145774 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:58.311377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eeaa77c9-8d74-44ce-82ff-9e5f2d145774 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:58.311815 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eeaa77c9-8d74-44ce-82ff-9e5f2d145774 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:58.312682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eeaa77c9-8d74-44ce-82ff-9e5f2d145774 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:58.313135 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eeaa77c9-8d74-44ce-82ff-9e5f2d145774 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:58.313555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eeaa77c9-8d74-44ce-82ff-9e5f2d145774 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:58.381311 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-de285d03-de7e-4c56-b773-cff08d911073 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:58.381652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-eeaa77c9-8d74-44ce-82ff-9e5f2d145774 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:58.389778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-de285d03-de7e-4c56-b773-cff08d911073 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.154775 Aug 30 15:01:58.390111 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-eeaa77c9-8d74-44ce-82ff-9e5f2d145774 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:58.390508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 869/1735] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:58 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:58.391668 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-eeaa77c9-8d74-44ce-82ff-9e5f2d145774 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:58.392892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-eeaa77c9-8d74-44ce-82ff-9e5f2d145774 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.093620 Aug 30 15:01:58.393449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 867/1736] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:58 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:01:58.988174 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9c31b8fe-9248-402d-aac8-ababb864ddb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:58.988789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9c31b8fe-9248-402d-aac8-ababb864ddb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:58.994681 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c31b8fe-9248-402d-aac8-ababb864ddb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:58.995155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c31b8fe-9248-402d-aac8-ababb864ddb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:58.995617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c31b8fe-9248-402d-aac8-ababb864ddb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:58.996299 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c31b8fe-9248-402d-aac8-ababb864ddb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:58.996746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c31b8fe-9248-402d-aac8-ababb864ddb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:58.997177 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c31b8fe-9248-402d-aac8-ababb864ddb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:59.121565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9c31b8fe-9248-402d-aac8-ababb864ddb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:59.130425 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9c31b8fe-9248-402d-aac8-ababb864ddb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.146806 Aug 30 15:01:59.130982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 870/1737] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:58 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:01:59.411877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9c334d57-b983-4022-a22f-1425362de95b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:59.412494 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9c334d57-b983-4022-a22f-1425362de95b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:59.416045 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-12f63518-89f2-409e-b324-981d7e5f901e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:01:59.416682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-12f63518-89f2-409e-b324-981d7e5f901e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:01:59.418870 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c334d57-b983-4022-a22f-1425362de95b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:59.419391 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c334d57-b983-4022-a22f-1425362de95b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:59.419831 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c334d57-b983-4022-a22f-1425362de95b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:59.420519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c334d57-b983-4022-a22f-1425362de95b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:59.420969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c334d57-b983-4022-a22f-1425362de95b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:59.421389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c334d57-b983-4022-a22f-1425362de95b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:59.422734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12f63518-89f2-409e-b324-981d7e5f901e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:59.423228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12f63518-89f2-409e-b324-981d7e5f901e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:59.423673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12f63518-89f2-409e-b324-981d7e5f901e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:59.424384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12f63518-89f2-409e-b324-981d7e5f901e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:01:59.424850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12f63518-89f2-409e-b324-981d7e5f901e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:01:59.427261 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12f63518-89f2-409e-b324-981d7e5f901e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:01:59.489913 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-12f63518-89f2-409e-b324-981d7e5f901e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:59.498729 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-12f63518-89f2-409e-b324-981d7e5f901e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:59.500272 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-12f63518-89f2-409e-b324-981d7e5f901e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:59.501434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-12f63518-89f2-409e-b324-981d7e5f901e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089030 Aug 30 15:01:59.501843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 871/1738] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:01:59 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:01:59.551687 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9c334d57-b983-4022-a22f-1425362de95b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:01:59.559935 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9c334d57-b983-4022-a22f-1425362de95b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152682 Aug 30 15:01:59.560503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 868/1739] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:01:59 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:00.152741 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f962a7b9-596b-4715-9ba6-94f5edf03284 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:00.153381 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f962a7b9-596b-4715-9ba6-94f5edf03284 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:00.159981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f962a7b9-596b-4715-9ba6-94f5edf03284 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:00.160655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f962a7b9-596b-4715-9ba6-94f5edf03284 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:00.161098 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f962a7b9-596b-4715-9ba6-94f5edf03284 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:00.161798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f962a7b9-596b-4715-9ba6-94f5edf03284 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:00.162259 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f962a7b9-596b-4715-9ba6-94f5edf03284 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:00.162688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f962a7b9-596b-4715-9ba6-94f5edf03284 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:00.289442 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f962a7b9-596b-4715-9ba6-94f5edf03284 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:00.297453 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f962a7b9-596b-4715-9ba6-94f5edf03284 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148633 Aug 30 15:02:00.298016 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 872/1740] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:00 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:00.524728 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dfcb9573-8e35-4ee4-968b-67a515404008 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:00.525270 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dfcb9573-8e35-4ee4-968b-67a515404008 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:00.531642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dfcb9573-8e35-4ee4-968b-67a515404008 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:00.532125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dfcb9573-8e35-4ee4-968b-67a515404008 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:00.532555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dfcb9573-8e35-4ee4-968b-67a515404008 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:00.533237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dfcb9573-8e35-4ee4-968b-67a515404008 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:00.533682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dfcb9573-8e35-4ee4-968b-67a515404008 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:00.534184 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dfcb9573-8e35-4ee4-968b-67a515404008 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:00.582363 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ef80c3f2-bf6e-4c90-99c6-60d7e7abf48f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:00.582985 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ef80c3f2-bf6e-4c90-99c6-60d7e7abf48f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:00.589339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef80c3f2-bf6e-4c90-99c6-60d7e7abf48f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:00.589814 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef80c3f2-bf6e-4c90-99c6-60d7e7abf48f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:00.590245 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef80c3f2-bf6e-4c90-99c6-60d7e7abf48f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:00.590929 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef80c3f2-bf6e-4c90-99c6-60d7e7abf48f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:00.591403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef80c3f2-bf6e-4c90-99c6-60d7e7abf48f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:00.591828 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef80c3f2-bf6e-4c90-99c6-60d7e7abf48f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:00.595239 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-dfcb9573-8e35-4ee4-968b-67a515404008 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:00.604707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-dfcb9573-8e35-4ee4-968b-67a515404008 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:00.606184 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-dfcb9573-8e35-4ee4-968b-67a515404008 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:00.607355 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dfcb9573-8e35-4ee4-968b-67a515404008 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086601 Aug 30 15:02:00.608527 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 869/1741] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:00 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:00.718064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ef80c3f2-bf6e-4c90-99c6-60d7e7abf48f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:00.727249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ef80c3f2-bf6e-4c90-99c6-60d7e7abf48f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149311 Aug 30 15:02:00.727813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 873/1742] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:00 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:01.320070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0a880aa5-7dc8-4564-a6fb-7f50ca621860 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:01.320702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0a880aa5-7dc8-4564-a6fb-7f50ca621860 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:01.326823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a880aa5-7dc8-4564-a6fb-7f50ca621860 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:01.327325 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a880aa5-7dc8-4564-a6fb-7f50ca621860 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:01.327756 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a880aa5-7dc8-4564-a6fb-7f50ca621860 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:01.328434 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a880aa5-7dc8-4564-a6fb-7f50ca621860 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:01.329120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a880aa5-7dc8-4564-a6fb-7f50ca621860 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:01.329303 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a880aa5-7dc8-4564-a6fb-7f50ca621860 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:01.459232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0a880aa5-7dc8-4564-a6fb-7f50ca621860 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:01.467429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0a880aa5-7dc8-4564-a6fb-7f50ca621860 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152043 Aug 30 15:02:01.467936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 870/1743] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:01 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:01.630057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cb6d6158-c8c9-48dd-aeb3-cb66fb6159a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:01.630666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cb6d6158-c8c9-48dd-aeb3-cb66fb6159a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:01.637078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb6d6158-c8c9-48dd-aeb3-cb66fb6159a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:01.637556 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb6d6158-c8c9-48dd-aeb3-cb66fb6159a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:01.637987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb6d6158-c8c9-48dd-aeb3-cb66fb6159a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:01.638675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb6d6158-c8c9-48dd-aeb3-cb66fb6159a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:01.639126 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb6d6158-c8c9-48dd-aeb3-cb66fb6159a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:01.639574 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cb6d6158-c8c9-48dd-aeb3-cb66fb6159a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:01.705403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cb6d6158-c8c9-48dd-aeb3-cb66fb6159a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:01.714066 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cb6d6158-c8c9-48dd-aeb3-cb66fb6159a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:01.715538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cb6d6158-c8c9-48dd-aeb3-cb66fb6159a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:01.716673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cb6d6158-c8c9-48dd-aeb3-cb66fb6159a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090638 Aug 30 15:02:01.717233 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 874/1744] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:01 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:01.748706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f76750c2-038e-400e-afe9-b5a6479dde30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:01.749247 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f76750c2-038e-400e-afe9-b5a6479dde30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:01.755714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f76750c2-038e-400e-afe9-b5a6479dde30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:01.756187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f76750c2-038e-400e-afe9-b5a6479dde30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:01.756619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f76750c2-038e-400e-afe9-b5a6479dde30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:01.757298 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f76750c2-038e-400e-afe9-b5a6479dde30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:01.757745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f76750c2-038e-400e-afe9-b5a6479dde30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:01.758169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f76750c2-038e-400e-afe9-b5a6479dde30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:01.775826 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:01.884980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f76750c2-038e-400e-afe9-b5a6479dde30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:01.892966 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f76750c2-038e-400e-afe9-b5a6479dde30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148174 Aug 30 15:02:01.893583 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 871/1745] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:01 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:02.489305 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8a8c9238-d7eb-4d50-8914-9e5b9761de74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:02.489830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8a8c9238-d7eb-4d50-8914-9e5b9761de74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:02.495711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a8c9238-d7eb-4d50-8914-9e5b9761de74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:02.496184 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a8c9238-d7eb-4d50-8914-9e5b9761de74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:02.496614 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a8c9238-d7eb-4d50-8914-9e5b9761de74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:02.497290 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a8c9238-d7eb-4d50-8914-9e5b9761de74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:02.497734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a8c9238-d7eb-4d50-8914-9e5b9761de74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:02.498145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a8c9238-d7eb-4d50-8914-9e5b9761de74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:02.624739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8a8c9238-d7eb-4d50-8914-9e5b9761de74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:02.633816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8a8c9238-d7eb-4d50-8914-9e5b9761de74 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148764 Aug 30 15:02:02.634411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 875/1746] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:02 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:02.740520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c1f67f30-279b-49e5-a949-3da8198591fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:02.741047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c1f67f30-279b-49e5-a949-3da8198591fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:02.746847 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1f67f30-279b-49e5-a949-3da8198591fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:02.747347 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1f67f30-279b-49e5-a949-3da8198591fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:02.747785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1f67f30-279b-49e5-a949-3da8198591fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:02.748448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1f67f30-279b-49e5-a949-3da8198591fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:02.748887 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1f67f30-279b-49e5-a949-3da8198591fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:02.749437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1f67f30-279b-49e5-a949-3da8198591fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:02.809230 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c1f67f30-279b-49e5-a949-3da8198591fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:02.818267 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c1f67f30-279b-49e5-a949-3da8198591fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:02.819724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c1f67f30-279b-49e5-a949-3da8198591fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:02.820855 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c1f67f30-279b-49e5-a949-3da8198591fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084787 Aug 30 15:02:02.821403 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 872/1747] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:02 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:02.913620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9815bca4-0fc6-4d6a-8305-1585dc10e9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:02.914241 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9815bca4-0fc6-4d6a-8305-1585dc10e9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:02.921171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9815bca4-0fc6-4d6a-8305-1585dc10e9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:02.921651 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9815bca4-0fc6-4d6a-8305-1585dc10e9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:02.922082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9815bca4-0fc6-4d6a-8305-1585dc10e9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:02.922771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9815bca4-0fc6-4d6a-8305-1585dc10e9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:02.923235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9815bca4-0fc6-4d6a-8305-1585dc10e9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:02.923701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9815bca4-0fc6-4d6a-8305-1585dc10e9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:03.049968 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9815bca4-0fc6-4d6a-8305-1585dc10e9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:03.058087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9815bca4-0fc6-4d6a-8305-1585dc10e9b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148496 Aug 30 15:02:03.058661 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 876/1748] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:02 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:03.655042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7a8c3eab-4340-4d9c-9e31-a98cd650dc11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:03.656012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7a8c3eab-4340-4d9c-9e31-a98cd650dc11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:03.662334 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a8c3eab-4340-4d9c-9e31-a98cd650dc11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:03.662825 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a8c3eab-4340-4d9c-9e31-a98cd650dc11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:03.663289 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a8c3eab-4340-4d9c-9e31-a98cd650dc11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:03.663981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a8c3eab-4340-4d9c-9e31-a98cd650dc11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:03.664432 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a8c3eab-4340-4d9c-9e31-a98cd650dc11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:03.664853 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a8c3eab-4340-4d9c-9e31-a98cd650dc11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:03.796688 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7a8c3eab-4340-4d9c-9e31-a98cd650dc11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:03.805653 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7a8c3eab-4340-4d9c-9e31-a98cd650dc11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.154475 Aug 30 15:02:03.806217 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 873/1749] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:03 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:03.842806 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e475a2e0-745e-4e89-9037-7f942a5143a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:03.843472 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e475a2e0-745e-4e89-9037-7f942a5143a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:03.850078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e475a2e0-745e-4e89-9037-7f942a5143a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:03.850587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e475a2e0-745e-4e89-9037-7f942a5143a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:03.851049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e475a2e0-745e-4e89-9037-7f942a5143a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:03.851757 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e475a2e0-745e-4e89-9037-7f942a5143a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:03.852200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e475a2e0-745e-4e89-9037-7f942a5143a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:03.852620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e475a2e0-745e-4e89-9037-7f942a5143a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:03.915753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e475a2e0-745e-4e89-9037-7f942a5143a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:03.919529 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:03.926232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e475a2e0-745e-4e89-9037-7f942a5143a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:03.927707 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e475a2e0-745e-4e89-9037-7f942a5143a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:03.928839 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e475a2e0-745e-4e89-9037-7f942a5143a4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090034 Aug 30 15:02:03.929404 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 877/1750] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:03 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:04.079882 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-518a6b5c-4638-45cf-bf24-657c3654e410 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:04.080493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-518a6b5c-4638-45cf-bf24-657c3654e410 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:04.086486 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-518a6b5c-4638-45cf-bf24-657c3654e410 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:04.086960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-518a6b5c-4638-45cf-bf24-657c3654e410 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:04.087428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-518a6b5c-4638-45cf-bf24-657c3654e410 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:04.088111 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-518a6b5c-4638-45cf-bf24-657c3654e410 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:04.088558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-518a6b5c-4638-45cf-bf24-657c3654e410 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:04.088976 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-518a6b5c-4638-45cf-bf24-657c3654e410 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:04.216285 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-518a6b5c-4638-45cf-bf24-657c3654e410 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:04.225162 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-518a6b5c-4638-45cf-bf24-657c3654e410 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149056 Aug 30 15:02:04.225736 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 874/1751] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:04 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:04.827195 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d1826604-8531-4048-b3c8-2a17119e2be1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:04.827830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d1826604-8531-4048-b3c8-2a17119e2be1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:04.834391 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1826604-8531-4048-b3c8-2a17119e2be1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:04.834868 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1826604-8531-4048-b3c8-2a17119e2be1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:04.835336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1826604-8531-4048-b3c8-2a17119e2be1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:04.836026 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1826604-8531-4048-b3c8-2a17119e2be1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:04.836479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1826604-8531-4048-b3c8-2a17119e2be1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:04.836902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1826604-8531-4048-b3c8-2a17119e2be1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:04.951152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b8af73fa-7200-4bae-aa3b-f0352ff6d4f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:04.951775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b8af73fa-7200-4bae-aa3b-f0352ff6d4f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:04.958353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8af73fa-7200-4bae-aa3b-f0352ff6d4f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:04.958836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8af73fa-7200-4bae-aa3b-f0352ff6d4f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:04.959300 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8af73fa-7200-4bae-aa3b-f0352ff6d4f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:04.960000 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8af73fa-7200-4bae-aa3b-f0352ff6d4f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:04.960452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8af73fa-7200-4bae-aa3b-f0352ff6d4f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:04.960874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8af73fa-7200-4bae-aa3b-f0352ff6d4f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:04.964057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d1826604-8531-4048-b3c8-2a17119e2be1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:04.972164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d1826604-8531-4048-b3c8-2a17119e2be1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148769 Aug 30 15:02:04.972739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 878/1752] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:04 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:05.021546 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b8af73fa-7200-4bae-aa3b-f0352ff6d4f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:05.030031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b8af73fa-7200-4bae-aa3b-f0352ff6d4f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:05.031505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b8af73fa-7200-4bae-aa3b-f0352ff6d4f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:05.032651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b8af73fa-7200-4bae-aa3b-f0352ff6d4f7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085382 Aug 30 15:02:05.033212 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 875/1753] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:04 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:02:05.246563 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e31ba05b-1e42-4f54-b6ab-b2c11cc50973 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:05.247177 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e31ba05b-1e42-4f54-b6ab-b2c11cc50973 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:05.254295 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e31ba05b-1e42-4f54-b6ab-b2c11cc50973 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:05.254774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e31ba05b-1e42-4f54-b6ab-b2c11cc50973 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:05.255227 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e31ba05b-1e42-4f54-b6ab-b2c11cc50973 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:05.255932 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e31ba05b-1e42-4f54-b6ab-b2c11cc50973 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:05.256372 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e31ba05b-1e42-4f54-b6ab-b2c11cc50973 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:05.256795 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e31ba05b-1e42-4f54-b6ab-b2c11cc50973 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:05.382644 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e31ba05b-1e42-4f54-b6ab-b2c11cc50973 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:05.390685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e31ba05b-1e42-4f54-b6ab-b2c11cc50973 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148691 Aug 30 15:02:05.391268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 879/1754] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:05 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:05.992924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ae02188c-79c1-4fc6-b080-c2f8b69f8250 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:05.993536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ae02188c-79c1-4fc6-b080-c2f8b69f8250 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:05.999993 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae02188c-79c1-4fc6-b080-c2f8b69f8250 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:06.000470 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae02188c-79c1-4fc6-b080-c2f8b69f8250 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:06.000901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae02188c-79c1-4fc6-b080-c2f8b69f8250 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:06.001586 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae02188c-79c1-4fc6-b080-c2f8b69f8250 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:06.002036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae02188c-79c1-4fc6-b080-c2f8b69f8250 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:06.002455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae02188c-79c1-4fc6-b080-c2f8b69f8250 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:06.055251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6735c2b6-49ee-418e-8557-5e3b725dbd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:06.055870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6735c2b6-49ee-418e-8557-5e3b725dbd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:06.062285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6735c2b6-49ee-418e-8557-5e3b725dbd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:06.062766 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6735c2b6-49ee-418e-8557-5e3b725dbd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:06.063199 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6735c2b6-49ee-418e-8557-5e3b725dbd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:06.063921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6735c2b6-49ee-418e-8557-5e3b725dbd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:06.064368 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6735c2b6-49ee-418e-8557-5e3b725dbd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:06.066269 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6735c2b6-49ee-418e-8557-5e3b725dbd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:06.130084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6735c2b6-49ee-418e-8557-5e3b725dbd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:06.137511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ae02188c-79c1-4fc6-b080-c2f8b69f8250 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:06.138997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6735c2b6-49ee-418e-8557-5e3b725dbd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:06.140496 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6735c2b6-49ee-418e-8557-5e3b725dbd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:06.141655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6735c2b6-49ee-418e-8557-5e3b725dbd44 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090330 Aug 30 15:02:06.142213 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 880/1755] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:06 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:02:06.146581 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ae02188c-79c1-4fc6-b080-c2f8b69f8250 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.157467 Aug 30 15:02:06.147144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 876/1756] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:05 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:06.411595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-86b49ad8-078e-4536-959e-3153d8b44621 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:06.412214 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-86b49ad8-078e-4536-959e-3153d8b44621 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:06.418072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86b49ad8-078e-4536-959e-3153d8b44621 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:06.418548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86b49ad8-078e-4536-959e-3153d8b44621 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:06.419042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86b49ad8-078e-4536-959e-3153d8b44621 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:06.419764 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86b49ad8-078e-4536-959e-3153d8b44621 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:06.420247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86b49ad8-078e-4536-959e-3153d8b44621 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:06.420713 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86b49ad8-078e-4536-959e-3153d8b44621 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:06.547413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-86b49ad8-078e-4536-959e-3153d8b44621 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:06.555778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-86b49ad8-078e-4536-959e-3153d8b44621 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148815 Aug 30 15:02:06.556347 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 881/1757] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:06 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:07.164409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b65c7875-86be-49ba-a9ce-fdb73a08a004 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:07.165022 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b65c7875-86be-49ba-a9ce-fdb73a08a004 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:07.167895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a258158f-3056-4e1e-8c8b-381b1c099efc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:07.168508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a258158f-3056-4e1e-8c8b-381b1c099efc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:07.171684 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65c7875-86be-49ba-a9ce-fdb73a08a004 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:07.172168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65c7875-86be-49ba-a9ce-fdb73a08a004 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:07.172609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65c7875-86be-49ba-a9ce-fdb73a08a004 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:07.173297 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65c7875-86be-49ba-a9ce-fdb73a08a004 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:07.173748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65c7875-86be-49ba-a9ce-fdb73a08a004 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:07.174173 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65c7875-86be-49ba-a9ce-fdb73a08a004 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:07.176303 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a258158f-3056-4e1e-8c8b-381b1c099efc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:07.176786 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a258158f-3056-4e1e-8c8b-381b1c099efc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:07.177219 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a258158f-3056-4e1e-8c8b-381b1c099efc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:07.177914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a258158f-3056-4e1e-8c8b-381b1c099efc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:07.178367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a258158f-3056-4e1e-8c8b-381b1c099efc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:07.178817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a258158f-3056-4e1e-8c8b-381b1c099efc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:07.237777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b65c7875-86be-49ba-a9ce-fdb73a08a004 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:07.250635 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b65c7875-86be-49ba-a9ce-fdb73a08a004 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:07.252117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b65c7875-86be-49ba-a9ce-fdb73a08a004 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:07.253336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b65c7875-86be-49ba-a9ce-fdb73a08a004 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.092926 Aug 30 15:02:07.253908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 877/1758] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:07 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:07.308448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a258158f-3056-4e1e-8c8b-381b1c099efc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:07.317262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a258158f-3056-4e1e-8c8b-381b1c099efc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153297 Aug 30 15:02:07.317833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 882/1759] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:07 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:07.577196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-62f64cc6-588b-4752-99d3-76328c185d0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:07.577817 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-62f64cc6-588b-4752-99d3-76328c185d0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:07.583791 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62f64cc6-588b-4752-99d3-76328c185d0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:07.584272 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62f64cc6-588b-4752-99d3-76328c185d0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:07.584709 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62f64cc6-588b-4752-99d3-76328c185d0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:07.585394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62f64cc6-588b-4752-99d3-76328c185d0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:07.585845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62f64cc6-588b-4752-99d3-76328c185d0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:07.586269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-62f64cc6-588b-4752-99d3-76328c185d0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:07.713747 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-62f64cc6-588b-4752-99d3-76328c185d0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:07.722407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-62f64cc6-588b-4752-99d3-76328c185d0d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148453 Aug 30 15:02:07.723069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 878/1760] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:07 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:08.276230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8532cfbb-6ed7-4b2c-ae4d-1976f18297d4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:08.276835 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8532cfbb-6ed7-4b2c-ae4d-1976f18297d4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:08.283382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8532cfbb-6ed7-4b2c-ae4d-1976f18297d4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:08.283860 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8532cfbb-6ed7-4b2c-ae4d-1976f18297d4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:08.284861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8532cfbb-6ed7-4b2c-ae4d-1976f18297d4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:08.285764 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8532cfbb-6ed7-4b2c-ae4d-1976f18297d4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:08.286213 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8532cfbb-6ed7-4b2c-ae4d-1976f18297d4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:08.286628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8532cfbb-6ed7-4b2c-ae4d-1976f18297d4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:08.338283 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2ae8ab7a-4941-4a04-af0b-87d4f82e1d46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:08.338879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2ae8ab7a-4941-4a04-af0b-87d4f82e1d46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:08.345489 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ae8ab7a-4941-4a04-af0b-87d4f82e1d46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:08.345979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ae8ab7a-4941-4a04-af0b-87d4f82e1d46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:08.346450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ae8ab7a-4941-4a04-af0b-87d4f82e1d46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:08.347147 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ae8ab7a-4941-4a04-af0b-87d4f82e1d46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:08.347634 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ae8ab7a-4941-4a04-af0b-87d4f82e1d46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:08.348084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2ae8ab7a-4941-4a04-af0b-87d4f82e1d46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:08.354497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8532cfbb-6ed7-4b2c-ae4d-1976f18297d4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:08.363415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8532cfbb-6ed7-4b2c-ae4d-1976f18297d4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:08.364882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8532cfbb-6ed7-4b2c-ae4d-1976f18297d4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:08.366044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8532cfbb-6ed7-4b2c-ae4d-1976f18297d4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.093754 Aug 30 15:02:08.366610 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 883/1761] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:08 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:08.482775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2ae8ab7a-4941-4a04-af0b-87d4f82e1d46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:08.491198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2ae8ab7a-4941-4a04-af0b-87d4f82e1d46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.156752 Aug 30 15:02:08.491793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 879/1762] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:08 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:08.743670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5c2d2ce9-d062-4be2-a506-7a8877c6f6ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:08.744201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5c2d2ce9-d062-4be2-a506-7a8877c6f6ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:08.750122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c2d2ce9-d062-4be2-a506-7a8877c6f6ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:08.750600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c2d2ce9-d062-4be2-a506-7a8877c6f6ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:08.751031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c2d2ce9-d062-4be2-a506-7a8877c6f6ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:08.751731 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c2d2ce9-d062-4be2-a506-7a8877c6f6ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:08.752175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c2d2ce9-d062-4be2-a506-7a8877c6f6ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:08.752602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c2d2ce9-d062-4be2-a506-7a8877c6f6ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:08.881335 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5c2d2ce9-d062-4be2-a506-7a8877c6f6ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:08.889465 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5c2d2ce9-d062-4be2-a506-7a8877c6f6ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150232 Aug 30 15:02:08.890022 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 884/1763] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:08 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:09.388741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-84581be9-1b1b-40d4-8821-db77ecc864b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:09.389346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-84581be9-1b1b-40d4-8821-db77ecc864b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:09.395760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-84581be9-1b1b-40d4-8821-db77ecc864b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:09.396237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-84581be9-1b1b-40d4-8821-db77ecc864b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:09.396667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-84581be9-1b1b-40d4-8821-db77ecc864b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:09.397352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-84581be9-1b1b-40d4-8821-db77ecc864b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:09.397801 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-84581be9-1b1b-40d4-8821-db77ecc864b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:09.398226 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-84581be9-1b1b-40d4-8821-db77ecc864b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:09.459398 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-84581be9-1b1b-40d4-8821-db77ecc864b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:09.467996 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-84581be9-1b1b-40d4-8821-db77ecc864b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:09.469363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-84581be9-1b1b-40d4-8821-db77ecc864b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:09.470489 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-84581be9-1b1b-40d4-8821-db77ecc864b2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085685 Aug 30 15:02:09.471041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 880/1764] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:09 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:09.512407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-154f7199-b637-43cc-948f-5933f288e6c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:09.513017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-154f7199-b637-43cc-948f-5933f288e6c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:09.520512 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-154f7199-b637-43cc-948f-5933f288e6c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:09.520987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-154f7199-b637-43cc-948f-5933f288e6c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:09.521410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-154f7199-b637-43cc-948f-5933f288e6c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:09.522088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-154f7199-b637-43cc-948f-5933f288e6c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:09.522528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-154f7199-b637-43cc-948f-5933f288e6c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:09.522941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-154f7199-b637-43cc-948f-5933f288e6c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:09.650862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-154f7199-b637-43cc-948f-5933f288e6c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:09.659661 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-154f7199-b637-43cc-948f-5933f288e6c2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150348 Aug 30 15:02:09.660229 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 885/1765] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:09 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:09.909928 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8d613bfb-3a2a-4682-938b-0ad0221ca626 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:09.910538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8d613bfb-3a2a-4682-938b-0ad0221ca626 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:09.916443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d613bfb-3a2a-4682-938b-0ad0221ca626 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:09.916925 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d613bfb-3a2a-4682-938b-0ad0221ca626 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:09.917360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d613bfb-3a2a-4682-938b-0ad0221ca626 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:09.918045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d613bfb-3a2a-4682-938b-0ad0221ca626 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:09.918494 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d613bfb-3a2a-4682-938b-0ad0221ca626 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:09.918916 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d613bfb-3a2a-4682-938b-0ad0221ca626 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:10.051139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8d613bfb-3a2a-4682-938b-0ad0221ca626 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:10.059325 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8d613bfb-3a2a-4682-938b-0ad0221ca626 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153305 Aug 30 15:02:10.059899 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 881/1766] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:09 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:10.494469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0ac9e8a6-b301-411c-bbe4-0de58d369bc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:10.495001 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0ac9e8a6-b301-411c-bbe4-0de58d369bc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:10.500861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ac9e8a6-b301-411c-bbe4-0de58d369bc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:10.501333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ac9e8a6-b301-411c-bbe4-0de58d369bc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:10.501761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ac9e8a6-b301-411c-bbe4-0de58d369bc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:10.502439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ac9e8a6-b301-411c-bbe4-0de58d369bc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:10.503685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ac9e8a6-b301-411c-bbe4-0de58d369bc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:10.504100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0ac9e8a6-b301-411c-bbe4-0de58d369bc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:10.566696 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0ac9e8a6-b301-411c-bbe4-0de58d369bc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:10.575466 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0ac9e8a6-b301-411c-bbe4-0de58d369bc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:10.576898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0ac9e8a6-b301-411c-bbe4-0de58d369bc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:10.578018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0ac9e8a6-b301-411c-bbe4-0de58d369bc0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087524 Aug 30 15:02:10.578566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 886/1767] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:10 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:10.680792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-261b7c7d-4916-47c5-af5b-6c818804ee94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:10.681401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-261b7c7d-4916-47c5-af5b-6c818804ee94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:10.687737 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-261b7c7d-4916-47c5-af5b-6c818804ee94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:10.688219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-261b7c7d-4916-47c5-af5b-6c818804ee94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:10.688650 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-261b7c7d-4916-47c5-af5b-6c818804ee94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:10.689333 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-261b7c7d-4916-47c5-af5b-6c818804ee94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:10.689783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-261b7c7d-4916-47c5-af5b-6c818804ee94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:10.690263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-261b7c7d-4916-47c5-af5b-6c818804ee94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:10.817015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-261b7c7d-4916-47c5-af5b-6c818804ee94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:10.825392 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-261b7c7d-4916-47c5-af5b-6c818804ee94 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148457 Aug 30 15:02:10.825954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 882/1768] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:10 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:11.082833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b79e2d2c-e3aa-43ed-aa28-4b9eb717bdd9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:11.083467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b79e2d2c-e3aa-43ed-aa28-4b9eb717bdd9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:11.089312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b79e2d2c-e3aa-43ed-aa28-4b9eb717bdd9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:11.089784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b79e2d2c-e3aa-43ed-aa28-4b9eb717bdd9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:11.090213 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b79e2d2c-e3aa-43ed-aa28-4b9eb717bdd9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:11.090893 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b79e2d2c-e3aa-43ed-aa28-4b9eb717bdd9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:11.091410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b79e2d2c-e3aa-43ed-aa28-4b9eb717bdd9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:11.091831 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b79e2d2c-e3aa-43ed-aa28-4b9eb717bdd9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:11.217751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b79e2d2c-e3aa-43ed-aa28-4b9eb717bdd9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:11.227031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b79e2d2c-e3aa-43ed-aa28-4b9eb717bdd9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148920 Aug 30 15:02:11.227795 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 887/1769] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:11 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:11.600325 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e65e8b77-db6d-4e0c-9270-597b417cfb93 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:11.600928 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e65e8b77-db6d-4e0c-9270-597b417cfb93 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:11.606774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e65e8b77-db6d-4e0c-9270-597b417cfb93 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:11.607276 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e65e8b77-db6d-4e0c-9270-597b417cfb93 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:11.607712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e65e8b77-db6d-4e0c-9270-597b417cfb93 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:11.608392 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e65e8b77-db6d-4e0c-9270-597b417cfb93 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:11.608835 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e65e8b77-db6d-4e0c-9270-597b417cfb93 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:11.609283 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e65e8b77-db6d-4e0c-9270-597b417cfb93 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:11.669363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e65e8b77-db6d-4e0c-9270-597b417cfb93 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:11.678739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e65e8b77-db6d-4e0c-9270-597b417cfb93 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:11.680200 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e65e8b77-db6d-4e0c-9270-597b417cfb93 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:11.681365 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e65e8b77-db6d-4e0c-9270-597b417cfb93 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085095 Aug 30 15:02:11.681942 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 883/1770] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:11 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:11.845708 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9291d134-f7d3-491b-a961-7e9b1bf46cc4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:11.846316 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9291d134-f7d3-491b-a961-7e9b1bf46cc4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:11.852683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9291d134-f7d3-491b-a961-7e9b1bf46cc4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:11.853098 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9291d134-f7d3-491b-a961-7e9b1bf46cc4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:11.853527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9291d134-f7d3-491b-a961-7e9b1bf46cc4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:11.854210 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9291d134-f7d3-491b-a961-7e9b1bf46cc4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:11.854654 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9291d134-f7d3-491b-a961-7e9b1bf46cc4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:11.855067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9291d134-f7d3-491b-a961-7e9b1bf46cc4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:11.980253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9291d134-f7d3-491b-a961-7e9b1bf46cc4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:11.988818 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9291d134-f7d3-491b-a961-7e9b1bf46cc4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.146933 Aug 30 15:02:11.989380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 888/1771] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:11 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:12.248674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5cd03142-247b-45fa-bf67-2cc17b4bf847 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:12.249288 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5cd03142-247b-45fa-bf67-2cc17b4bf847 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:12.256007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cd03142-247b-45fa-bf67-2cc17b4bf847 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:12.256487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cd03142-247b-45fa-bf67-2cc17b4bf847 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:12.256945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cd03142-247b-45fa-bf67-2cc17b4bf847 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:12.257629 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cd03142-247b-45fa-bf67-2cc17b4bf847 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:12.258107 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cd03142-247b-45fa-bf67-2cc17b4bf847 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:12.258552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cd03142-247b-45fa-bf67-2cc17b4bf847 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:12.390454 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5cd03142-247b-45fa-bf67-2cc17b4bf847 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:12.398805 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5cd03142-247b-45fa-bf67-2cc17b4bf847 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153975 Aug 30 15:02:12.399407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 884/1772] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:12 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:12.704612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4908fd50-2064-4780-847c-09db0e35d5e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:12.705220 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4908fd50-2064-4780-847c-09db0e35d5e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:12.711848 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4908fd50-2064-4780-847c-09db0e35d5e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:12.712333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4908fd50-2064-4780-847c-09db0e35d5e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:12.712765 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4908fd50-2064-4780-847c-09db0e35d5e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:12.713484 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4908fd50-2064-4780-847c-09db0e35d5e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:12.713932 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4908fd50-2064-4780-847c-09db0e35d5e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:12.714352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4908fd50-2064-4780-847c-09db0e35d5e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:12.777465 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4908fd50-2064-4780-847c-09db0e35d5e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:12.787794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4908fd50-2064-4780-847c-09db0e35d5e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:12.789219 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4908fd50-2064-4780-847c-09db0e35d5e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:12.790353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4908fd50-2064-4780-847c-09db0e35d5e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089686 Aug 30 15:02:12.790906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 889/1773] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:12 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:13.009724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-db751625-1c6b-4be3-8e40-1ed14a33f343 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:13.010263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-db751625-1c6b-4be3-8e40-1ed14a33f343 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:13.016224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-db751625-1c6b-4be3-8e40-1ed14a33f343 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:13.016707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-db751625-1c6b-4be3-8e40-1ed14a33f343 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:13.017143 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-db751625-1c6b-4be3-8e40-1ed14a33f343 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:13.017832 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-db751625-1c6b-4be3-8e40-1ed14a33f343 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:13.018981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-db751625-1c6b-4be3-8e40-1ed14a33f343 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:13.019473 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-db751625-1c6b-4be3-8e40-1ed14a33f343 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:13.143216 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-db751625-1c6b-4be3-8e40-1ed14a33f343 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:13.152044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-db751625-1c6b-4be3-8e40-1ed14a33f343 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.146333 Aug 30 15:02:13.152610 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 885/1774] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:13 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:13.420464 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c71eab8c-e8af-4330-8e07-5cf68c9ff56f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:13.421070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c71eab8c-e8af-4330-8e07-5cf68c9ff56f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:13.428134 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c71eab8c-e8af-4330-8e07-5cf68c9ff56f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:13.428609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c71eab8c-e8af-4330-8e07-5cf68c9ff56f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:13.429035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c71eab8c-e8af-4330-8e07-5cf68c9ff56f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:13.429718 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c71eab8c-e8af-4330-8e07-5cf68c9ff56f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:13.430161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c71eab8c-e8af-4330-8e07-5cf68c9ff56f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:13.430587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c71eab8c-e8af-4330-8e07-5cf68c9ff56f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:13.559037 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c71eab8c-e8af-4330-8e07-5cf68c9ff56f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:13.567711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c71eab8c-e8af-4330-8e07-5cf68c9ff56f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151147 Aug 30 15:02:13.568275 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 890/1775] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:13 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:13.813162 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-577351d4-287b-4327-9230-70f371b8a905 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:13.813694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-577351d4-287b-4327-9230-70f371b8a905 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:13.820606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-577351d4-287b-4327-9230-70f371b8a905 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:13.821081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-577351d4-287b-4327-9230-70f371b8a905 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:13.821514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-577351d4-287b-4327-9230-70f371b8a905 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:13.822450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-577351d4-287b-4327-9230-70f371b8a905 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:13.822894 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-577351d4-287b-4327-9230-70f371b8a905 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:13.823342 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-577351d4-287b-4327-9230-70f371b8a905 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:13.884768 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-577351d4-287b-4327-9230-70f371b8a905 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:13.893340 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-577351d4-287b-4327-9230-70f371b8a905 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:13.894777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-577351d4-287b-4327-9230-70f371b8a905 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:13.895960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-577351d4-287b-4327-9230-70f371b8a905 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086822 Aug 30 15:02:13.896521 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 886/1776] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:13 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:14.172988 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2838b4c4-b60e-4db6-9323-f593fd21b1b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:14.173524 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2838b4c4-b60e-4db6-9323-f593fd21b1b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:14.179694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2838b4c4-b60e-4db6-9323-f593fd21b1b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:14.180170 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2838b4c4-b60e-4db6-9323-f593fd21b1b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:14.180598 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2838b4c4-b60e-4db6-9323-f593fd21b1b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:14.181281 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2838b4c4-b60e-4db6-9323-f593fd21b1b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:14.181726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2838b4c4-b60e-4db6-9323-f593fd21b1b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:14.182145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2838b4c4-b60e-4db6-9323-f593fd21b1b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:14.307754 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2838b4c4-b60e-4db6-9323-f593fd21b1b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:14.316954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2838b4c4-b60e-4db6-9323-f593fd21b1b8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147866 Aug 30 15:02:14.318130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 891/1777] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:14 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:14.588891 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-11c9ceab-a518-4f31-8b84-9a95d6581754 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:14.589509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-11c9ceab-a518-4f31-8b84-9a95d6581754 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:14.595454 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11c9ceab-a518-4f31-8b84-9a95d6581754 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:14.595930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11c9ceab-a518-4f31-8b84-9a95d6581754 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:14.596407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11c9ceab-a518-4f31-8b84-9a95d6581754 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:14.597105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11c9ceab-a518-4f31-8b84-9a95d6581754 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:14.597552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11c9ceab-a518-4f31-8b84-9a95d6581754 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:14.597969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11c9ceab-a518-4f31-8b84-9a95d6581754 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:14.731247 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-11c9ceab-a518-4f31-8b84-9a95d6581754 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:14.739883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-11c9ceab-a518-4f31-8b84-9a95d6581754 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.154836 Aug 30 15:02:14.740456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 887/1778] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:14 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:14.918531 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-308e90c8-a1eb-4115-a50b-c8f6a91983b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:14.919074 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-308e90c8-a1eb-4115-a50b-c8f6a91983b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:14.925547 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-308e90c8-a1eb-4115-a50b-c8f6a91983b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:14.926024 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-308e90c8-a1eb-4115-a50b-c8f6a91983b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:14.926457 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-308e90c8-a1eb-4115-a50b-c8f6a91983b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:14.927148 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-308e90c8-a1eb-4115-a50b-c8f6a91983b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:14.927637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-308e90c8-a1eb-4115-a50b-c8f6a91983b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:14.928059 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-308e90c8-a1eb-4115-a50b-c8f6a91983b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:14.992759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-308e90c8-a1eb-4115-a50b-c8f6a91983b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:15.001313 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-308e90c8-a1eb-4115-a50b-c8f6a91983b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:15.002949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-308e90c8-a1eb-4115-a50b-c8f6a91983b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:15.004050 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-308e90c8-a1eb-4115-a50b-c8f6a91983b4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089477 Aug 30 15:02:15.004623 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 892/1779] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:14 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:15.337782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9311c694-2988-4805-9fb8-328361ec3315 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:15.338401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9311c694-2988-4805-9fb8-328361ec3315 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:15.344829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9311c694-2988-4805-9fb8-328361ec3315 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:15.345310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9311c694-2988-4805-9fb8-328361ec3315 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:15.345746 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9311c694-2988-4805-9fb8-328361ec3315 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:15.346436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9311c694-2988-4805-9fb8-328361ec3315 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:15.346887 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9311c694-2988-4805-9fb8-328361ec3315 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:15.347338 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9311c694-2988-4805-9fb8-328361ec3315 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:15.351279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:15.474294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9311c694-2988-4805-9fb8-328361ec3315 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:15.482414 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9311c694-2988-4805-9fb8-328361ec3315 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148484 Aug 30 15:02:15.482991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 888/1780] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:15 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:15.760847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1f3a9906-ae6d-4602-ad47-084d68cb72e8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:15.761406 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1f3a9906-ae6d-4602-ad47-084d68cb72e8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:15.767352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f3a9906-ae6d-4602-ad47-084d68cb72e8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:15.767829 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f3a9906-ae6d-4602-ad47-084d68cb72e8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:15.768840 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f3a9906-ae6d-4602-ad47-084d68cb72e8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:15.769535 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f3a9906-ae6d-4602-ad47-084d68cb72e8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:15.769986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f3a9906-ae6d-4602-ad47-084d68cb72e8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:15.770408 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f3a9906-ae6d-4602-ad47-084d68cb72e8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:15.898176 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1f3a9906-ae6d-4602-ad47-084d68cb72e8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:15.906161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1f3a9906-ae6d-4602-ad47-084d68cb72e8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149259 Aug 30 15:02:15.906727 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 893/1781] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:15 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:16.027413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-27bbf3a9-4966-4802-ae30-fb813f8a8ac1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:16.028040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-27bbf3a9-4966-4802-ae30-fb813f8a8ac1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:16.034361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27bbf3a9-4966-4802-ae30-fb813f8a8ac1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:16.034912 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27bbf3a9-4966-4802-ae30-fb813f8a8ac1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:16.035363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27bbf3a9-4966-4802-ae30-fb813f8a8ac1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:16.036036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27bbf3a9-4966-4802-ae30-fb813f8a8ac1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:16.036475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27bbf3a9-4966-4802-ae30-fb813f8a8ac1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:16.036888 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27bbf3a9-4966-4802-ae30-fb813f8a8ac1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:16.098082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-27bbf3a9-4966-4802-ae30-fb813f8a8ac1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:16.106434 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-27bbf3a9-4966-4802-ae30-fb813f8a8ac1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:16.107883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-27bbf3a9-4966-4802-ae30-fb813f8a8ac1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:16.109007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-27bbf3a9-4966-4802-ae30-fb813f8a8ac1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085642 Aug 30 15:02:16.109559 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 889/1782] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:16 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:16.503170 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0f3343ae-fd3b-4ade-a713-d008f3048a5f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:16.503805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0f3343ae-fd3b-4ade-a713-d008f3048a5f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:16.510241 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f3343ae-fd3b-4ade-a713-d008f3048a5f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:16.510724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f3343ae-fd3b-4ade-a713-d008f3048a5f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:16.511157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f3343ae-fd3b-4ade-a713-d008f3048a5f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:16.511875 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f3343ae-fd3b-4ade-a713-d008f3048a5f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:16.512323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f3343ae-fd3b-4ade-a713-d008f3048a5f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:16.512743 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f3343ae-fd3b-4ade-a713-d008f3048a5f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:16.531031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:16.640368 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0f3343ae-fd3b-4ade-a713-d008f3048a5f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:16.649182 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0f3343ae-fd3b-4ade-a713-d008f3048a5f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149943 Aug 30 15:02:16.649749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 894/1783] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:16 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:16.927798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2f6b957e-af8c-4d43-b5e3-e393b9517f40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:16.928402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2f6b957e-af8c-4d43-b5e3-e393b9517f40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:16.934667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f6b957e-af8c-4d43-b5e3-e393b9517f40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:16.935140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f6b957e-af8c-4d43-b5e3-e393b9517f40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:16.935602 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f6b957e-af8c-4d43-b5e3-e393b9517f40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:16.936278 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f6b957e-af8c-4d43-b5e3-e393b9517f40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:16.936718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f6b957e-af8c-4d43-b5e3-e393b9517f40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:16.937133 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f6b957e-af8c-4d43-b5e3-e393b9517f40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:17.067985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2f6b957e-af8c-4d43-b5e3-e393b9517f40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:17.076255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2f6b957e-af8c-4d43-b5e3-e393b9517f40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152826 Aug 30 15:02:17.076820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 890/1784] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:16 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:17.132682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bd58315e-f560-4cb2-89f6-c07e11cabf9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:17.133286 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bd58315e-f560-4cb2-89f6-c07e11cabf9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:17.139135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd58315e-f560-4cb2-89f6-c07e11cabf9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:17.139647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd58315e-f560-4cb2-89f6-c07e11cabf9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:17.140077 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd58315e-f560-4cb2-89f6-c07e11cabf9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:17.140758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd58315e-f560-4cb2-89f6-c07e11cabf9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:17.141207 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd58315e-f560-4cb2-89f6-c07e11cabf9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:17.141625 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd58315e-f560-4cb2-89f6-c07e11cabf9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:17.204509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bd58315e-f560-4cb2-89f6-c07e11cabf9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:17.213348 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bd58315e-f560-4cb2-89f6-c07e11cabf9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:17.214788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bd58315e-f560-4cb2-89f6-c07e11cabf9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:17.215961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bd58315e-f560-4cb2-89f6-c07e11cabf9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087223 Aug 30 15:02:17.216514 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 895/1785] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:17 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:17.669645 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8756ff73-9019-4d6a-8a2f-09990e966ace tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:17.670257 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8756ff73-9019-4d6a-8a2f-09990e966ace tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:17.676936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8756ff73-9019-4d6a-8a2f-09990e966ace tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:17.677411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8756ff73-9019-4d6a-8a2f-09990e966ace tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:17.677845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8756ff73-9019-4d6a-8a2f-09990e966ace tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:17.678551 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8756ff73-9019-4d6a-8a2f-09990e966ace tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:17.678985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8756ff73-9019-4d6a-8a2f-09990e966ace tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:17.679444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8756ff73-9019-4d6a-8a2f-09990e966ace tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:17.807249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8756ff73-9019-4d6a-8a2f-09990e966ace tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:17.815392 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8756ff73-9019-4d6a-8a2f-09990e966ace tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149599 Aug 30 15:02:17.816023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 891/1786] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:17 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:18.097048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c6582ee8-416f-41c5-a387-886e46e99376 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:18.097658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c6582ee8-416f-41c5-a387-886e46e99376 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:18.104111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6582ee8-416f-41c5-a387-886e46e99376 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:18.104583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6582ee8-416f-41c5-a387-886e46e99376 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:18.105010 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6582ee8-416f-41c5-a387-886e46e99376 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:18.105686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6582ee8-416f-41c5-a387-886e46e99376 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:18.106128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6582ee8-416f-41c5-a387-886e46e99376 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:18.106543 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6582ee8-416f-41c5-a387-886e46e99376 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:18.233448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c6582ee8-416f-41c5-a387-886e46e99376 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:18.238136 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-691c3f44-78e0-4bc0-8ac5-6af9566e3c0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:18.238816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-691c3f44-78e0-4bc0-8ac5-6af9566e3c0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:18.241793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c6582ee8-416f-41c5-a387-886e46e99376 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148515 Aug 30 15:02:18.242371 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 896/1787] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:18 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:18.245370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-691c3f44-78e0-4bc0-8ac5-6af9566e3c0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:18.245843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-691c3f44-78e0-4bc0-8ac5-6af9566e3c0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:18.246267 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-691c3f44-78e0-4bc0-8ac5-6af9566e3c0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:18.246946 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-691c3f44-78e0-4bc0-8ac5-6af9566e3c0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:18.247439 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-691c3f44-78e0-4bc0-8ac5-6af9566e3c0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:18.247884 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-691c3f44-78e0-4bc0-8ac5-6af9566e3c0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:18.309048 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-691c3f44-78e0-4bc0-8ac5-6af9566e3c0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:18.318149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-691c3f44-78e0-4bc0-8ac5-6af9566e3c0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:18.319617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-691c3f44-78e0-4bc0-8ac5-6af9566e3c0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:18.320830 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-691c3f44-78e0-4bc0-8ac5-6af9566e3c0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086659 Aug 30 15:02:18.321386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 892/1788] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:18 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:02:18.836389 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7e8e9b7e-5447-4304-9dbf-5b8208b60b24 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:18.836999 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7e8e9b7e-5447-4304-9dbf-5b8208b60b24 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:18.843027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7e8e9b7e-5447-4304-9dbf-5b8208b60b24 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:18.843612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7e8e9b7e-5447-4304-9dbf-5b8208b60b24 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:18.844049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7e8e9b7e-5447-4304-9dbf-5b8208b60b24 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:18.844735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7e8e9b7e-5447-4304-9dbf-5b8208b60b24 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:18.845185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7e8e9b7e-5447-4304-9dbf-5b8208b60b24 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:18.845603 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7e8e9b7e-5447-4304-9dbf-5b8208b60b24 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:18.970965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7e8e9b7e-5447-4304-9dbf-5b8208b60b24 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:18.979785 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7e8e9b7e-5447-4304-9dbf-5b8208b60b24 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147298 Aug 30 15:02:18.980356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 897/1789] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:18 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:19.270199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5542f3de-5a65-488a-b3c7-ae2f824172c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:19.270802 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5542f3de-5a65-488a-b3c7-ae2f824172c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:19.277178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5542f3de-5a65-488a-b3c7-ae2f824172c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:19.277658 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5542f3de-5a65-488a-b3c7-ae2f824172c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:19.278088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5542f3de-5a65-488a-b3c7-ae2f824172c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:19.278772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5542f3de-5a65-488a-b3c7-ae2f824172c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:19.279239 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5542f3de-5a65-488a-b3c7-ae2f824172c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:19.279662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5542f3de-5a65-488a-b3c7-ae2f824172c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:19.344653 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3a517167-c8ac-4655-a63b-7398fa02954d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:19.345312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3a517167-c8ac-4655-a63b-7398fa02954d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:19.351449 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a517167-c8ac-4655-a63b-7398fa02954d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:19.351934 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a517167-c8ac-4655-a63b-7398fa02954d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:19.352370 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a517167-c8ac-4655-a63b-7398fa02954d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:19.353100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a517167-c8ac-4655-a63b-7398fa02954d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:19.353554 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a517167-c8ac-4655-a63b-7398fa02954d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:19.353986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a517167-c8ac-4655-a63b-7398fa02954d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:19.414303 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5542f3de-5a65-488a-b3c7-ae2f824172c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:19.419882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3a517167-c8ac-4655-a63b-7398fa02954d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:19.423314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5542f3de-5a65-488a-b3c7-ae2f824172c5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.157449 Aug 30 15:02:19.423895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 893/1790] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:19 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:19.429305 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3a517167-c8ac-4655-a63b-7398fa02954d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:19.430756 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3a517167-c8ac-4655-a63b-7398fa02954d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:19.431929 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3a517167-c8ac-4655-a63b-7398fa02954d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091283 Aug 30 15:02:19.432642 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 898/1791] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:19 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:02:20.001022 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-46fc9ecc-7648-4c30-9ced-45b270be882b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:20.001636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-46fc9ecc-7648-4c30-9ced-45b270be882b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:20.007799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46fc9ecc-7648-4c30-9ced-45b270be882b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:20.008317 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46fc9ecc-7648-4c30-9ced-45b270be882b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:20.008751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46fc9ecc-7648-4c30-9ced-45b270be882b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:20.009437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46fc9ecc-7648-4c30-9ced-45b270be882b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:20.009892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46fc9ecc-7648-4c30-9ced-45b270be882b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:20.010319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46fc9ecc-7648-4c30-9ced-45b270be882b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:20.137049 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-46fc9ecc-7648-4c30-9ced-45b270be882b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:20.145624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-46fc9ecc-7648-4c30-9ced-45b270be882b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148540 Aug 30 15:02:20.146193 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 894/1792] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:19 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:20.445643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a4c53ee9-c3c0-4764-916c-6e1b9d474b62 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:20.446248 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a4c53ee9-c3c0-4764-916c-6e1b9d474b62 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:20.454265 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a4c53ee9-c3c0-4764-916c-6e1b9d474b62 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:20.456881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c86f380c-5374-4680-b5a4-edcddbf67fcb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:20.457439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a4c53ee9-c3c0-4764-916c-6e1b9d474b62 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:20.457565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a4c53ee9-c3c0-4764-916c-6e1b9d474b62 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:20.458269 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a4c53ee9-c3c0-4764-916c-6e1b9d474b62 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:20.458404 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c86f380c-5374-4680-b5a4-edcddbf67fcb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:20.458736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a4c53ee9-c3c0-4764-916c-6e1b9d474b62 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:20.459180 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a4c53ee9-c3c0-4764-916c-6e1b9d474b62 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:20.464923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c86f380c-5374-4680-b5a4-edcddbf67fcb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:20.465434 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c86f380c-5374-4680-b5a4-edcddbf67fcb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:20.465872 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c86f380c-5374-4680-b5a4-edcddbf67fcb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:20.466570 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c86f380c-5374-4680-b5a4-edcddbf67fcb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:20.467021 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c86f380c-5374-4680-b5a4-edcddbf67fcb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:20.467609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c86f380c-5374-4680-b5a4-edcddbf67fcb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:20.533340 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c86f380c-5374-4680-b5a4-edcddbf67fcb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:20.542365 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c86f380c-5374-4680-b5a4-edcddbf67fcb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:20.543918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c86f380c-5374-4680-b5a4-edcddbf67fcb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:20.545069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c86f380c-5374-4680-b5a4-edcddbf67fcb tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.093384 Aug 30 15:02:20.545634 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 895/1793] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:20 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:20.587791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a4c53ee9-c3c0-4764-916c-6e1b9d474b62 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:20.596114 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a4c53ee9-c3c0-4764-916c-6e1b9d474b62 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.154447 Aug 30 15:02:20.596810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 899/1794] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:20 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:21.167218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3be63b04-3f3e-4b8f-85a2-4835569d45d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:21.167846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3be63b04-3f3e-4b8f-85a2-4835569d45d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:21.173983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3be63b04-3f3e-4b8f-85a2-4835569d45d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:21.175150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3be63b04-3f3e-4b8f-85a2-4835569d45d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:21.175608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3be63b04-3f3e-4b8f-85a2-4835569d45d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:21.176299 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3be63b04-3f3e-4b8f-85a2-4835569d45d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:21.176751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3be63b04-3f3e-4b8f-85a2-4835569d45d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:21.177176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3be63b04-3f3e-4b8f-85a2-4835569d45d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:21.302844 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3be63b04-3f3e-4b8f-85a2-4835569d45d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:21.312042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3be63b04-3f3e-4b8f-85a2-4835569d45d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148616 Aug 30 15:02:21.312615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 896/1795] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:21 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:21.568216 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-870003c4-baf7-46be-afde-4e1215f7ecd0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:21.568859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-870003c4-baf7-46be-afde-4e1215f7ecd0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:21.575722 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-870003c4-baf7-46be-afde-4e1215f7ecd0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:21.576233 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-870003c4-baf7-46be-afde-4e1215f7ecd0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:21.576668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-870003c4-baf7-46be-afde-4e1215f7ecd0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:21.577366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-870003c4-baf7-46be-afde-4e1215f7ecd0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:21.577819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-870003c4-baf7-46be-afde-4e1215f7ecd0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:21.578241 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-870003c4-baf7-46be-afde-4e1215f7ecd0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:21.617658 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dbe7ce5f-cb81-4f00-9f19-e21fffba049c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:21.618260 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dbe7ce5f-cb81-4f00-9f19-e21fffba049c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:21.624502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbe7ce5f-cb81-4f00-9f19-e21fffba049c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:21.624994 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbe7ce5f-cb81-4f00-9f19-e21fffba049c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:21.625428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbe7ce5f-cb81-4f00-9f19-e21fffba049c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:21.626129 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbe7ce5f-cb81-4f00-9f19-e21fffba049c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:21.626581 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbe7ce5f-cb81-4f00-9f19-e21fffba049c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:21.627007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dbe7ce5f-cb81-4f00-9f19-e21fffba049c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:21.642042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-870003c4-baf7-46be-afde-4e1215f7ecd0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:21.650995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-870003c4-baf7-46be-afde-4e1215f7ecd0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:21.652463 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-870003c4-baf7-46be-afde-4e1215f7ecd0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:21.653598 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-870003c4-baf7-46be-afde-4e1215f7ecd0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089527 Aug 30 15:02:21.654154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 900/1796] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:21 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:21.756378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-dbe7ce5f-cb81-4f00-9f19-e21fffba049c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:21.764546 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dbe7ce5f-cb81-4f00-9f19-e21fffba049c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151043 Aug 30 15:02:21.765136 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 897/1797] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:21 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:22.337103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7b0e0e1a-a733-4ff6-bae3-fc4f6c0dd6c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:22.337818 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7b0e0e1a-a733-4ff6-bae3-fc4f6c0dd6c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:22.340120 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=80 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:22.345778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b0e0e1a-a733-4ff6-bae3-fc4f6c0dd6c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:22.346365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b0e0e1a-a733-4ff6-bae3-fc4f6c0dd6c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:22.346807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b0e0e1a-a733-4ff6-bae3-fc4f6c0dd6c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:22.347540 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b0e0e1a-a733-4ff6-bae3-fc4f6c0dd6c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:22.347999 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b0e0e1a-a733-4ff6-bae3-fc4f6c0dd6c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:22.348432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b0e0e1a-a733-4ff6-bae3-fc4f6c0dd6c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:22.476905 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7b0e0e1a-a733-4ff6-bae3-fc4f6c0dd6c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:22.485055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7b0e0e1a-a733-4ff6-bae3-fc4f6c0dd6c9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151881 Aug 30 15:02:22.485618 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 901/1798] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:22 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:22.677174 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9ef688ac-2ac3-4e63-8174-8ab116fe89a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:22.677724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9ef688ac-2ac3-4e63-8174-8ab116fe89a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:22.680016 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=80 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:22.685280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ef688ac-2ac3-4e63-8174-8ab116fe89a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:22.685752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ef688ac-2ac3-4e63-8174-8ab116fe89a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:22.686180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ef688ac-2ac3-4e63-8174-8ab116fe89a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:22.686864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ef688ac-2ac3-4e63-8174-8ab116fe89a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:22.687348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ef688ac-2ac3-4e63-8174-8ab116fe89a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:22.687768 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ef688ac-2ac3-4e63-8174-8ab116fe89a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:22.753667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9ef688ac-2ac3-4e63-8174-8ab116fe89a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:22.762300 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9ef688ac-2ac3-4e63-8174-8ab116fe89a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:22.763769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9ef688ac-2ac3-4e63-8174-8ab116fe89a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:22.764933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9ef688ac-2ac3-4e63-8174-8ab116fe89a2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.092376 Aug 30 15:02:22.765483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 898/1799] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:22 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:22.786429 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-85453088-bdec-4cb4-b758-613092a69bb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:22.787045 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-85453088-bdec-4cb4-b758-613092a69bb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:22.793460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-85453088-bdec-4cb4-b758-613092a69bb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:22.793952 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-85453088-bdec-4cb4-b758-613092a69bb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:22.794391 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-85453088-bdec-4cb4-b758-613092a69bb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:22.795079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-85453088-bdec-4cb4-b758-613092a69bb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:22.795587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-85453088-bdec-4cb4-b758-613092a69bb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:22.796010 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-85453088-bdec-4cb4-b758-613092a69bb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:22.925263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-85453088-bdec-4cb4-b758-613092a69bb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:22.933469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-85453088-bdec-4cb4-b758-613092a69bb9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151498 Aug 30 15:02:22.933974 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 902/1800] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:22 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:23.506748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2d82fc8e-321f-49a5-be80-7a5c534761bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:23.507303 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2d82fc8e-321f-49a5-be80-7a5c534761bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:23.513186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d82fc8e-321f-49a5-be80-7a5c534761bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:23.513658 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d82fc8e-321f-49a5-be80-7a5c534761bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:23.514085 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d82fc8e-321f-49a5-be80-7a5c534761bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:23.514767 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d82fc8e-321f-49a5-be80-7a5c534761bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:23.515220 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d82fc8e-321f-49a5-be80-7a5c534761bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:23.515647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2d82fc8e-321f-49a5-be80-7a5c534761bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:23.641834 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2d82fc8e-321f-49a5-be80-7a5c534761bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:23.650589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2d82fc8e-321f-49a5-be80-7a5c534761bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148186 Aug 30 15:02:23.651163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 899/1801] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:23 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:23.787353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b65f9afc-e97b-4fe9-a890-c7d91bad8782 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:23.787881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b65f9afc-e97b-4fe9-a890-c7d91bad8782 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:23.794149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b65f9afc-e97b-4fe9-a890-c7d91bad8782 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:23.794630 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b65f9afc-e97b-4fe9-a890-c7d91bad8782 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:23.795094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b65f9afc-e97b-4fe9-a890-c7d91bad8782 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:23.795807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b65f9afc-e97b-4fe9-a890-c7d91bad8782 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:23.796256 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b65f9afc-e97b-4fe9-a890-c7d91bad8782 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:23.796676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b65f9afc-e97b-4fe9-a890-c7d91bad8782 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:23.857036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b65f9afc-e97b-4fe9-a890-c7d91bad8782 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:23.865678 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b65f9afc-e97b-4fe9-a890-c7d91bad8782 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:23.867120 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b65f9afc-e97b-4fe9-a890-c7d91bad8782 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:23.868359 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b65f9afc-e97b-4fe9-a890-c7d91bad8782 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085720 Aug 30 15:02:23.869351 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 903/1802] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:23 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:23.953834 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-564be8d5-3af1-497a-bf3d-56a4261f7932 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:23.954592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-564be8d5-3af1-497a-bf3d-56a4261f7932 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:23.962218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-564be8d5-3af1-497a-bf3d-56a4261f7932 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:23.962732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-564be8d5-3af1-497a-bf3d-56a4261f7932 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:23.963157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-564be8d5-3af1-497a-bf3d-56a4261f7932 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:23.964225 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-564be8d5-3af1-497a-bf3d-56a4261f7932 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:23.964558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-564be8d5-3af1-497a-bf3d-56a4261f7932 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:23.964978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-564be8d5-3af1-497a-bf3d-56a4261f7932 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:24.093614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-564be8d5-3af1-497a-bf3d-56a4261f7932 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:24.101944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-564be8d5-3af1-497a-bf3d-56a4261f7932 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152046 Aug 30 15:02:24.102523 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 900/1803] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:23 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:24.671918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9b32207a-dbe8-40e6-b562-2f7a5ae58218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:24.672532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9b32207a-dbe8-40e6-b562-2f7a5ae58218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:24.678965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b32207a-dbe8-40e6-b562-2f7a5ae58218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:24.679479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b32207a-dbe8-40e6-b562-2f7a5ae58218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:24.679918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b32207a-dbe8-40e6-b562-2f7a5ae58218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:24.680614 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b32207a-dbe8-40e6-b562-2f7a5ae58218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:24.681071 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b32207a-dbe8-40e6-b562-2f7a5ae58218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:24.681493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9b32207a-dbe8-40e6-b562-2f7a5ae58218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:24.890962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-63766c5c-66da-4307-827c-63f9791bf305 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:24.891607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-63766c5c-66da-4307-827c-63f9791bf305 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:24.897898 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63766c5c-66da-4307-827c-63f9791bf305 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:24.898380 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63766c5c-66da-4307-827c-63f9791bf305 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:24.898809 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63766c5c-66da-4307-827c-63f9791bf305 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:24.899534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63766c5c-66da-4307-827c-63f9791bf305 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:24.899982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63766c5c-66da-4307-827c-63f9791bf305 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:24.900405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63766c5c-66da-4307-827c-63f9791bf305 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:24.968684 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-63766c5c-66da-4307-827c-63f9791bf305 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:24.978112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-63766c5c-66da-4307-827c-63f9791bf305 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:24.979577 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-63766c5c-66da-4307-827c-63f9791bf305 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:24.980715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-63766c5c-66da-4307-827c-63f9791bf305 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.093748 Aug 30 15:02:24.981265 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 901/1804] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:24 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:02:25.036891 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9b32207a-dbe8-40e6-b562-2f7a5ae58218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:25.045135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9b32207a-dbe8-40e6-b562-2f7a5ae58218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.377151 Aug 30 15:02:25.045703 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 904/1805] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:24 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:25.122632 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7dcbad0e-9768-4c97-8fb3-00bb7cc60686 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:25.123264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7dcbad0e-9768-4c97-8fb3-00bb7cc60686 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:25.129370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dcbad0e-9768-4c97-8fb3-00bb7cc60686 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:25.129850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dcbad0e-9768-4c97-8fb3-00bb7cc60686 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:25.130282 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dcbad0e-9768-4c97-8fb3-00bb7cc60686 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:25.130971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dcbad0e-9768-4c97-8fb3-00bb7cc60686 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:25.131449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dcbad0e-9768-4c97-8fb3-00bb7cc60686 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:25.131872 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7dcbad0e-9768-4c97-8fb3-00bb7cc60686 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:25.261969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7dcbad0e-9768-4c97-8fb3-00bb7cc60686 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:25.270997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7dcbad0e-9768-4c97-8fb3-00bb7cc60686 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152274 Aug 30 15:02:25.271600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 902/1806] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:25 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:26.005155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-afe4de40-1bea-486f-99f0-ec66f9a1b49a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:26.005761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-afe4de40-1bea-486f-99f0-ec66f9a1b49a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:26.012208 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afe4de40-1bea-486f-99f0-ec66f9a1b49a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:26.012685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afe4de40-1bea-486f-99f0-ec66f9a1b49a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:26.013111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afe4de40-1bea-486f-99f0-ec66f9a1b49a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:26.013788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afe4de40-1bea-486f-99f0-ec66f9a1b49a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:26.014237 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afe4de40-1bea-486f-99f0-ec66f9a1b49a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:26.014656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afe4de40-1bea-486f-99f0-ec66f9a1b49a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:26.066509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2b9531de-2a0c-4226-aa3c-39af6ed210cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:26.067259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2b9531de-2a0c-4226-aa3c-39af6ed210cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:26.073886 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2b9531de-2a0c-4226-aa3c-39af6ed210cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:26.074708 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2b9531de-2a0c-4226-aa3c-39af6ed210cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:26.074837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2b9531de-2a0c-4226-aa3c-39af6ed210cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:26.075515 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2b9531de-2a0c-4226-aa3c-39af6ed210cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:26.076583 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2b9531de-2a0c-4226-aa3c-39af6ed210cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:26.076991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-afe4de40-1bea-486f-99f0-ec66f9a1b49a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:26.077700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2b9531de-2a0c-4226-aa3c-39af6ed210cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:26.087325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-afe4de40-1bea-486f-99f0-ec66f9a1b49a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:26.088767 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-afe4de40-1bea-486f-99f0-ec66f9a1b49a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:26.089905 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-afe4de40-1bea-486f-99f0-ec66f9a1b49a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089731 Aug 30 15:02:26.090455 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 905/1807] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:25 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:26.204312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2b9531de-2a0c-4226-aa3c-39af6ed210cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:26.212512 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2b9531de-2a0c-4226-aa3c-39af6ed210cd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150468 Aug 30 15:02:26.213087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 903/1808] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:26 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:26.292851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b80de7f6-bc96-410a-a5b4-6ef140d5c216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:26.293382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b80de7f6-bc96-410a-a5b4-6ef140d5c216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:26.300041 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b80de7f6-bc96-410a-a5b4-6ef140d5c216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:26.300557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b80de7f6-bc96-410a-a5b4-6ef140d5c216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:26.300989 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b80de7f6-bc96-410a-a5b4-6ef140d5c216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:26.301693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b80de7f6-bc96-410a-a5b4-6ef140d5c216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:26.302165 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b80de7f6-bc96-410a-a5b4-6ef140d5c216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:26.302580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b80de7f6-bc96-410a-a5b4-6ef140d5c216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:26.428854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b80de7f6-bc96-410a-a5b4-6ef140d5c216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:26.436982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b80de7f6-bc96-410a-a5b4-6ef140d5c216 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148056 Aug 30 15:02:26.437551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 906/1809] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:26 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:27.112582 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0e6f8980-6246-4528-aee6-d65335c6053c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:27.113187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0e6f8980-6246-4528-aee6-d65335c6053c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:27.119816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e6f8980-6246-4528-aee6-d65335c6053c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:27.120291 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e6f8980-6246-4528-aee6-d65335c6053c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:27.120766 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e6f8980-6246-4528-aee6-d65335c6053c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:27.121481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e6f8980-6246-4528-aee6-d65335c6053c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:27.121954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e6f8980-6246-4528-aee6-d65335c6053c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:27.122397 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e6f8980-6246-4528-aee6-d65335c6053c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:27.185921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0e6f8980-6246-4528-aee6-d65335c6053c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:27.189239 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:27.196490 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0e6f8980-6246-4528-aee6-d65335c6053c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:27.198116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0e6f8980-6246-4528-aee6-d65335c6053c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:27.199269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0e6f8980-6246-4528-aee6-d65335c6053c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090776 Aug 30 15:02:27.199826 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 904/1810] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:27 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:27.233036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-702bec89-0061-4fbc-8565-1c0aca25af30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:27.233644 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-702bec89-0061-4fbc-8565-1c0aca25af30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:27.240247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-702bec89-0061-4fbc-8565-1c0aca25af30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:27.240724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-702bec89-0061-4fbc-8565-1c0aca25af30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:27.241150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-702bec89-0061-4fbc-8565-1c0aca25af30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:27.241830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-702bec89-0061-4fbc-8565-1c0aca25af30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:27.242273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-702bec89-0061-4fbc-8565-1c0aca25af30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:27.242685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-702bec89-0061-4fbc-8565-1c0aca25af30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:27.371675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-702bec89-0061-4fbc-8565-1c0aca25af30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:27.380509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-702bec89-0061-4fbc-8565-1c0aca25af30 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151306 Aug 30 15:02:27.381070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 907/1811] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:27 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:27.457929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1a428e81-a67b-466f-adbf-cfd93158a65d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:27.458458 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1a428e81-a67b-466f-adbf-cfd93158a65d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:27.464214 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a428e81-a67b-466f-adbf-cfd93158a65d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:27.464683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a428e81-a67b-466f-adbf-cfd93158a65d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:27.465108 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a428e81-a67b-466f-adbf-cfd93158a65d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:27.465780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a428e81-a67b-466f-adbf-cfd93158a65d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:27.466218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a428e81-a67b-466f-adbf-cfd93158a65d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:27.466630 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a428e81-a67b-466f-adbf-cfd93158a65d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:27.593650 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1a428e81-a67b-466f-adbf-cfd93158a65d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:27.601821 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1a428e81-a67b-466f-adbf-cfd93158a65d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147950 Aug 30 15:02:27.602378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 905/1812] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:27 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:28.223797 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b4dc9a0e-a2eb-4029-898a-1d08cef02e62 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:28.224406 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b4dc9a0e-a2eb-4029-898a-1d08cef02e62 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:28.230400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b4dc9a0e-a2eb-4029-898a-1d08cef02e62 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:28.230898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b4dc9a0e-a2eb-4029-898a-1d08cef02e62 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:28.231345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b4dc9a0e-a2eb-4029-898a-1d08cef02e62 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:28.232028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b4dc9a0e-a2eb-4029-898a-1d08cef02e62 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:28.232469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b4dc9a0e-a2eb-4029-898a-1d08cef02e62 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:28.232881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b4dc9a0e-a2eb-4029-898a-1d08cef02e62 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:28.294323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b4dc9a0e-a2eb-4029-898a-1d08cef02e62 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:28.303154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b4dc9a0e-a2eb-4029-898a-1d08cef02e62 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:28.304618 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b4dc9a0e-a2eb-4029-898a-1d08cef02e62 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:28.305746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b4dc9a0e-a2eb-4029-898a-1d08cef02e62 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086800 Aug 30 15:02:28.306298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 908/1813] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:28 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:28.401949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3f525e02-41e9-490f-8e7c-70b52aa4d591 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:28.402538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3f525e02-41e9-490f-8e7c-70b52aa4d591 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:28.409044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f525e02-41e9-490f-8e7c-70b52aa4d591 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:28.409539 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f525e02-41e9-490f-8e7c-70b52aa4d591 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:28.410801 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f525e02-41e9-490f-8e7c-70b52aa4d591 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:28.412057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f525e02-41e9-490f-8e7c-70b52aa4d591 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:28.412557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f525e02-41e9-490f-8e7c-70b52aa4d591 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:28.413000 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f525e02-41e9-490f-8e7c-70b52aa4d591 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:28.555994 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3f525e02-41e9-490f-8e7c-70b52aa4d591 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:28.564550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3f525e02-41e9-490f-8e7c-70b52aa4d591 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.166529 Aug 30 15:02:28.565117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 906/1814] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:28 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:28.623424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0411d0d0-6632-418d-8ea8-1f18770f4f85 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:28.624031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0411d0d0-6632-418d-8ea8-1f18770f4f85 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:28.630544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0411d0d0-6632-418d-8ea8-1f18770f4f85 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:28.631268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0411d0d0-6632-418d-8ea8-1f18770f4f85 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:28.631710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0411d0d0-6632-418d-8ea8-1f18770f4f85 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:28.632410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0411d0d0-6632-418d-8ea8-1f18770f4f85 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:28.632859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0411d0d0-6632-418d-8ea8-1f18770f4f85 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:28.633277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0411d0d0-6632-418d-8ea8-1f18770f4f85 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:28.778019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0411d0d0-6632-418d-8ea8-1f18770f4f85 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:28.790983 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0411d0d0-6632-418d-8ea8-1f18770f4f85 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.171147 Aug 30 15:02:28.791969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 909/1815] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:28 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:29.328738 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-45686858-4665-4c43-8b3e-96864fef6e6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:29.329339 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-45686858-4665-4c43-8b3e-96864fef6e6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:29.335190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45686858-4665-4c43-8b3e-96864fef6e6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:29.335716 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45686858-4665-4c43-8b3e-96864fef6e6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:29.336116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45686858-4665-4c43-8b3e-96864fef6e6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:29.337088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45686858-4665-4c43-8b3e-96864fef6e6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:29.337613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45686858-4665-4c43-8b3e-96864fef6e6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:29.338071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45686858-4665-4c43-8b3e-96864fef6e6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:29.402804 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45686858-4665-4c43-8b3e-96864fef6e6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:29.412787 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45686858-4665-4c43-8b3e-96864fef6e6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:29.414293 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45686858-4665-4c43-8b3e-96864fef6e6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:29.415472 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-45686858-4665-4c43-8b3e-96864fef6e6e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090621 Aug 30 15:02:29.416038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 907/1816] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:29 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:29.586253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-531b2777-7a60-4d5d-bf7d-021624117a76 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:29.586907 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-531b2777-7a60-4d5d-bf7d-021624117a76 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:29.593577 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-531b2777-7a60-4d5d-bf7d-021624117a76 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:29.594062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-531b2777-7a60-4d5d-bf7d-021624117a76 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:29.594499 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-531b2777-7a60-4d5d-bf7d-021624117a76 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:29.595189 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-531b2777-7a60-4d5d-bf7d-021624117a76 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:29.595669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-531b2777-7a60-4d5d-bf7d-021624117a76 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:29.596096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-531b2777-7a60-4d5d-bf7d-021624117a76 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:29.724663 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-531b2777-7a60-4d5d-bf7d-021624117a76 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:29.732758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-531b2777-7a60-4d5d-bf7d-021624117a76 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150446 Aug 30 15:02:29.733328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 910/1817] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:29 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:29.812582 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e12fa2cb-d219-477d-8a30-4a64d36258e7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:29.813211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e12fa2cb-d219-477d-8a30-4a64d36258e7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:29.820123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e12fa2cb-d219-477d-8a30-4a64d36258e7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:29.820594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e12fa2cb-d219-477d-8a30-4a64d36258e7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:29.821019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e12fa2cb-d219-477d-8a30-4a64d36258e7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:29.821956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e12fa2cb-d219-477d-8a30-4a64d36258e7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:29.822408 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e12fa2cb-d219-477d-8a30-4a64d36258e7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:29.822824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e12fa2cb-d219-477d-8a30-4a64d36258e7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:29.955119 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e12fa2cb-d219-477d-8a30-4a64d36258e7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:29.964130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e12fa2cb-d219-477d-8a30-4a64d36258e7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.155375 Aug 30 15:02:29.964691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 908/1818] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:29 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:30.437979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b2818877-72b5-483d-a76b-b971f0352e25 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:30.438608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b2818877-72b5-483d-a76b-b971f0352e25 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:30.445231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2818877-72b5-483d-a76b-b971f0352e25 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:30.445752 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2818877-72b5-483d-a76b-b971f0352e25 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:30.446191 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2818877-72b5-483d-a76b-b971f0352e25 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:30.447165 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2818877-72b5-483d-a76b-b971f0352e25 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:30.447653 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2818877-72b5-483d-a76b-b971f0352e25 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:30.448080 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b2818877-72b5-483d-a76b-b971f0352e25 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:30.452102 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:30.508962 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b2818877-72b5-483d-a76b-b971f0352e25 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:30.517516 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b2818877-72b5-483d-a76b-b971f0352e25 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:30.518967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b2818877-72b5-483d-a76b-b971f0352e25 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:30.520143 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b2818877-72b5-483d-a76b-b971f0352e25 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086168 Aug 30 15:02:30.521340 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 911/1819] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:30 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:30.911583 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e7012883-6211-4675-8252-37fb5fc8385a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:30.912199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e7012883-6211-4675-8252-37fb5fc8385a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:30.918056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7012883-6211-4675-8252-37fb5fc8385a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:30.918536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7012883-6211-4675-8252-37fb5fc8385a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:30.918974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7012883-6211-4675-8252-37fb5fc8385a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:30.919697 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7012883-6211-4675-8252-37fb5fc8385a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:30.920155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7012883-6211-4675-8252-37fb5fc8385a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:30.920578 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e7012883-6211-4675-8252-37fb5fc8385a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:30.986076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-666628a9-e6cb-45d1-8c63-120c55cce445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:30.986694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-666628a9-e6cb-45d1-8c63-120c55cce445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:30.993356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-666628a9-e6cb-45d1-8c63-120c55cce445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:30.993843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-666628a9-e6cb-45d1-8c63-120c55cce445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:30.994275 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-666628a9-e6cb-45d1-8c63-120c55cce445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:30.995118 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-666628a9-e6cb-45d1-8c63-120c55cce445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:30.995620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-666628a9-e6cb-45d1-8c63-120c55cce445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:30.996040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-666628a9-e6cb-45d1-8c63-120c55cce445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:31.051544 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e7012883-6211-4675-8252-37fb5fc8385a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:31.059710 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e7012883-6211-4675-8252-37fb5fc8385a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.309487 Aug 30 15:02:31.060277 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 909/1820] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:30 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:31.126812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-666628a9-e6cb-45d1-8c63-120c55cce445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:31.135631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-666628a9-e6cb-45d1-8c63-120c55cce445 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153511 Aug 30 15:02:31.136200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 912/1821] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:30 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:31.543305 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c0b2e61c-0aec-47a4-9ee4-3e3127e103f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:31.543919 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c0b2e61c-0aec-47a4-9ee4-3e3127e103f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:31.549891 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0b2e61c-0aec-47a4-9ee4-3e3127e103f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:31.550304 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0b2e61c-0aec-47a4-9ee4-3e3127e103f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:31.550736 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0b2e61c-0aec-47a4-9ee4-3e3127e103f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:31.551455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0b2e61c-0aec-47a4-9ee4-3e3127e103f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:31.552503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0b2e61c-0aec-47a4-9ee4-3e3127e103f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:31.552930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0b2e61c-0aec-47a4-9ee4-3e3127e103f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:31.618620 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0b2e61c-0aec-47a4-9ee4-3e3127e103f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:31.627553 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0b2e61c-0aec-47a4-9ee4-3e3127e103f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:31.628992 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0b2e61c-0aec-47a4-9ee4-3e3127e103f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:31.630221 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c0b2e61c-0aec-47a4-9ee4-3e3127e103f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090970 Aug 30 15:02:31.630806 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 910/1822] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:31 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:32.080891 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-350b8a61-1327-403c-92cc-941680cefff0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:32.081520 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-350b8a61-1327-403c-92cc-941680cefff0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:32.088660 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-350b8a61-1327-403c-92cc-941680cefff0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:32.089132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-350b8a61-1327-403c-92cc-941680cefff0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:32.089562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-350b8a61-1327-403c-92cc-941680cefff0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:32.090238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-350b8a61-1327-403c-92cc-941680cefff0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:32.090680 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-350b8a61-1327-403c-92cc-941680cefff0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:32.091095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-350b8a61-1327-403c-92cc-941680cefff0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:32.156932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3a41f94b-9206-4f75-9b0e-34ffdf24dabe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:32.157543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3a41f94b-9206-4f75-9b0e-34ffdf24dabe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:32.166034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a41f94b-9206-4f75-9b0e-34ffdf24dabe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:32.166510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a41f94b-9206-4f75-9b0e-34ffdf24dabe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:32.166958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a41f94b-9206-4f75-9b0e-34ffdf24dabe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:32.167655 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a41f94b-9206-4f75-9b0e-34ffdf24dabe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:32.168102 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a41f94b-9206-4f75-9b0e-34ffdf24dabe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:32.168520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a41f94b-9206-4f75-9b0e-34ffdf24dabe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:32.221314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-350b8a61-1327-403c-92cc-941680cefff0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:32.230473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-350b8a61-1327-403c-92cc-941680cefff0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153412 Aug 30 15:02:32.231053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 913/1823] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:32 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:32.301711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3a41f94b-9206-4f75-9b0e-34ffdf24dabe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:32.310039 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3a41f94b-9206-4f75-9b0e-34ffdf24dabe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.157045 Aug 30 15:02:32.310613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 911/1824] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:32 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:32.652807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-579f0ed4-e5cb-4dbf-9c27-952289887b9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:32.653419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-579f0ed4-e5cb-4dbf-9c27-952289887b9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:32.659293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-579f0ed4-e5cb-4dbf-9c27-952289887b9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:32.659774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-579f0ed4-e5cb-4dbf-9c27-952289887b9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:32.660204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-579f0ed4-e5cb-4dbf-9c27-952289887b9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:32.661031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-579f0ed4-e5cb-4dbf-9c27-952289887b9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:32.661686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-579f0ed4-e5cb-4dbf-9c27-952289887b9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:32.662111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-579f0ed4-e5cb-4dbf-9c27-952289887b9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:32.722318 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-579f0ed4-e5cb-4dbf-9c27-952289887b9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:32.730962 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-579f0ed4-e5cb-4dbf-9c27-952289887b9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:32.732441 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-579f0ed4-e5cb-4dbf-9c27-952289887b9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:32.733587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-579f0ed4-e5cb-4dbf-9c27-952289887b9d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084741 Aug 30 15:02:32.734126 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 914/1825] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:32 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:33.251162 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bd69f6ac-cf3d-4972-868b-7a87f2cf1593 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:33.251833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bd69f6ac-cf3d-4972-868b-7a87f2cf1593 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:33.258198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd69f6ac-cf3d-4972-868b-7a87f2cf1593 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:33.258679 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd69f6ac-cf3d-4972-868b-7a87f2cf1593 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:33.259114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd69f6ac-cf3d-4972-868b-7a87f2cf1593 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:33.259828 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd69f6ac-cf3d-4972-868b-7a87f2cf1593 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:33.260282 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd69f6ac-cf3d-4972-868b-7a87f2cf1593 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:33.260706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd69f6ac-cf3d-4972-868b-7a87f2cf1593 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:33.332183 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-556c510b-9611-4b32-ace5-93ebffd96bb6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:33.333017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-556c510b-9611-4b32-ace5-93ebffd96bb6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:33.339936 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-556c510b-9611-4b32-ace5-93ebffd96bb6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:33.340488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-556c510b-9611-4b32-ace5-93ebffd96bb6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:33.340987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-556c510b-9611-4b32-ace5-93ebffd96bb6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:33.341750 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-556c510b-9611-4b32-ace5-93ebffd96bb6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:33.342289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-556c510b-9611-4b32-ace5-93ebffd96bb6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:33.342715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-556c510b-9611-4b32-ace5-93ebffd96bb6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:33.391727 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bd69f6ac-cf3d-4972-868b-7a87f2cf1593 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:33.400306 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bd69f6ac-cf3d-4972-868b-7a87f2cf1593 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153085 Aug 30 15:02:33.400866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 912/1826] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:33 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:33.479196 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-556c510b-9611-4b32-ace5-93ebffd96bb6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:33.487246 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-556c510b-9611-4b32-ace5-93ebffd96bb6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.159056 Aug 30 15:02:33.487815 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 915/1827] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:33 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:33.758012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f0cd9f1f-835e-4e4c-9ef6-4804016c60c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:33.758525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f0cd9f1f-835e-4e4c-9ef6-4804016c60c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:33.764371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0cd9f1f-835e-4e4c-9ef6-4804016c60c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:33.764838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0cd9f1f-835e-4e4c-9ef6-4804016c60c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:33.765261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0cd9f1f-835e-4e4c-9ef6-4804016c60c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:33.765931 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0cd9f1f-835e-4e4c-9ef6-4804016c60c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:33.766372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0cd9f1f-835e-4e4c-9ef6-4804016c60c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:33.766786 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0cd9f1f-835e-4e4c-9ef6-4804016c60c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:33.829598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f0cd9f1f-835e-4e4c-9ef6-4804016c60c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:33.838533 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f0cd9f1f-835e-4e4c-9ef6-4804016c60c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:33.839982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f0cd9f1f-835e-4e4c-9ef6-4804016c60c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:33.841107 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f0cd9f1f-835e-4e4c-9ef6-4804016c60c4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088263 Aug 30 15:02:33.841662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 913/1828] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:33 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:34.422070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fad0ecbd-1dca-41b2-b30b-639b1f88529c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:34.422710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fad0ecbd-1dca-41b2-b30b-639b1f88529c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:34.429852 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fad0ecbd-1dca-41b2-b30b-639b1f88529c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:34.430326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fad0ecbd-1dca-41b2-b30b-639b1f88529c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:34.430751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fad0ecbd-1dca-41b2-b30b-639b1f88529c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:34.431464 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fad0ecbd-1dca-41b2-b30b-639b1f88529c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:34.431912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fad0ecbd-1dca-41b2-b30b-639b1f88529c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:34.432332 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fad0ecbd-1dca-41b2-b30b-639b1f88529c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:34.508540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5715af69-e88f-4924-9e6c-5245e3a57772 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:34.509281 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5715af69-e88f-4924-9e6c-5245e3a57772 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:34.515560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5715af69-e88f-4924-9e6c-5245e3a57772 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:34.516045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5715af69-e88f-4924-9e6c-5245e3a57772 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:34.516480 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5715af69-e88f-4924-9e6c-5245e3a57772 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:34.517178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5715af69-e88f-4924-9e6c-5245e3a57772 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:34.517627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5715af69-e88f-4924-9e6c-5245e3a57772 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:34.518051 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5715af69-e88f-4924-9e6c-5245e3a57772 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:34.561121 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fad0ecbd-1dca-41b2-b30b-639b1f88529c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:34.569528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fad0ecbd-1dca-41b2-b30b-639b1f88529c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151296 Aug 30 15:02:34.570300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 916/1829] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:34 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:34.649337 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5715af69-e88f-4924-9e6c-5245e3a57772 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:34.657471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5715af69-e88f-4924-9e6c-5245e3a57772 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153473 Aug 30 15:02:34.658042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 914/1830] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:34 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:34.966805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-56cb220d-75ca-4d49-bd6d-d72a1504aca9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:34.967645 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-56cb220d-75ca-4d49-bd6d-d72a1504aca9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:34.974979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-56cb220d-75ca-4d49-bd6d-d72a1504aca9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:34.975576 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-56cb220d-75ca-4d49-bd6d-d72a1504aca9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:34.976042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-56cb220d-75ca-4d49-bd6d-d72a1504aca9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:34.976826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-56cb220d-75ca-4d49-bd6d-d72a1504aca9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:34.977309 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-56cb220d-75ca-4d49-bd6d-d72a1504aca9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:34.977860 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-56cb220d-75ca-4d49-bd6d-d72a1504aca9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:35.040223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-56cb220d-75ca-4d49-bd6d-d72a1504aca9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:35.048905 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-56cb220d-75ca-4d49-bd6d-d72a1504aca9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:35.050329 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-56cb220d-75ca-4d49-bd6d-d72a1504aca9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:35.051884 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-56cb220d-75ca-4d49-bd6d-d72a1504aca9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.191938 Aug 30 15:02:35.052520 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 917/1831] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:34 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:35.591455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-42117579-71c4-4a15-b126-ea5e11d793f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:35.592072 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-42117579-71c4-4a15-b126-ea5e11d793f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:35.598487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42117579-71c4-4a15-b126-ea5e11d793f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:35.598977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42117579-71c4-4a15-b126-ea5e11d793f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:35.599448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42117579-71c4-4a15-b126-ea5e11d793f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:35.600139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42117579-71c4-4a15-b126-ea5e11d793f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:35.600591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42117579-71c4-4a15-b126-ea5e11d793f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:35.601018 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42117579-71c4-4a15-b126-ea5e11d793f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:35.678723 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-12011e49-c932-4596-a93c-060c78fe8747 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:35.679924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-12011e49-c932-4596-a93c-060c78fe8747 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:35.686266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12011e49-c932-4596-a93c-060c78fe8747 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:35.686753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12011e49-c932-4596-a93c-060c78fe8747 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:35.687187 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12011e49-c932-4596-a93c-060c78fe8747 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:35.687908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12011e49-c932-4596-a93c-060c78fe8747 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:35.688363 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12011e49-c932-4596-a93c-060c78fe8747 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:35.688787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12011e49-c932-4596-a93c-060c78fe8747 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:35.728309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-42117579-71c4-4a15-b126-ea5e11d793f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:35.736627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-42117579-71c4-4a15-b126-ea5e11d793f4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149052 Aug 30 15:02:35.737198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 915/1832] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:35 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:35.823148 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-12011e49-c932-4596-a93c-060c78fe8747 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:35.831332 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-12011e49-c932-4596-a93c-060c78fe8747 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.157229 Aug 30 15:02:35.831900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 918/1833] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:35 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:36.074388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bc4c0f40-ebb4-4f7c-a408-b56bb8469720 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:36.074994 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bc4c0f40-ebb4-4f7c-a408-b56bb8469720 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:36.080867 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4c0f40-ebb4-4f7c-a408-b56bb8469720 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:36.081336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4c0f40-ebb4-4f7c-a408-b56bb8469720 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:36.081760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4c0f40-ebb4-4f7c-a408-b56bb8469720 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:36.082452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4c0f40-ebb4-4f7c-a408-b56bb8469720 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:36.082879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4c0f40-ebb4-4f7c-a408-b56bb8469720 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:36.083324 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4c0f40-ebb4-4f7c-a408-b56bb8469720 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:36.147746 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bc4c0f40-ebb4-4f7c-a408-b56bb8469720 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:36.156213 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bc4c0f40-ebb4-4f7c-a408-b56bb8469720 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:36.157632 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bc4c0f40-ebb4-4f7c-a408-b56bb8469720 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:36.158769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bc4c0f40-ebb4-4f7c-a408-b56bb8469720 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088569 Aug 30 15:02:36.159353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 916/1834] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:36 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:36.758501 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5ad3d1c6-b203-4286-90f0-f74764f9a483 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:36.759032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5ad3d1c6-b203-4286-90f0-f74764f9a483 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:36.765443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ad3d1c6-b203-4286-90f0-f74764f9a483 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:36.765927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ad3d1c6-b203-4286-90f0-f74764f9a483 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:36.766365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ad3d1c6-b203-4286-90f0-f74764f9a483 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:36.767061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ad3d1c6-b203-4286-90f0-f74764f9a483 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:36.767540 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ad3d1c6-b203-4286-90f0-f74764f9a483 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:36.767964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5ad3d1c6-b203-4286-90f0-f74764f9a483 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:36.852351 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b7bbc6de-5be3-49e1-9d0b-83e4a07fc79c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:36.853503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b7bbc6de-5be3-49e1-9d0b-83e4a07fc79c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:36.859927 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7bbc6de-5be3-49e1-9d0b-83e4a07fc79c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:36.860401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7bbc6de-5be3-49e1-9d0b-83e4a07fc79c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:36.860828 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7bbc6de-5be3-49e1-9d0b-83e4a07fc79c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:36.861511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7bbc6de-5be3-49e1-9d0b-83e4a07fc79c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:36.861954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7bbc6de-5be3-49e1-9d0b-83e4a07fc79c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:36.862367 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7bbc6de-5be3-49e1-9d0b-83e4a07fc79c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:36.899551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5ad3d1c6-b203-4286-90f0-f74764f9a483 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:36.907843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5ad3d1c6-b203-4286-90f0-f74764f9a483 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153828 Aug 30 15:02:36.908431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 919/1835] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:36 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:36.990834 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b7bbc6de-5be3-49e1-9d0b-83e4a07fc79c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:36.999141 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b7bbc6de-5be3-49e1-9d0b-83e4a07fc79c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150913 Aug 30 15:02:36.999785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 917/1836] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:36 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:37.182200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b5aae31c-d368-437d-97d5-6a24fb50b11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:37.182806 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b5aae31c-d368-437d-97d5-6a24fb50b11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:37.188750 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5aae31c-d368-437d-97d5-6a24fb50b11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:37.189227 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5aae31c-d368-437d-97d5-6a24fb50b11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:37.189658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5aae31c-d368-437d-97d5-6a24fb50b11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:37.190374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5aae31c-d368-437d-97d5-6a24fb50b11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:37.190828 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5aae31c-d368-437d-97d5-6a24fb50b11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:37.191268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b5aae31c-d368-437d-97d5-6a24fb50b11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:37.254023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b5aae31c-d368-437d-97d5-6a24fb50b11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:37.263180 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b5aae31c-d368-437d-97d5-6a24fb50b11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:37.264660 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b5aae31c-d368-437d-97d5-6a24fb50b11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:37.265790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b5aae31c-d368-437d-97d5-6a24fb50b11b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087613 Aug 30 15:02:37.266374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 920/1837] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:37 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:37.928941 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d790c752-a4e1-4396-9bfb-7f69e3930bf0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:37.929552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d790c752-a4e1-4396-9bfb-7f69e3930bf0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:37.936028 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d790c752-a4e1-4396-9bfb-7f69e3930bf0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:37.936510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d790c752-a4e1-4396-9bfb-7f69e3930bf0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:37.936943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d790c752-a4e1-4396-9bfb-7f69e3930bf0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:37.937632 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d790c752-a4e1-4396-9bfb-7f69e3930bf0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:37.938081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d790c752-a4e1-4396-9bfb-7f69e3930bf0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:37.938499 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d790c752-a4e1-4396-9bfb-7f69e3930bf0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:38.021596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-234ea4b1-63eb-4b10-8f64-66228e2bf2b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:38.022211 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-234ea4b1-63eb-4b10-8f64-66228e2bf2b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:38.028625 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-234ea4b1-63eb-4b10-8f64-66228e2bf2b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:38.029110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-234ea4b1-63eb-4b10-8f64-66228e2bf2b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:38.029544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-234ea4b1-63eb-4b10-8f64-66228e2bf2b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:38.030236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-234ea4b1-63eb-4b10-8f64-66228e2bf2b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:38.030701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-234ea4b1-63eb-4b10-8f64-66228e2bf2b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:38.031131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-234ea4b1-63eb-4b10-8f64-66228e2bf2b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:38.066080 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d790c752-a4e1-4396-9bfb-7f69e3930bf0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:38.074959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d790c752-a4e1-4396-9bfb-7f69e3930bf0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150015 Aug 30 15:02:38.075621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 918/1838] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:37 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:38.162087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-234ea4b1-63eb-4b10-8f64-66228e2bf2b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:38.170115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-234ea4b1-63eb-4b10-8f64-66228e2bf2b4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153212 Aug 30 15:02:38.170676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 921/1839] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:38 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:38.288580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1b77cb38-1ece-459e-9840-68550871e72d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:38.289149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1b77cb38-1ece-459e-9840-68550871e72d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:38.295038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b77cb38-1ece-459e-9840-68550871e72d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:38.295542 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b77cb38-1ece-459e-9840-68550871e72d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:38.295977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b77cb38-1ece-459e-9840-68550871e72d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:38.296656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b77cb38-1ece-459e-9840-68550871e72d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:38.297102 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b77cb38-1ece-459e-9840-68550871e72d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:38.297517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b77cb38-1ece-459e-9840-68550871e72d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:38.361142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1b77cb38-1ece-459e-9840-68550871e72d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:38.370374 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1b77cb38-1ece-459e-9840-68550871e72d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:38.371838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1b77cb38-1ece-459e-9840-68550871e72d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:38.372976 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1b77cb38-1ece-459e-9840-68550871e72d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088480 Aug 30 15:02:38.373669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 919/1840] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:38 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:39.096280 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ec1b6f48-f481-4454-a49d-6c4e57231819 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:39.096880 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ec1b6f48-f481-4454-a49d-6c4e57231819 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:39.104598 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec1b6f48-f481-4454-a49d-6c4e57231819 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:39.105079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec1b6f48-f481-4454-a49d-6c4e57231819 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:39.105508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec1b6f48-f481-4454-a49d-6c4e57231819 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:39.106257 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec1b6f48-f481-4454-a49d-6c4e57231819 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:39.106969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec1b6f48-f481-4454-a49d-6c4e57231819 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:39.107419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ec1b6f48-f481-4454-a49d-6c4e57231819 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:39.191061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-73d076aa-e4cd-47f6-a79f-31641e8ca27d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:39.191775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-73d076aa-e4cd-47f6-a79f-31641e8ca27d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:39.198595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73d076aa-e4cd-47f6-a79f-31641e8ca27d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:39.199076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73d076aa-e4cd-47f6-a79f-31641e8ca27d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:39.199618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73d076aa-e4cd-47f6-a79f-31641e8ca27d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:39.200313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73d076aa-e4cd-47f6-a79f-31641e8ca27d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:39.200764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73d076aa-e4cd-47f6-a79f-31641e8ca27d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:39.201183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73d076aa-e4cd-47f6-a79f-31641e8ca27d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:39.238750 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ec1b6f48-f481-4454-a49d-6c4e57231819 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:39.247831 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ec1b6f48-f481-4454-a49d-6c4e57231819 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.155448 Aug 30 15:02:39.248399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 922/1841] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:39 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:39.330655 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-73d076aa-e4cd-47f6-a79f-31641e8ca27d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:39.339639 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-73d076aa-e4cd-47f6-a79f-31641e8ca27d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152302 Aug 30 15:02:39.340201 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 920/1842] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:39 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:39.396397 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5e52a28a-3238-4bdf-afae-60df29ad4b71 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:39.396921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5e52a28a-3238-4bdf-afae-60df29ad4b71 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:39.402781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e52a28a-3238-4bdf-afae-60df29ad4b71 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:39.403287 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e52a28a-3238-4bdf-afae-60df29ad4b71 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:39.403728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e52a28a-3238-4bdf-afae-60df29ad4b71 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:39.404407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e52a28a-3238-4bdf-afae-60df29ad4b71 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:39.404858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e52a28a-3238-4bdf-afae-60df29ad4b71 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:39.405270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e52a28a-3238-4bdf-afae-60df29ad4b71 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:39.477132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5e52a28a-3238-4bdf-afae-60df29ad4b71 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:39.485693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5e52a28a-3238-4bdf-afae-60df29ad4b71 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:39.487128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5e52a28a-3238-4bdf-afae-60df29ad4b71 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:39.488288 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5e52a28a-3238-4bdf-afae-60df29ad4b71 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.095954 Aug 30 15:02:39.489450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 923/1843] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:39 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:40.268866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c334164c-66f2-4195-9957-8d2ca34c0976 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:40.269477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c334164c-66f2-4195-9957-8d2ca34c0976 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:40.276320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c334164c-66f2-4195-9957-8d2ca34c0976 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:40.276798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c334164c-66f2-4195-9957-8d2ca34c0976 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:40.277229 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c334164c-66f2-4195-9957-8d2ca34c0976 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:40.277908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c334164c-66f2-4195-9957-8d2ca34c0976 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:40.278358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c334164c-66f2-4195-9957-8d2ca34c0976 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:40.278777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c334164c-66f2-4195-9957-8d2ca34c0976 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:40.296801 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:40.368023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9793f95a-6c24-4a2c-93c8-83d9816bbae5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:40.368719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9793f95a-6c24-4a2c-93c8-83d9816bbae5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:40.374625 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9793f95a-6c24-4a2c-93c8-83d9816bbae5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:40.375194 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9793f95a-6c24-4a2c-93c8-83d9816bbae5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:40.375720 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9793f95a-6c24-4a2c-93c8-83d9816bbae5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:40.376473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9793f95a-6c24-4a2c-93c8-83d9816bbae5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:40.376987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9793f95a-6c24-4a2c-93c8-83d9816bbae5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:40.377476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9793f95a-6c24-4a2c-93c8-83d9816bbae5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:40.407598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c334164c-66f2-4195-9957-8d2ca34c0976 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:40.418637 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c334164c-66f2-4195-9957-8d2ca34c0976 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153580 Aug 30 15:02:40.419222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 921/1844] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:40 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:40.506573 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9793f95a-6c24-4a2c-93c8-83d9816bbae5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:40.511895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-21b4abb2-22ea-4b84-a010-78323fb91688 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:40.512505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-21b4abb2-22ea-4b84-a010-78323fb91688 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:40.514746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9793f95a-6c24-4a2c-93c8-83d9816bbae5 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151208 Aug 30 15:02:40.515338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 924/1845] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:40 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:40.518460 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21b4abb2-22ea-4b84-a010-78323fb91688 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:40.518936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21b4abb2-22ea-4b84-a010-78323fb91688 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:40.519410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21b4abb2-22ea-4b84-a010-78323fb91688 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:40.521532 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21b4abb2-22ea-4b84-a010-78323fb91688 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:40.521995 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21b4abb2-22ea-4b84-a010-78323fb91688 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:40.522419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21b4abb2-22ea-4b84-a010-78323fb91688 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:40.589108 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-21b4abb2-22ea-4b84-a010-78323fb91688 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:40.597715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-21b4abb2-22ea-4b84-a010-78323fb91688 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:40.599745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-21b4abb2-22ea-4b84-a010-78323fb91688 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:40.600885 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-21b4abb2-22ea-4b84-a010-78323fb91688 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.092836 Aug 30 15:02:40.601443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 922/1846] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:40 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:41.439422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6508cde2-cbb2-4fd9-bfe7-4b684301bd47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:41.440032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6508cde2-cbb2-4fd9-bfe7-4b684301bd47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:41.446470 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6508cde2-cbb2-4fd9-bfe7-4b684301bd47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:41.447233 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6508cde2-cbb2-4fd9-bfe7-4b684301bd47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:41.447660 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6508cde2-cbb2-4fd9-bfe7-4b684301bd47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:41.448447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6508cde2-cbb2-4fd9-bfe7-4b684301bd47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:41.448889 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6508cde2-cbb2-4fd9-bfe7-4b684301bd47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:41.449307 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6508cde2-cbb2-4fd9-bfe7-4b684301bd47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:41.536796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3e7c2980-ba2f-44e4-9efe-0ae3e8cf8c2a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:41.537435 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3e7c2980-ba2f-44e4-9efe-0ae3e8cf8c2a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:41.543862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e7c2980-ba2f-44e4-9efe-0ae3e8cf8c2a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:41.544343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e7c2980-ba2f-44e4-9efe-0ae3e8cf8c2a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:41.544774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e7c2980-ba2f-44e4-9efe-0ae3e8cf8c2a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:41.545464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e7c2980-ba2f-44e4-9efe-0ae3e8cf8c2a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:41.545913 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e7c2980-ba2f-44e4-9efe-0ae3e8cf8c2a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:41.546332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3e7c2980-ba2f-44e4-9efe-0ae3e8cf8c2a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:41.576298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6508cde2-cbb2-4fd9-bfe7-4b684301bd47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:41.584871 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6508cde2-cbb2-4fd9-bfe7-4b684301bd47 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149353 Aug 30 15:02:41.585451 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 925/1847] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:41 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:41.623108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-63b8e938-dcb6-4b41-86e5-d72fa23068cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:41.623746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-63b8e938-dcb6-4b41-86e5-d72fa23068cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:41.629759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63b8e938-dcb6-4b41-86e5-d72fa23068cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:41.630243 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63b8e938-dcb6-4b41-86e5-d72fa23068cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:41.630667 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63b8e938-dcb6-4b41-86e5-d72fa23068cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:41.631518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63b8e938-dcb6-4b41-86e5-d72fa23068cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:41.631972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63b8e938-dcb6-4b41-86e5-d72fa23068cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:41.632388 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63b8e938-dcb6-4b41-86e5-d72fa23068cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:41.675921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3e7c2980-ba2f-44e4-9efe-0ae3e8cf8c2a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:41.684292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3e7c2980-ba2f-44e4-9efe-0ae3e8cf8c2a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151927 Aug 30 15:02:41.684868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 923/1848] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:41 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:41.698679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-63b8e938-dcb6-4b41-86e5-d72fa23068cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:41.707282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-63b8e938-dcb6-4b41-86e5-d72fa23068cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:41.709412 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-63b8e938-dcb6-4b41-86e5-d72fa23068cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:41.710550 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-63b8e938-dcb6-4b41-86e5-d72fa23068cd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091386 Aug 30 15:02:41.711125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 926/1849] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:41 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:02:42.605502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9b64d263-c876-42b7-a5f7-8689942805de tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:42.606116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9b64d263-c876-42b7-a5f7-8689942805de tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:42.612443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b64d263-c876-42b7-a5f7-8689942805de tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:42.612920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b64d263-c876-42b7-a5f7-8689942805de tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:42.613352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b64d263-c876-42b7-a5f7-8689942805de tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:42.614044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b64d263-c876-42b7-a5f7-8689942805de tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:42.614567 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b64d263-c876-42b7-a5f7-8689942805de tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:42.614990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b64d263-c876-42b7-a5f7-8689942805de tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:42.705418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ca10297b-787e-4e7b-ade1-2a667eb4018a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:42.706058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ca10297b-787e-4e7b-ade1-2a667eb4018a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:42.713277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca10297b-787e-4e7b-ade1-2a667eb4018a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:42.713751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca10297b-787e-4e7b-ade1-2a667eb4018a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:42.714177 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca10297b-787e-4e7b-ade1-2a667eb4018a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:42.714857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca10297b-787e-4e7b-ade1-2a667eb4018a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:42.715480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca10297b-787e-4e7b-ade1-2a667eb4018a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:42.715746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca10297b-787e-4e7b-ade1-2a667eb4018a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:42.822206 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b64d263-c876-42b7-a5f7-8689942805de tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:42.830987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9b64d263-c876-42b7-a5f7-8689942805de tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.229333 Aug 30 15:02:42.832782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 924/1850] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:42 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:42.837062 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-665879c6-7367-492f-8074-dccc92357525 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:42.837525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-665879c6-7367-492f-8074-dccc92357525 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:42.843528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-665879c6-7367-492f-8074-dccc92357525 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:42.843997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-665879c6-7367-492f-8074-dccc92357525 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:42.844445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-665879c6-7367-492f-8074-dccc92357525 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:42.845139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-665879c6-7367-492f-8074-dccc92357525 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:42.845584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-665879c6-7367-492f-8074-dccc92357525 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:42.846001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-665879c6-7367-492f-8074-dccc92357525 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:42.854949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ca10297b-787e-4e7b-ade1-2a667eb4018a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:42.858540 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:42.866614 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ca10297b-787e-4e7b-ade1-2a667eb4018a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.164586 Aug 30 15:02:42.869411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 927/1851] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:42 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:42.927864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-665879c6-7367-492f-8074-dccc92357525 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:42.936412 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-665879c6-7367-492f-8074-dccc92357525 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:42.937854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-665879c6-7367-492f-8074-dccc92357525 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:42.939032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-665879c6-7367-492f-8074-dccc92357525 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.106468 Aug 30 15:02:42.939628 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 925/1852] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:42 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:43.852634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a00b2896-6316-4242-b4f5-02abf515c9be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:43.853247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a00b2896-6316-4242-b4f5-02abf515c9be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:43.859644 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a00b2896-6316-4242-b4f5-02abf515c9be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:43.860125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a00b2896-6316-4242-b4f5-02abf515c9be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:43.860560 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a00b2896-6316-4242-b4f5-02abf515c9be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:43.861248 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a00b2896-6316-4242-b4f5-02abf515c9be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:43.861700 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a00b2896-6316-4242-b4f5-02abf515c9be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:43.862120 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a00b2896-6316-4242-b4f5-02abf515c9be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:43.888220 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-08c904d9-0025-4254-a825-610657ba1c30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:43.888920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-08c904d9-0025-4254-a825-610657ba1c30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:43.896047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08c904d9-0025-4254-a825-610657ba1c30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:43.896660 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08c904d9-0025-4254-a825-610657ba1c30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:43.897066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08c904d9-0025-4254-a825-610657ba1c30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:43.897758 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08c904d9-0025-4254-a825-610657ba1c30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:43.898204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08c904d9-0025-4254-a825-610657ba1c30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:43.898625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08c904d9-0025-4254-a825-610657ba1c30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:43.995125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a00b2896-6316-4242-b4f5-02abf515c9be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:44.003683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a00b2896-6316-4242-b4f5-02abf515c9be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.155426 Aug 30 15:02:44.004810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 928/1853] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:43 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:44.009655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-65897f14-7131-4073-8a79-dd34b746e095 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:44.010269 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-65897f14-7131-4073-8a79-dd34b746e095 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:44.016069 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65897f14-7131-4073-8a79-dd34b746e095 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:44.016553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65897f14-7131-4073-8a79-dd34b746e095 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:44.016991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65897f14-7131-4073-8a79-dd34b746e095 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:44.017686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65897f14-7131-4073-8a79-dd34b746e095 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:44.018325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65897f14-7131-4073-8a79-dd34b746e095 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:44.018756 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65897f14-7131-4073-8a79-dd34b746e095 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:44.028790 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-08c904d9-0025-4254-a825-610657ba1c30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:44.036905 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-08c904d9-0025-4254-a825-610657ba1c30 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152614 Aug 30 15:02:44.037560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 926/1854] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:43 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:44.085204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-65897f14-7131-4073-8a79-dd34b746e095 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:44.093765 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-65897f14-7131-4073-8a79-dd34b746e095 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:44.095272 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-65897f14-7131-4073-8a79-dd34b746e095 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:44.096411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-65897f14-7131-4073-8a79-dd34b746e095 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090686 Aug 30 15:02:44.096978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 929/1855] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:44 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:45.025972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-391d9cef-0bb8-4f75-a086-6705085352a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:45.026571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-391d9cef-0bb8-4f75-a086-6705085352a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:45.032886 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-391d9cef-0bb8-4f75-a086-6705085352a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:45.033360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-391d9cef-0bb8-4f75-a086-6705085352a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:45.033787 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-391d9cef-0bb8-4f75-a086-6705085352a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:45.034464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-391d9cef-0bb8-4f75-a086-6705085352a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:45.034910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-391d9cef-0bb8-4f75-a086-6705085352a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:45.035353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-391d9cef-0bb8-4f75-a086-6705085352a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:45.058269 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e401c8ff-d3f8-41b1-9b84-c96f7ac95617 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:45.058875 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e401c8ff-d3f8-41b1-9b84-c96f7ac95617 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:45.065252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e401c8ff-d3f8-41b1-9b84-c96f7ac95617 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:45.065736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e401c8ff-d3f8-41b1-9b84-c96f7ac95617 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:45.066163 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e401c8ff-d3f8-41b1-9b84-c96f7ac95617 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:45.066898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e401c8ff-d3f8-41b1-9b84-c96f7ac95617 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:45.067697 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e401c8ff-d3f8-41b1-9b84-c96f7ac95617 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:45.068147 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e401c8ff-d3f8-41b1-9b84-c96f7ac95617 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:45.166395 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-391d9cef-0bb8-4f75-a086-6705085352a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:45.174503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-391d9cef-0bb8-4f75-a086-6705085352a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152372 Aug 30 15:02:45.175073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 927/1856] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:45 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:45.179642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ed080c15-2a8b-4704-8ed2-7b8db5195115 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:45.180247 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ed080c15-2a8b-4704-8ed2-7b8db5195115 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:45.185809 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed080c15-2a8b-4704-8ed2-7b8db5195115 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:45.186304 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed080c15-2a8b-4704-8ed2-7b8db5195115 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:45.186724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed080c15-2a8b-4704-8ed2-7b8db5195115 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:45.187493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed080c15-2a8b-4704-8ed2-7b8db5195115 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:45.188147 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed080c15-2a8b-4704-8ed2-7b8db5195115 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:45.188573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ed080c15-2a8b-4704-8ed2-7b8db5195115 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:45.198374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e401c8ff-d3f8-41b1-9b84-c96f7ac95617 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:45.206453 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e401c8ff-d3f8-41b1-9b84-c96f7ac95617 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152118 Aug 30 15:02:45.207027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 930/1857] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:45 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:45.253066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ed080c15-2a8b-4704-8ed2-7b8db5195115 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:45.261641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ed080c15-2a8b-4704-8ed2-7b8db5195115 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:45.263078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ed080c15-2a8b-4704-8ed2-7b8db5195115 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:45.264251 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ed080c15-2a8b-4704-8ed2-7b8db5195115 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088240 Aug 30 15:02:45.264811 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 928/1858] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:45 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:46.197083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c9a7c1ba-6a55-45b5-920f-0866b797e5af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:46.197721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c9a7c1ba-6a55-45b5-920f-0866b797e5af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:46.204195 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c9a7c1ba-6a55-45b5-920f-0866b797e5af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:46.204676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c9a7c1ba-6a55-45b5-920f-0866b797e5af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:46.205108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c9a7c1ba-6a55-45b5-920f-0866b797e5af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:46.205805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c9a7c1ba-6a55-45b5-920f-0866b797e5af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:46.206254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c9a7c1ba-6a55-45b5-920f-0866b797e5af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:46.206676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c9a7c1ba-6a55-45b5-920f-0866b797e5af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:46.228280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-110aa41c-ae19-4a2d-895f-db717af02f0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:46.228986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-110aa41c-ae19-4a2d-895f-db717af02f0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:46.235813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-110aa41c-ae19-4a2d-895f-db717af02f0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:46.236297 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-110aa41c-ae19-4a2d-895f-db717af02f0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:46.236730 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-110aa41c-ae19-4a2d-895f-db717af02f0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:46.237426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-110aa41c-ae19-4a2d-895f-db717af02f0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:46.237904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-110aa41c-ae19-4a2d-895f-db717af02f0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:46.238365 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-110aa41c-ae19-4a2d-895f-db717af02f0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:46.340063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c9a7c1ba-6a55-45b5-920f-0866b797e5af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:46.348870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c9a7c1ba-6a55-45b5-920f-0866b797e5af tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.156154 Aug 30 15:02:46.349424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 931/1859] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:46 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:46.354292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ca2b4846-8d27-4fb6-b1d5-efbef1dea1ca tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:46.354567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ca2b4846-8d27-4fb6-b1d5-efbef1dea1ca tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:46.360197 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca2b4846-8d27-4fb6-b1d5-efbef1dea1ca tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:46.360682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca2b4846-8d27-4fb6-b1d5-efbef1dea1ca tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:46.361365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca2b4846-8d27-4fb6-b1d5-efbef1dea1ca tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:46.361775 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca2b4846-8d27-4fb6-b1d5-efbef1dea1ca tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:46.362233 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca2b4846-8d27-4fb6-b1d5-efbef1dea1ca tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:46.362632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ca2b4846-8d27-4fb6-b1d5-efbef1dea1ca tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:46.369132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-110aa41c-ae19-4a2d-895f-db717af02f0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:46.377168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-110aa41c-ae19-4a2d-895f-db717af02f0a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152722 Aug 30 15:02:46.377739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 929/1860] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:46 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:46.428135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ca2b4846-8d27-4fb6-b1d5-efbef1dea1ca tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:46.436559 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ca2b4846-8d27-4fb6-b1d5-efbef1dea1ca tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:46.437990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ca2b4846-8d27-4fb6-b1d5-efbef1dea1ca tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:46.439110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ca2b4846-8d27-4fb6-b1d5-efbef1dea1ca tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088780 Aug 30 15:02:46.439709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 932/1861] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:46 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:47.369512 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8ec054e6-98e0-4cad-afaf-a5cbaa763405 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:47.370128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8ec054e6-98e0-4cad-afaf-a5cbaa763405 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:47.376505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ec054e6-98e0-4cad-afaf-a5cbaa763405 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:47.376985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ec054e6-98e0-4cad-afaf-a5cbaa763405 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:47.377421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ec054e6-98e0-4cad-afaf-a5cbaa763405 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:47.378108 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ec054e6-98e0-4cad-afaf-a5cbaa763405 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:47.378564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ec054e6-98e0-4cad-afaf-a5cbaa763405 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:47.378987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8ec054e6-98e0-4cad-afaf-a5cbaa763405 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:47.398584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3a71d2fe-a8cc-4298-a4c6-11d3d95b2cbe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:47.399196 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3a71d2fe-a8cc-4298-a4c6-11d3d95b2cbe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:47.405502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a71d2fe-a8cc-4298-a4c6-11d3d95b2cbe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:47.405974 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a71d2fe-a8cc-4298-a4c6-11d3d95b2cbe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:47.406402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a71d2fe-a8cc-4298-a4c6-11d3d95b2cbe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:47.407093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a71d2fe-a8cc-4298-a4c6-11d3d95b2cbe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:47.407566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a71d2fe-a8cc-4298-a4c6-11d3d95b2cbe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:47.407982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a71d2fe-a8cc-4298-a4c6-11d3d95b2cbe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:47.521639 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8ec054e6-98e0-4cad-afaf-a5cbaa763405 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:47.529973 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8ec054e6-98e0-4cad-afaf-a5cbaa763405 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.164313 Aug 30 15:02:47.530551 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 930/1862] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:47 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:47.535114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f8fd3693-f035-48b7-bb49-ba023a5aec79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:47.536429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f8fd3693-f035-48b7-bb49-ba023a5aec79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:47.539962 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3a71d2fe-a8cc-4298-a4c6-11d3d95b2cbe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:47.542418 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8fd3693-f035-48b7-bb49-ba023a5aec79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:47.542896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8fd3693-f035-48b7-bb49-ba023a5aec79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:47.543615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8fd3693-f035-48b7-bb49-ba023a5aec79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:47.544036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8fd3693-f035-48b7-bb49-ba023a5aec79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:47.544474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8fd3693-f035-48b7-bb49-ba023a5aec79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:47.544887 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8fd3693-f035-48b7-bb49-ba023a5aec79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:47.548444 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3a71d2fe-a8cc-4298-a4c6-11d3d95b2cbe tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.154475 Aug 30 15:02:47.549015 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 933/1863] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:47 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:47.607131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f8fd3693-f035-48b7-bb49-ba023a5aec79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:47.615784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f8fd3693-f035-48b7-bb49-ba023a5aec79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:47.617258 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f8fd3693-f035-48b7-bb49-ba023a5aec79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:47.618402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f8fd3693-f035-48b7-bb49-ba023a5aec79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086946 Aug 30 15:02:47.618967 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 931/1864] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:47 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:48.552052 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-288150a2-bd6b-4338-b02a-bffc96a2eb25 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:48.552634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-288150a2-bd6b-4338-b02a-bffc96a2eb25 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:48.559226 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-288150a2-bd6b-4338-b02a-bffc96a2eb25 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:48.559716 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-288150a2-bd6b-4338-b02a-bffc96a2eb25 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:48.560146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-288150a2-bd6b-4338-b02a-bffc96a2eb25 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:48.560860 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-288150a2-bd6b-4338-b02a-bffc96a2eb25 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:48.561306 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-288150a2-bd6b-4338-b02a-bffc96a2eb25 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:48.561721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-288150a2-bd6b-4338-b02a-bffc96a2eb25 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:48.569119 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-22747126-e719-474b-a064-a88abb9265a1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:48.569729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-22747126-e719-474b-a064-a88abb9265a1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:48.576412 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22747126-e719-474b-a064-a88abb9265a1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:48.576892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22747126-e719-474b-a064-a88abb9265a1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:48.577321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22747126-e719-474b-a064-a88abb9265a1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:48.578014 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22747126-e719-474b-a064-a88abb9265a1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:48.578464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22747126-e719-474b-a064-a88abb9265a1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:48.578892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22747126-e719-474b-a064-a88abb9265a1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:48.695559 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-288150a2-bd6b-4338-b02a-bffc96a2eb25 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:48.704110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-288150a2-bd6b-4338-b02a-bffc96a2eb25 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.156649 Aug 30 15:02:48.704904 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 934/1865] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:48 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:48.709379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-22747126-e719-474b-a064-a88abb9265a1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:48.712633 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-89a4ed9c-9c68-4d06-b128-887540d348c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:48.713247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-89a4ed9c-9c68-4d06-b128-887540d348c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:48.717591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-22747126-e719-474b-a064-a88abb9265a1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152491 Aug 30 15:02:48.718271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 932/1866] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:48 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:48.719419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89a4ed9c-9c68-4d06-b128-887540d348c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:48.719909 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89a4ed9c-9c68-4d06-b128-887540d348c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:48.720342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89a4ed9c-9c68-4d06-b128-887540d348c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:48.721039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89a4ed9c-9c68-4d06-b128-887540d348c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:48.721493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89a4ed9c-9c68-4d06-b128-887540d348c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:48.721917 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89a4ed9c-9c68-4d06-b128-887540d348c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:48.788836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-89a4ed9c-9c68-4d06-b128-887540d348c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:48.797290 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-89a4ed9c-9c68-4d06-b128-887540d348c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:48.798740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-89a4ed9c-9c68-4d06-b128-887540d348c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:48.799902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-89a4ed9c-9c68-4d06-b128-887540d348c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.094303 Aug 30 15:02:48.800462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 935/1867] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:48 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:49.725310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-541ec762-8f23-43fb-b7a2-447cc2ed710d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:49.725925 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-541ec762-8f23-43fb-b7a2-447cc2ed710d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:49.732308 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-541ec762-8f23-43fb-b7a2-447cc2ed710d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:49.732794 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-541ec762-8f23-43fb-b7a2-447cc2ed710d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:49.733224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-541ec762-8f23-43fb-b7a2-447cc2ed710d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:49.733909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-541ec762-8f23-43fb-b7a2-447cc2ed710d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:49.734356 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-541ec762-8f23-43fb-b7a2-447cc2ed710d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:49.734774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-541ec762-8f23-43fb-b7a2-447cc2ed710d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:49.738141 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-55f78ab4-fd91-4931-b94f-c0a0289ea859 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:49.739616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-55f78ab4-fd91-4931-b94f-c0a0289ea859 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:49.745468 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55f78ab4-fd91-4931-b94f-c0a0289ea859 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:49.745943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55f78ab4-fd91-4931-b94f-c0a0289ea859 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:49.746370 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55f78ab4-fd91-4931-b94f-c0a0289ea859 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:49.747055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55f78ab4-fd91-4931-b94f-c0a0289ea859 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:49.747524 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55f78ab4-fd91-4931-b94f-c0a0289ea859 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:49.747942 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-55f78ab4-fd91-4931-b94f-c0a0289ea859 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:49.870924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-541ec762-8f23-43fb-b7a2-447cc2ed710d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:49.879087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-541ec762-8f23-43fb-b7a2-447cc2ed710d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.157775 Aug 30 15:02:49.880235 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 933/1868] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:49 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:49.883770 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-55f78ab4-fd91-4931-b94f-c0a0289ea859 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:49.884745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-76ca98b5-fff6-4fc3-9f11-7fd4d10bb6c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:49.885352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-76ca98b5-fff6-4fc3-9f11-7fd4d10bb6c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:49.891008 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76ca98b5-fff6-4fc3-9f11-7fd4d10bb6c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:49.891529 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76ca98b5-fff6-4fc3-9f11-7fd4d10bb6c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:49.891966 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76ca98b5-fff6-4fc3-9f11-7fd4d10bb6c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:49.892260 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-55f78ab4-fd91-4931-b94f-c0a0289ea859 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.158258 Aug 30 15:02:49.892659 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76ca98b5-fff6-4fc3-9f11-7fd4d10bb6c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:49.893110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76ca98b5-fff6-4fc3-9f11-7fd4d10bb6c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:49.893532 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76ca98b5-fff6-4fc3-9f11-7fd4d10bb6c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:49.896115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 936/1869] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:49 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:49.954436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-76ca98b5-fff6-4fc3-9f11-7fd4d10bb6c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:49.963297 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-76ca98b5-fff6-4fc3-9f11-7fd4d10bb6c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:49.964752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-76ca98b5-fff6-4fc3-9f11-7fd4d10bb6c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:49.965896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-76ca98b5-fff6-4fc3-9f11-7fd4d10bb6c0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084744 Aug 30 15:02:49.966460 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 934/1870] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:49 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:50.901698 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b50ea40b-62eb-4043-906e-5437f452f280 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:50.902302 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b50ea40b-62eb-4043-906e-5437f452f280 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:50.908890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b50ea40b-62eb-4043-906e-5437f452f280 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:50.909370 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b50ea40b-62eb-4043-906e-5437f452f280 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:50.909802 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b50ea40b-62eb-4043-906e-5437f452f280 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:50.910495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b50ea40b-62eb-4043-906e-5437f452f280 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:50.910951 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b50ea40b-62eb-4043-906e-5437f452f280 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:50.911417 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b50ea40b-62eb-4043-906e-5437f452f280 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:50.913159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0887127b-05e5-49f0-8d14-9a866b30bf6b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:50.913776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0887127b-05e5-49f0-8d14-9a866b30bf6b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:50.919987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0887127b-05e5-49f0-8d14-9a866b30bf6b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:50.920505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0887127b-05e5-49f0-8d14-9a866b30bf6b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:50.920942 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0887127b-05e5-49f0-8d14-9a866b30bf6b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:50.921671 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0887127b-05e5-49f0-8d14-9a866b30bf6b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:50.922123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0887127b-05e5-49f0-8d14-9a866b30bf6b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:50.922552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0887127b-05e5-49f0-8d14-9a866b30bf6b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:51.043449 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b50ea40b-62eb-4043-906e-5437f452f280 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:51.051632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b50ea40b-62eb-4043-906e-5437f452f280 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153659 Aug 30 15:02:51.052080 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 937/1871] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:50 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:51.053045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0887127b-05e5-49f0-8d14-9a866b30bf6b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:51.056737 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0031ae98-bcd5-431f-9b48-b6ae1491a0b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:51.057343 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0031ae98-bcd5-431f-9b48-b6ae1491a0b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:51.061719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0887127b-05e5-49f0-8d14-9a866b30bf6b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152780 Aug 30 15:02:51.062441 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 935/1872] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:50 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:51.062992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0031ae98-bcd5-431f-9b48-b6ae1491a0b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:51.063533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0031ae98-bcd5-431f-9b48-b6ae1491a0b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:51.063967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0031ae98-bcd5-431f-9b48-b6ae1491a0b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:51.064682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0031ae98-bcd5-431f-9b48-b6ae1491a0b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:51.065128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0031ae98-bcd5-431f-9b48-b6ae1491a0b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:51.065547 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0031ae98-bcd5-431f-9b48-b6ae1491a0b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:51.129760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0031ae98-bcd5-431f-9b48-b6ae1491a0b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:51.138155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0031ae98-bcd5-431f-9b48-b6ae1491a0b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:51.139660 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0031ae98-bcd5-431f-9b48-b6ae1491a0b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:51.140791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0031ae98-bcd5-431f-9b48-b6ae1491a0b0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087801 Aug 30 15:02:51.141353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 938/1873] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:51 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:52.073204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5f9b24a5-0442-4eec-9d72-c18dcc7f6ea9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:52.073800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5f9b24a5-0442-4eec-9d72-c18dcc7f6ea9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:52.080348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f9b24a5-0442-4eec-9d72-c18dcc7f6ea9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:52.080825 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f9b24a5-0442-4eec-9d72-c18dcc7f6ea9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:52.081253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f9b24a5-0442-4eec-9d72-c18dcc7f6ea9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:52.081942 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f9b24a5-0442-4eec-9d72-c18dcc7f6ea9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:52.082528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f9b24a5-0442-4eec-9d72-c18dcc7f6ea9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:52.083185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f9b24a5-0442-4eec-9d72-c18dcc7f6ea9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:52.083768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-82becad0-9a10-49bb-8980-46a44f355c40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:52.084877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-82becad0-9a10-49bb-8980-46a44f355c40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:52.091577 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82becad0-9a10-49bb-8980-46a44f355c40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:52.092061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82becad0-9a10-49bb-8980-46a44f355c40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:52.092495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82becad0-9a10-49bb-8980-46a44f355c40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:52.093314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82becad0-9a10-49bb-8980-46a44f355c40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:52.093768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82becad0-9a10-49bb-8980-46a44f355c40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:52.094188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-82becad0-9a10-49bb-8980-46a44f355c40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:52.216279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5f9b24a5-0442-4eec-9d72-c18dcc7f6ea9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:52.224590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-82becad0-9a10-49bb-8980-46a44f355c40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:52.225097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5f9b24a5-0442-4eec-9d72-c18dcc7f6ea9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.155955 Aug 30 15:02:52.225692 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 936/1874] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:52 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:52.230337 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-be30d2b4-9627-4630-91b6-52e8ed218c5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:52.230939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-be30d2b4-9627-4630-91b6-52e8ed218c5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:52.233322 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-82becad0-9a10-49bb-8980-46a44f355c40 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.154110 Aug 30 15:02:52.234141 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 939/1875] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:52 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:52.237043 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be30d2b4-9627-4630-91b6-52e8ed218c5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:52.237526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be30d2b4-9627-4630-91b6-52e8ed218c5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:52.237963 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be30d2b4-9627-4630-91b6-52e8ed218c5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:52.238706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be30d2b4-9627-4630-91b6-52e8ed218c5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:52.239377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be30d2b4-9627-4630-91b6-52e8ed218c5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:52.239812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be30d2b4-9627-4630-91b6-52e8ed218c5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:52.300470 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-be30d2b4-9627-4630-91b6-52e8ed218c5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:52.311908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-be30d2b4-9627-4630-91b6-52e8ed218c5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:52.313585 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-be30d2b4-9627-4630-91b6-52e8ed218c5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:52.315075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-be30d2b4-9627-4630-91b6-52e8ed218c5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088332 Aug 30 15:02:52.315703 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 937/1876] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:52 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:53.246705 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ac43f8df-844d-4267-8312-4b0eba30b58f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:53.247361 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ac43f8df-844d-4267-8312-4b0eba30b58f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:53.249659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=78 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:53.254691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-633c158a-09c9-46a9-a077-a807e9f7b24a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:53.255432 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-633c158a-09c9-46a9-a077-a807e9f7b24a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:53.255734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac43f8df-844d-4267-8312-4b0eba30b58f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:53.256225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac43f8df-844d-4267-8312-4b0eba30b58f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:53.256662 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac43f8df-844d-4267-8312-4b0eba30b58f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:53.257360 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac43f8df-844d-4267-8312-4b0eba30b58f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:53.257747 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=80 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:53.257869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac43f8df-844d-4267-8312-4b0eba30b58f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:53.258221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ac43f8df-844d-4267-8312-4b0eba30b58f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:53.263053 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-633c158a-09c9-46a9-a077-a807e9f7b24a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:53.263574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-633c158a-09c9-46a9-a077-a807e9f7b24a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:53.263993 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-633c158a-09c9-46a9-a077-a807e9f7b24a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:53.264672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-633c158a-09c9-46a9-a077-a807e9f7b24a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:53.265112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-633c158a-09c9-46a9-a077-a807e9f7b24a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:53.265527 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-633c158a-09c9-46a9-a077-a807e9f7b24a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:53.269494 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:53.389230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ac43f8df-844d-4267-8312-4b0eba30b58f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:53.397833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ac43f8df-844d-4267-8312-4b0eba30b58f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.154906 Aug 30 15:02:53.398413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 940/1877] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:53 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:53.399381 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-633c158a-09c9-46a9-a077-a807e9f7b24a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:53.407562 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-633c158a-09c9-46a9-a077-a807e9f7b24a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.157745 Aug 30 15:02:53.408383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 938/1878] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:53 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:53.412067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-906cf84d-3c11-4358-b6a1-4df837430ab4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:53.412675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-906cf84d-3c11-4358-b6a1-4df837430ab4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:53.418556 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-906cf84d-3c11-4358-b6a1-4df837430ab4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:53.419033 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-906cf84d-3c11-4358-b6a1-4df837430ab4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:53.419497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-906cf84d-3c11-4358-b6a1-4df837430ab4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:53.420215 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-906cf84d-3c11-4358-b6a1-4df837430ab4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:53.420663 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-906cf84d-3c11-4358-b6a1-4df837430ab4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:53.421113 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-906cf84d-3c11-4358-b6a1-4df837430ab4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:53.484981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-906cf84d-3c11-4358-b6a1-4df837430ab4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:53.494130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-906cf84d-3c11-4358-b6a1-4df837430ab4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:53.495607 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-906cf84d-3c11-4358-b6a1-4df837430ab4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:53.496744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-906cf84d-3c11-4358-b6a1-4df837430ab4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.097417 Aug 30 15:02:53.497302 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 941/1879] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:53 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:54.418211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c9ac876e-4b1f-4510-a19f-2c0cdb5b82b1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:54.418813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c9ac876e-4b1f-4510-a19f-2c0cdb5b82b1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:54.425222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9ac876e-4b1f-4510-a19f-2c0cdb5b82b1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:54.426343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9ac876e-4b1f-4510-a19f-2c0cdb5b82b1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:54.426774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9ac876e-4b1f-4510-a19f-2c0cdb5b82b1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:54.427480 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9ac876e-4b1f-4510-a19f-2c0cdb5b82b1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:54.427929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9ac876e-4b1f-4510-a19f-2c0cdb5b82b1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:54.428494 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9ac876e-4b1f-4510-a19f-2c0cdb5b82b1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:54.430232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-00a495c2-d193-4e74-8a44-38cd8d414111 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:54.430851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-00a495c2-d193-4e74-8a44-38cd8d414111 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:54.437240 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00a495c2-d193-4e74-8a44-38cd8d414111 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:54.437725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00a495c2-d193-4e74-8a44-38cd8d414111 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:54.438162 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00a495c2-d193-4e74-8a44-38cd8d414111 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:54.438862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00a495c2-d193-4e74-8a44-38cd8d414111 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:54.439379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00a495c2-d193-4e74-8a44-38cd8d414111 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:54.439804 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00a495c2-d193-4e74-8a44-38cd8d414111 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:54.557564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c9ac876e-4b1f-4510-a19f-2c0cdb5b82b1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:54.565617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c9ac876e-4b1f-4510-a19f-2c0cdb5b82b1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151341 Aug 30 15:02:54.566183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 939/1880] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:54 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:54.571413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1e9005fe-61ac-4d39-ba33-4118bcb6c853 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:54.572269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1e9005fe-61ac-4d39-ba33-4118bcb6c853 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:54.573119 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-00a495c2-d193-4e74-8a44-38cd8d414111 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:54.578309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e9005fe-61ac-4d39-ba33-4118bcb6c853 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:54.578783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e9005fe-61ac-4d39-ba33-4118bcb6c853 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:54.579231 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e9005fe-61ac-4d39-ba33-4118bcb6c853 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:54.579909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e9005fe-61ac-4d39-ba33-4118bcb6c853 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:54.580345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e9005fe-61ac-4d39-ba33-4118bcb6c853 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:54.580755 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e9005fe-61ac-4d39-ba33-4118bcb6c853 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:54.581819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-00a495c2-d193-4e74-8a44-38cd8d414111 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156101 Aug 30 15:02:54.582432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 942/1881] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:54 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:54.640483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1e9005fe-61ac-4d39-ba33-4118bcb6c853 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:54.648878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1e9005fe-61ac-4d39-ba33-4118bcb6c853 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:54.650302 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1e9005fe-61ac-4d39-ba33-4118bcb6c853 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:54.651472 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1e9005fe-61ac-4d39-ba33-4118bcb6c853 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.083684 Aug 30 15:02:54.652026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 940/1882] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:54 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:55.588227 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b00ba070-fa41-4592-b6d5-9a785216c32b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:55.588836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b00ba070-fa41-4592-b6d5-9a785216c32b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:55.595117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b00ba070-fa41-4592-b6d5-9a785216c32b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:55.595631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b00ba070-fa41-4592-b6d5-9a785216c32b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:55.596064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b00ba070-fa41-4592-b6d5-9a785216c32b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:55.596747 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b00ba070-fa41-4592-b6d5-9a785216c32b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:55.597192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b00ba070-fa41-4592-b6d5-9a785216c32b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:55.597659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b00ba070-fa41-4592-b6d5-9a785216c32b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:55.602812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-04943ad9-01e9-4119-b1b7-41769a9e9004 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:55.603433 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-04943ad9-01e9-4119-b1b7-41769a9e9004 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:55.609721 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04943ad9-01e9-4119-b1b7-41769a9e9004 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:55.610199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04943ad9-01e9-4119-b1b7-41769a9e9004 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:55.610633 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04943ad9-01e9-4119-b1b7-41769a9e9004 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:55.611349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04943ad9-01e9-4119-b1b7-41769a9e9004 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:55.611792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04943ad9-01e9-4119-b1b7-41769a9e9004 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:55.612204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04943ad9-01e9-4119-b1b7-41769a9e9004 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:55.731945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b00ba070-fa41-4592-b6d5-9a785216c32b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:55.740183 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b00ba070-fa41-4592-b6d5-9a785216c32b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.155826 Aug 30 15:02:55.740757 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 943/1883] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:55 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:55.744713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-04943ad9-01e9-4119-b1b7-41769a9e9004 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:55.745282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-749746a1-8cf5-48bc-85bd-e0857aeb3627 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:55.746010 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-749746a1-8cf5-48bc-85bd-e0857aeb3627 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:55.751711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-749746a1-8cf5-48bc-85bd-e0857aeb3627 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:55.752192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-749746a1-8cf5-48bc-85bd-e0857aeb3627 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:55.752646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-749746a1-8cf5-48bc-85bd-e0857aeb3627 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:55.753044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-04943ad9-01e9-4119-b1b7-41769a9e9004 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153970 Aug 30 15:02:55.753325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-749746a1-8cf5-48bc-85bd-e0857aeb3627 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:55.753637 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 941/1884] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:55 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:55.754364 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-749746a1-8cf5-48bc-85bd-e0857aeb3627 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:55.754794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-749746a1-8cf5-48bc-85bd-e0857aeb3627 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:55.773400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:02:55.821245 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-749746a1-8cf5-48bc-85bd-e0857aeb3627 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:55.829991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-749746a1-8cf5-48bc-85bd-e0857aeb3627 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:55.831424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-749746a1-8cf5-48bc-85bd-e0857aeb3627 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:55.833232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-749746a1-8cf5-48bc-85bd-e0857aeb3627 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091552 Aug 30 15:02:55.833794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 944/1885] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:55 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:56.760986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6966d8b3-01eb-4a63-b9ec-78562b0aadbc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:56.761667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6966d8b3-01eb-4a63-b9ec-78562b0aadbc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:56.768023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6966d8b3-01eb-4a63-b9ec-78562b0aadbc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:56.768506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6966d8b3-01eb-4a63-b9ec-78562b0aadbc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:56.768943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6966d8b3-01eb-4a63-b9ec-78562b0aadbc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:56.770248 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6966d8b3-01eb-4a63-b9ec-78562b0aadbc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:56.770781 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6966d8b3-01eb-4a63-b9ec-78562b0aadbc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:56.771230 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6966d8b3-01eb-4a63-b9ec-78562b0aadbc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:56.775323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-baed10b6-b55c-449d-9194-670f5411c43a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:56.775945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-baed10b6-b55c-449d-9194-670f5411c43a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:56.782256 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baed10b6-b55c-449d-9194-670f5411c43a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:56.782740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baed10b6-b55c-449d-9194-670f5411c43a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:56.783177 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baed10b6-b55c-449d-9194-670f5411c43a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:56.783917 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baed10b6-b55c-449d-9194-670f5411c43a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:56.784367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baed10b6-b55c-449d-9194-670f5411c43a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:56.784790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baed10b6-b55c-449d-9194-670f5411c43a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:56.899985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6966d8b3-01eb-4a63-b9ec-78562b0aadbc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:56.908035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6966d8b3-01eb-4a63-b9ec-78562b0aadbc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151076 Aug 30 15:02:56.908608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 942/1886] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:56 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:56.913860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a9313ffb-1acc-4105-a9bb-45d4f3200c80 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:56.914460 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a9313ffb-1acc-4105-a9bb-45d4f3200c80 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:56.915654 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-baed10b6-b55c-449d-9194-670f5411c43a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:56.920317 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9313ffb-1acc-4105-a9bb-45d4f3200c80 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:56.920796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9313ffb-1acc-4105-a9bb-45d4f3200c80 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:56.921224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9313ffb-1acc-4105-a9bb-45d4f3200c80 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:56.922105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9313ffb-1acc-4105-a9bb-45d4f3200c80 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:56.922732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9313ffb-1acc-4105-a9bb-45d4f3200c80 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:56.923154 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9313ffb-1acc-4105-a9bb-45d4f3200c80 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:56.923914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-baed10b6-b55c-449d-9194-670f5411c43a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152381 Aug 30 15:02:56.924481 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 945/1887] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:56 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:56.983049 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a9313ffb-1acc-4105-a9bb-45d4f3200c80 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:56.991688 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a9313ffb-1acc-4105-a9bb-45d4f3200c80 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:56.993124 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a9313ffb-1acc-4105-a9bb-45d4f3200c80 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:56.994268 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a9313ffb-1acc-4105-a9bb-45d4f3200c80 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084749 Aug 30 15:02:56.994821 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 943/1888] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:56 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:57.929876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-606e3428-6c8a-4004-af8b-8bc204d79fb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:57.930479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-606e3428-6c8a-4004-af8b-8bc204d79fb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:57.937877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-606e3428-6c8a-4004-af8b-8bc204d79fb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:57.938395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-606e3428-6c8a-4004-af8b-8bc204d79fb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:57.938831 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-606e3428-6c8a-4004-af8b-8bc204d79fb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:57.939558 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-606e3428-6c8a-4004-af8b-8bc204d79fb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:57.940013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-606e3428-6c8a-4004-af8b-8bc204d79fb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:57.940437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-606e3428-6c8a-4004-af8b-8bc204d79fb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:57.944430 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f4063331-ed29-45a4-9791-d723bbbaa844 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:57.945081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f4063331-ed29-45a4-9791-d723bbbaa844 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:57.951761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4063331-ed29-45a4-9791-d723bbbaa844 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:57.952243 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4063331-ed29-45a4-9791-d723bbbaa844 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:57.952674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4063331-ed29-45a4-9791-d723bbbaa844 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:57.953368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4063331-ed29-45a4-9791-d723bbbaa844 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:57.953816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4063331-ed29-45a4-9791-d723bbbaa844 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:57.954238 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4063331-ed29-45a4-9791-d723bbbaa844 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:58.069614 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-606e3428-6c8a-4004-af8b-8bc204d79fb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:58.077936 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-606e3428-6c8a-4004-af8b-8bc204d79fb3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152014 Aug 30 15:02:58.078538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 946/1889] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:57 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:58.084948 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a9a9ef8b-6248-4f72-a900-1288b6de4a35 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:58.085673 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f4063331-ed29-45a4-9791-d723bbbaa844 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:58.085821 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a9a9ef8b-6248-4f72-a900-1288b6de4a35 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:58.091837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a9a9ef8b-6248-4f72-a900-1288b6de4a35 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:58.092537 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a9a9ef8b-6248-4f72-a900-1288b6de4a35 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:58.093002 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a9a9ef8b-6248-4f72-a900-1288b6de4a35 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:58.093702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a9a9ef8b-6248-4f72-a900-1288b6de4a35 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:58.093829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f4063331-ed29-45a4-9791-d723bbbaa844 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153085 Aug 30 15:02:58.094155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a9a9ef8b-6248-4f72-a900-1288b6de4a35 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:58.094286 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 944/1890] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:57 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:58.094572 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a9a9ef8b-6248-4f72-a900-1288b6de4a35 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:58.158416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a9a9ef8b-6248-4f72-a900-1288b6de4a35 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:58.167412 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a9a9ef8b-6248-4f72-a900-1288b6de4a35 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:58.168888 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a9a9ef8b-6248-4f72-a900-1288b6de4a35 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:58.170025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a9a9ef8b-6248-4f72-a900-1288b6de4a35 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090574 Aug 30 15:02:58.170589 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 947/1891] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:58 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:02:59.099768 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-14e30847-2d15-45d3-b35c-3f211a0340ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:59.100375 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-14e30847-2d15-45d3-b35c-3f211a0340ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:59.106847 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14e30847-2d15-45d3-b35c-3f211a0340ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:59.107359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14e30847-2d15-45d3-b35c-3f211a0340ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:59.107795 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14e30847-2d15-45d3-b35c-3f211a0340ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:59.108507 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14e30847-2d15-45d3-b35c-3f211a0340ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:59.108957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14e30847-2d15-45d3-b35c-3f211a0340ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:59.109379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14e30847-2d15-45d3-b35c-3f211a0340ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:59.115817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2f9ce2d8-15e4-4b49-b9e4-3eb2c96ee722 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:59.116465 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2f9ce2d8-15e4-4b49-b9e4-3eb2c96ee722 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:59.122843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f9ce2d8-15e4-4b49-b9e4-3eb2c96ee722 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:59.123361 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f9ce2d8-15e4-4b49-b9e4-3eb2c96ee722 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:59.123798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f9ce2d8-15e4-4b49-b9e4-3eb2c96ee722 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:59.124501 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f9ce2d8-15e4-4b49-b9e4-3eb2c96ee722 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:59.124948 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f9ce2d8-15e4-4b49-b9e4-3eb2c96ee722 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:59.125365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f9ce2d8-15e4-4b49-b9e4-3eb2c96ee722 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:59.237519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-14e30847-2d15-45d3-b35c-3f211a0340ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:59.246198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-14e30847-2d15-45d3-b35c-3f211a0340ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150475 Aug 30 15:02:59.246775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 945/1892] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:59 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:02:59.252373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d9972db4-d945-405a-921f-3596cb7d02e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:02:59.252972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d9972db4-d945-405a-921f-3596cb7d02e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:02:59.259530 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9972db4-d945-405a-921f-3596cb7d02e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:59.259686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2f9ce2d8-15e4-4b49-b9e4-3eb2c96ee722 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:59.260005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9972db4-d945-405a-921f-3596cb7d02e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:59.260430 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9972db4-d945-405a-921f-3596cb7d02e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:59.261110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9972db4-d945-405a-921f-3596cb7d02e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:02:59.261546 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9972db4-d945-405a-921f-3596cb7d02e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:02:59.262155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9972db4-d945-405a-921f-3596cb7d02e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:02:59.267773 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2f9ce2d8-15e4-4b49-b9e4-3eb2c96ee722 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156349 Aug 30 15:02:59.268346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 948/1893] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:02:59 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:02:59.324417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d9972db4-d945-405a-921f-3596cb7d02e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:59.332829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d9972db4-d945-405a-921f-3596cb7d02e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:59.334250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d9972db4-d945-405a-921f-3596cb7d02e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:02:59.335426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d9972db4-d945-405a-921f-3596cb7d02e0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087662 Aug 30 15:02:59.335979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 946/1894] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:02:59 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:00.267286 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0682c74d-2c56-48e6-80ae-f202b8fa7d66 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:00.267901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0682c74d-2c56-48e6-80ae-f202b8fa7d66 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:00.274894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0682c74d-2c56-48e6-80ae-f202b8fa7d66 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:00.275432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0682c74d-2c56-48e6-80ae-f202b8fa7d66 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:00.275869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0682c74d-2c56-48e6-80ae-f202b8fa7d66 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:00.276567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0682c74d-2c56-48e6-80ae-f202b8fa7d66 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:00.277013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0682c74d-2c56-48e6-80ae-f202b8fa7d66 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:00.277435 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0682c74d-2c56-48e6-80ae-f202b8fa7d66 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:00.287987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e547c30e-3047-403c-ba61-353cc6988517 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:00.288618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e547c30e-3047-403c-ba61-353cc6988517 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:00.295150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e547c30e-3047-403c-ba61-353cc6988517 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:00.295650 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e547c30e-3047-403c-ba61-353cc6988517 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:00.296075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e547c30e-3047-403c-ba61-353cc6988517 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:00.296755 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e547c30e-3047-403c-ba61-353cc6988517 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:00.297198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e547c30e-3047-403c-ba61-353cc6988517 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:00.297615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e547c30e-3047-403c-ba61-353cc6988517 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:00.415582 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0682c74d-2c56-48e6-80ae-f202b8fa7d66 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:00.424252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0682c74d-2c56-48e6-80ae-f202b8fa7d66 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.160687 Aug 30 15:03:00.425087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 949/1895] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:00 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:00.430284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c57c5636-cdb6-4207-8d43-79256c7b03ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:00.430898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c57c5636-cdb6-4207-8d43-79256c7b03ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:00.437192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c57c5636-cdb6-4207-8d43-79256c7b03ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:00.437679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c57c5636-cdb6-4207-8d43-79256c7b03ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:00.438111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c57c5636-cdb6-4207-8d43-79256c7b03ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:00.438814 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c57c5636-cdb6-4207-8d43-79256c7b03ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:00.439285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c57c5636-cdb6-4207-8d43-79256c7b03ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:00.439707 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c57c5636-cdb6-4207-8d43-79256c7b03ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:00.508496 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c57c5636-cdb6-4207-8d43-79256c7b03ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:00.517195 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c57c5636-cdb6-4207-8d43-79256c7b03ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:00.518632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c57c5636-cdb6-4207-8d43-79256c7b03ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:00.519837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c57c5636-cdb6-4207-8d43-79256c7b03ae tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.094060 Aug 30 15:03:00.520507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 950/1896] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:00 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:00.583900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e547c30e-3047-403c-ba61-353cc6988517 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:00.591946 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e547c30e-3047-403c-ba61-353cc6988517 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.308072 Aug 30 15:03:00.592521 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 947/1897] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:00 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:01.445765 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-78cd0709-d544-4d2b-bce9-24a1787b3baf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:01.446373 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-78cd0709-d544-4d2b-bce9-24a1787b3baf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:01.453052 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-78cd0709-d544-4d2b-bce9-24a1787b3baf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:01.453544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-78cd0709-d544-4d2b-bce9-24a1787b3baf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:01.453956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-78cd0709-d544-4d2b-bce9-24a1787b3baf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:01.454636 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-78cd0709-d544-4d2b-bce9-24a1787b3baf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:01.455079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-78cd0709-d544-4d2b-bce9-24a1787b3baf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:01.455523 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-78cd0709-d544-4d2b-bce9-24a1787b3baf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:01.542310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-11153fdf-d663-499a-a529-7996f78a4efa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:01.542928 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-11153fdf-d663-499a-a529-7996f78a4efa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:01.549297 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11153fdf-d663-499a-a529-7996f78a4efa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:01.549782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11153fdf-d663-499a-a529-7996f78a4efa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:01.550221 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11153fdf-d663-499a-a529-7996f78a4efa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:01.550927 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11153fdf-d663-499a-a529-7996f78a4efa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:01.551411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11153fdf-d663-499a-a529-7996f78a4efa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:01.551836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11153fdf-d663-499a-a529-7996f78a4efa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:01.586488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-78cd0709-d544-4d2b-bce9-24a1787b3baf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:01.594647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-78cd0709-d544-4d2b-bce9-24a1787b3baf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152825 Aug 30 15:03:01.595237 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 951/1898] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:01 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:01.613105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e8a18dda-558b-41e0-9eb2-c8db3426d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:01.613861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e8a18dda-558b-41e0-9eb2-c8db3426d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:01.619694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e8a18dda-558b-41e0-9eb2-c8db3426d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:01.620173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e8a18dda-558b-41e0-9eb2-c8db3426d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:01.620600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e8a18dda-558b-41e0-9eb2-c8db3426d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:01.620792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-11153fdf-d663-499a-a529-7996f78a4efa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:01.621284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e8a18dda-558b-41e0-9eb2-c8db3426d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:01.621728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e8a18dda-558b-41e0-9eb2-c8db3426d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:01.622160 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e8a18dda-558b-41e0-9eb2-c8db3426d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:01.630254 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-11153fdf-d663-499a-a529-7996f78a4efa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:01.631741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-11153fdf-d663-499a-a529-7996f78a4efa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:01.632893 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-11153fdf-d663-499a-a529-7996f78a4efa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.094449 Aug 30 15:03:01.633438 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 948/1899] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:01 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:03:01.749661 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e8a18dda-558b-41e0-9eb2-c8db3426d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:01.758211 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e8a18dda-558b-41e0-9eb2-c8db3426d021 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148990 Aug 30 15:03:01.758780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 952/1900] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:01 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:02.615993 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7db21342-21c6-4e49-b8e5-b1aa3d3c2efd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:02.616587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7db21342-21c6-4e49-b8e5-b1aa3d3c2efd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:02.623027 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7db21342-21c6-4e49-b8e5-b1aa3d3c2efd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:02.623536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7db21342-21c6-4e49-b8e5-b1aa3d3c2efd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:02.623971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7db21342-21c6-4e49-b8e5-b1aa3d3c2efd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:02.624661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7db21342-21c6-4e49-b8e5-b1aa3d3c2efd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:02.625106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7db21342-21c6-4e49-b8e5-b1aa3d3c2efd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:02.625528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7db21342-21c6-4e49-b8e5-b1aa3d3c2efd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:02.655799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bdc2e67e-ba0d-4a5d-a773-da43562963f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:02.656513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bdc2e67e-ba0d-4a5d-a773-da43562963f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:02.663622 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdc2e67e-ba0d-4a5d-a773-da43562963f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:02.664105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdc2e67e-ba0d-4a5d-a773-da43562963f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:02.664541 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdc2e67e-ba0d-4a5d-a773-da43562963f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:02.665243 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdc2e67e-ba0d-4a5d-a773-da43562963f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:02.665695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdc2e67e-ba0d-4a5d-a773-da43562963f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:02.666152 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdc2e67e-ba0d-4a5d-a773-da43562963f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:02.732291 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bdc2e67e-ba0d-4a5d-a773-da43562963f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:02.741668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bdc2e67e-ba0d-4a5d-a773-da43562963f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:02.743470 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bdc2e67e-ba0d-4a5d-a773-da43562963f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:02.744647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bdc2e67e-ba0d-4a5d-a773-da43562963f1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.092692 Aug 30 15:03:02.745209 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 953/1901] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:02 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:03:02.756444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7db21342-21c6-4e49-b8e5-b1aa3d3c2efd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:02.764521 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7db21342-21c6-4e49-b8e5-b1aa3d3c2efd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153127 Aug 30 15:03:02.765072 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 949/1902] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:02 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:02.779223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9187cae1-88d6-4cc1-97e8-17c848203960 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:02.779834 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9187cae1-88d6-4cc1-97e8-17c848203960 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:02.786259 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9187cae1-88d6-4cc1-97e8-17c848203960 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:02.786735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9187cae1-88d6-4cc1-97e8-17c848203960 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:02.787167 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9187cae1-88d6-4cc1-97e8-17c848203960 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:02.787883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9187cae1-88d6-4cc1-97e8-17c848203960 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:02.788346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9187cae1-88d6-4cc1-97e8-17c848203960 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:02.788765 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9187cae1-88d6-4cc1-97e8-17c848203960 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:02.914919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9187cae1-88d6-4cc1-97e8-17c848203960 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:02.922977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9187cae1-88d6-4cc1-97e8-17c848203960 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147500 Aug 30 15:03:02.923572 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 954/1903] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:02 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:03.767903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-097f8c4f-1316-495a-8cfb-eb54847a1a11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:03.768920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-097f8c4f-1316-495a-8cfb-eb54847a1a11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:03.776235 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-097f8c4f-1316-495a-8cfb-eb54847a1a11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:03.776719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-097f8c4f-1316-495a-8cfb-eb54847a1a11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:03.777155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-097f8c4f-1316-495a-8cfb-eb54847a1a11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:03.777858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-097f8c4f-1316-495a-8cfb-eb54847a1a11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:03.778329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-097f8c4f-1316-495a-8cfb-eb54847a1a11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:03.778734 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-097f8c4f-1316-495a-8cfb-eb54847a1a11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:03.785737 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-232ccd29-76f0-43d9-9b17-9c836f06912d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:03.786443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-232ccd29-76f0-43d9-9b17-9c836f06912d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:03.792990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-232ccd29-76f0-43d9-9b17-9c836f06912d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:03.793487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-232ccd29-76f0-43d9-9b17-9c836f06912d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:03.793921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-232ccd29-76f0-43d9-9b17-9c836f06912d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:03.794629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-232ccd29-76f0-43d9-9b17-9c836f06912d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:03.795085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-232ccd29-76f0-43d9-9b17-9c836f06912d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:03.795535 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-232ccd29-76f0-43d9-9b17-9c836f06912d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:03.849926 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-097f8c4f-1316-495a-8cfb-eb54847a1a11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:03.859139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-097f8c4f-1316-495a-8cfb-eb54847a1a11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:03.860622 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-097f8c4f-1316-495a-8cfb-eb54847a1a11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:03.861822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-097f8c4f-1316-495a-8cfb-eb54847a1a11 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.097847 Aug 30 15:03:03.862379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 950/1904] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:03 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:03.929138 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-232ccd29-76f0-43d9-9b17-9c836f06912d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:03.941728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-232ccd29-76f0-43d9-9b17-9c836f06912d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.159602 Aug 30 15:03:03.942270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 955/1905] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:03 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:03.945401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-aadf418e-f5ba-47ae-a1d0-ecec7b15c965 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:03.946045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-aadf418e-f5ba-47ae-a1d0-ecec7b15c965 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:03.952735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aadf418e-f5ba-47ae-a1d0-ecec7b15c965 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:03.952898 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aadf418e-f5ba-47ae-a1d0-ecec7b15c965 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:03.953202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aadf418e-f5ba-47ae-a1d0-ecec7b15c965 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:03.953884 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aadf418e-f5ba-47ae-a1d0-ecec7b15c965 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:03.954331 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aadf418e-f5ba-47ae-a1d0-ecec7b15c965 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:03.954757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aadf418e-f5ba-47ae-a1d0-ecec7b15c965 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:04.087806 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-aadf418e-f5ba-47ae-a1d0-ecec7b15c965 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:04.095814 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-aadf418e-f5ba-47ae-a1d0-ecec7b15c965 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.154800 Aug 30 15:03:04.096373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 951/1906] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:03 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:04.885341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c8f082c5-43ea-446b-839f-002f6abd6afd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:04.885948 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c8f082c5-43ea-446b-839f-002f6abd6afd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:04.892277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8f082c5-43ea-446b-839f-002f6abd6afd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:04.892751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8f082c5-43ea-446b-839f-002f6abd6afd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:04.893178 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8f082c5-43ea-446b-839f-002f6abd6afd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:04.893857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8f082c5-43ea-446b-839f-002f6abd6afd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:04.894954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8f082c5-43ea-446b-839f-002f6abd6afd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:04.895699 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8f082c5-43ea-446b-839f-002f6abd6afd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:04.959992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c8f082c5-43ea-446b-839f-002f6abd6afd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:04.963121 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fddb1fff-55d6-48ef-85a5-47ee1402aebb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:04.963744 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fddb1fff-55d6-48ef-85a5-47ee1402aebb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:04.968753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c8f082c5-43ea-446b-839f-002f6abd6afd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:04.970024 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fddb1fff-55d6-48ef-85a5-47ee1402aebb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:04.970331 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c8f082c5-43ea-446b-839f-002f6abd6afd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:04.970656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fddb1fff-55d6-48ef-85a5-47ee1402aebb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:04.971153 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fddb1fff-55d6-48ef-85a5-47ee1402aebb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:04.971532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c8f082c5-43ea-446b-839f-002f6abd6afd tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090131 Aug 30 15:03:04.971986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fddb1fff-55d6-48ef-85a5-47ee1402aebb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:04.972094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 956/1907] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:04 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:04.973070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fddb1fff-55d6-48ef-85a5-47ee1402aebb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:04.973496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fddb1fff-55d6-48ef-85a5-47ee1402aebb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:05.103105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fddb1fff-55d6-48ef-85a5-47ee1402aebb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:05.111083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fddb1fff-55d6-48ef-85a5-47ee1402aebb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152253 Aug 30 15:03:05.111670 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 952/1908] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:04 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:05.117310 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0956d1ef-b68a-4ec2-9a36-3a21611ec24d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:05.117927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0956d1ef-b68a-4ec2-9a36-3a21611ec24d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:05.123964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0956d1ef-b68a-4ec2-9a36-3a21611ec24d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:05.124541 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0956d1ef-b68a-4ec2-9a36-3a21611ec24d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:05.125039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0956d1ef-b68a-4ec2-9a36-3a21611ec24d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:05.125792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0956d1ef-b68a-4ec2-9a36-3a21611ec24d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:05.126245 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0956d1ef-b68a-4ec2-9a36-3a21611ec24d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:05.126661 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0956d1ef-b68a-4ec2-9a36-3a21611ec24d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:05.251953 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0956d1ef-b68a-4ec2-9a36-3a21611ec24d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:05.260061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0956d1ef-b68a-4ec2-9a36-3a21611ec24d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.146652 Aug 30 15:03:05.260633 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 957/1909] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:05 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:05.998781 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-eaa3b36b-569e-4177-bdd1-ebbe03a6bef6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:05.999439 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-eaa3b36b-569e-4177-bdd1-ebbe03a6bef6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:06.006418 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eaa3b36b-569e-4177-bdd1-ebbe03a6bef6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:06.006890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eaa3b36b-569e-4177-bdd1-ebbe03a6bef6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:06.007343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eaa3b36b-569e-4177-bdd1-ebbe03a6bef6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:06.008026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eaa3b36b-569e-4177-bdd1-ebbe03a6bef6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:06.008467 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eaa3b36b-569e-4177-bdd1-ebbe03a6bef6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:06.008883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eaa3b36b-569e-4177-bdd1-ebbe03a6bef6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:06.076415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-eaa3b36b-569e-4177-bdd1-ebbe03a6bef6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:06.084856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-eaa3b36b-569e-4177-bdd1-ebbe03a6bef6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:06.086282 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-eaa3b36b-569e-4177-bdd1-ebbe03a6bef6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:06.087449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-eaa3b36b-569e-4177-bdd1-ebbe03a6bef6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.092597 Aug 30 15:03:06.087990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 953/1910] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:05 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:06.131649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e9076262-a49a-4310-954a-2efa3149ae3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:06.132282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e9076262-a49a-4310-954a-2efa3149ae3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:06.138614 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e9076262-a49a-4310-954a-2efa3149ae3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:06.139091 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e9076262-a49a-4310-954a-2efa3149ae3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:06.139547 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e9076262-a49a-4310-954a-2efa3149ae3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:06.140228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e9076262-a49a-4310-954a-2efa3149ae3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:06.140671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e9076262-a49a-4310-954a-2efa3149ae3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:06.141085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e9076262-a49a-4310-954a-2efa3149ae3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:06.269628 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e9076262-a49a-4310-954a-2efa3149ae3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:06.277727 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e9076262-a49a-4310-954a-2efa3149ae3a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149904 Aug 30 15:03:06.278291 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 958/1911] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:06 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:06.280371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-116a620f-b556-4acc-96d8-95774ac7c00b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:06.280983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-116a620f-b556-4acc-96d8-95774ac7c00b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:06.287413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-116a620f-b556-4acc-96d8-95774ac7c00b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:06.287897 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-116a620f-b556-4acc-96d8-95774ac7c00b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:06.288385 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-116a620f-b556-4acc-96d8-95774ac7c00b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:06.289078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-116a620f-b556-4acc-96d8-95774ac7c00b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:06.289526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-116a620f-b556-4acc-96d8-95774ac7c00b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:06.289944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-116a620f-b556-4acc-96d8-95774ac7c00b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:06.415077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-116a620f-b556-4acc-96d8-95774ac7c00b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:06.418433 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:06.424019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-116a620f-b556-4acc-96d8-95774ac7c00b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147420 Aug 30 15:03:06.424582 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 954/1912] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:06 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:07.112266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4b4f5714-a692-47ed-938a-27c5a42cebfa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:07.112986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4b4f5714-a692-47ed-938a-27c5a42cebfa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:07.118963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b4f5714-a692-47ed-938a-27c5a42cebfa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:07.119467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b4f5714-a692-47ed-938a-27c5a42cebfa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:07.119902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b4f5714-a692-47ed-938a-27c5a42cebfa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:07.120583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b4f5714-a692-47ed-938a-27c5a42cebfa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:07.121029 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b4f5714-a692-47ed-938a-27c5a42cebfa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:07.121446 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4b4f5714-a692-47ed-938a-27c5a42cebfa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:07.185807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4b4f5714-a692-47ed-938a-27c5a42cebfa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:07.195049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4b4f5714-a692-47ed-938a-27c5a42cebfa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:07.196519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4b4f5714-a692-47ed-938a-27c5a42cebfa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:07.197916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4b4f5714-a692-47ed-938a-27c5a42cebfa tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089630 Aug 30 15:03:07.198480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 959/1913] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:07 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:07.298715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1d9c5258-93d0-4cf6-ad66-e0f4defdde1b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:07.299363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1d9c5258-93d0-4cf6-ad66-e0f4defdde1b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:07.306475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d9c5258-93d0-4cf6-ad66-e0f4defdde1b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:07.306958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d9c5258-93d0-4cf6-ad66-e0f4defdde1b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:07.307510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d9c5258-93d0-4cf6-ad66-e0f4defdde1b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:07.308218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d9c5258-93d0-4cf6-ad66-e0f4defdde1b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:07.308678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d9c5258-93d0-4cf6-ad66-e0f4defdde1b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:07.309098 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d9c5258-93d0-4cf6-ad66-e0f4defdde1b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:07.439026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1d9c5258-93d0-4cf6-ad66-e0f4defdde1b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:07.445541 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-347e9c17-9589-4826-9c70-4e35f06ce0b3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:07.446061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-347e9c17-9589-4826-9c70-4e35f06ce0b3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:07.448426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1d9c5258-93d0-4cf6-ad66-e0f4defdde1b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153839 Aug 30 15:03:07.448998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 955/1914] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:07 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:07.452283 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-347e9c17-9589-4826-9c70-4e35f06ce0b3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:07.452767 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-347e9c17-9589-4826-9c70-4e35f06ce0b3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:07.453200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-347e9c17-9589-4826-9c70-4e35f06ce0b3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:07.453895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-347e9c17-9589-4826-9c70-4e35f06ce0b3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:07.454345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-347e9c17-9589-4826-9c70-4e35f06ce0b3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:07.454771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-347e9c17-9589-4826-9c70-4e35f06ce0b3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:07.585083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-347e9c17-9589-4826-9c70-4e35f06ce0b3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:07.593288 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-347e9c17-9589-4826-9c70-4e35f06ce0b3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152323 Aug 30 15:03:07.593853 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 960/1915] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:07 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:08.220320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6ca8b46b-79fb-4265-82c5-6ba83a2eadd4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:08.220927 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6ca8b46b-79fb-4265-82c5-6ba83a2eadd4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:08.227598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ca8b46b-79fb-4265-82c5-6ba83a2eadd4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:08.228070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ca8b46b-79fb-4265-82c5-6ba83a2eadd4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:08.228499 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ca8b46b-79fb-4265-82c5-6ba83a2eadd4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:08.229177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ca8b46b-79fb-4265-82c5-6ba83a2eadd4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:08.229621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ca8b46b-79fb-4265-82c5-6ba83a2eadd4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:08.230037 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ca8b46b-79fb-4265-82c5-6ba83a2eadd4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:08.290072 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6ca8b46b-79fb-4265-82c5-6ba83a2eadd4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:08.298569 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6ca8b46b-79fb-4265-82c5-6ba83a2eadd4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:08.300019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6ca8b46b-79fb-4265-82c5-6ba83a2eadd4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:08.301203 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6ca8b46b-79fb-4265-82c5-6ba83a2eadd4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084783 Aug 30 15:03:08.301801 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 956/1916] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:08 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:03:08.469700 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-dda91d43-08ff-45fa-a7e3-276a105609f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:08.470249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-dda91d43-08ff-45fa-a7e3-276a105609f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:08.477072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dda91d43-08ff-45fa-a7e3-276a105609f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:08.477546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dda91d43-08ff-45fa-a7e3-276a105609f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:08.477969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dda91d43-08ff-45fa-a7e3-276a105609f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:08.478647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dda91d43-08ff-45fa-a7e3-276a105609f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:08.479090 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dda91d43-08ff-45fa-a7e3-276a105609f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:08.479531 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dda91d43-08ff-45fa-a7e3-276a105609f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:08.483443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:08.606079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-dda91d43-08ff-45fa-a7e3-276a105609f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:08.614270 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f9e9451a-168d-4b94-a3a5-20da134560da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:08.614911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f9e9451a-168d-4b94-a3a5-20da134560da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:08.615492 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-dda91d43-08ff-45fa-a7e3-276a105609f8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150123 Aug 30 15:03:08.616073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 961/1917] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:08 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:08.621280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9e9451a-168d-4b94-a3a5-20da134560da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:08.621760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9e9451a-168d-4b94-a3a5-20da134560da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:08.622185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9e9451a-168d-4b94-a3a5-20da134560da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:08.622870 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9e9451a-168d-4b94-a3a5-20da134560da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:08.623353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9e9451a-168d-4b94-a3a5-20da134560da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:08.623774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9e9451a-168d-4b94-a3a5-20da134560da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:08.748784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f9e9451a-168d-4b94-a3a5-20da134560da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:08.757657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f9e9451a-168d-4b94-a3a5-20da134560da tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147726 Aug 30 15:03:08.758214 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 957/1918] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:08 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:09.324089 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-992fefdc-11ff-4b56-a40a-486239c6d59a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:09.324695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-992fefdc-11ff-4b56-a40a-486239c6d59a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:09.330919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-992fefdc-11ff-4b56-a40a-486239c6d59a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:09.331435 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-992fefdc-11ff-4b56-a40a-486239c6d59a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:09.331865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-992fefdc-11ff-4b56-a40a-486239c6d59a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:09.333261 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-992fefdc-11ff-4b56-a40a-486239c6d59a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:09.333985 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-992fefdc-11ff-4b56-a40a-486239c6d59a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:09.334409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-992fefdc-11ff-4b56-a40a-486239c6d59a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:09.398992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-992fefdc-11ff-4b56-a40a-486239c6d59a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:09.408009 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-992fefdc-11ff-4b56-a40a-486239c6d59a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:09.409437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-992fefdc-11ff-4b56-a40a-486239c6d59a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:09.411141 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-992fefdc-11ff-4b56-a40a-486239c6d59a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090778 Aug 30 15:03:09.412316 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 962/1919] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:09 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:09.636004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cb69f4c8-5ade-41f7-a158-437580a0a4a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:09.636615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cb69f4c8-5ade-41f7-a158-437580a0a4a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:09.643059 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb69f4c8-5ade-41f7-a158-437580a0a4a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:09.643590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb69f4c8-5ade-41f7-a158-437580a0a4a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:09.644001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb69f4c8-5ade-41f7-a158-437580a0a4a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:09.644684 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb69f4c8-5ade-41f7-a158-437580a0a4a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:09.645664 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb69f4c8-5ade-41f7-a158-437580a0a4a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:09.646089 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb69f4c8-5ade-41f7-a158-437580a0a4a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:09.778197 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9848a002-e178-4af1-aa7b-fa6a3faf59b9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:09.778801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9848a002-e178-4af1-aa7b-fa6a3faf59b9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:09.785838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9848a002-e178-4af1-aa7b-fa6a3faf59b9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:09.786390 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9848a002-e178-4af1-aa7b-fa6a3faf59b9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:09.786866 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9848a002-e178-4af1-aa7b-fa6a3faf59b9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:09.787627 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9848a002-e178-4af1-aa7b-fa6a3faf59b9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:09.788082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9848a002-e178-4af1-aa7b-fa6a3faf59b9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:09.788507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9848a002-e178-4af1-aa7b-fa6a3faf59b9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:09.928270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9848a002-e178-4af1-aa7b-fa6a3faf59b9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:09.936679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9848a002-e178-4af1-aa7b-fa6a3faf59b9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.162426 Aug 30 15:03:09.937260 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 963/1920] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:09 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:10.017264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cb69f4c8-5ade-41f7-a158-437580a0a4a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:10.025860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cb69f4c8-5ade-41f7-a158-437580a0a4a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.393722 Aug 30 15:03:10.026421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 958/1921] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:09 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:10.434592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3c9ddb41-7504-44d1-a3ed-d39865232c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:10.435198 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3c9ddb41-7504-44d1-a3ed-d39865232c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:10.441042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c9ddb41-7504-44d1-a3ed-d39865232c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:10.441516 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c9ddb41-7504-44d1-a3ed-d39865232c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:10.443071 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c9ddb41-7504-44d1-a3ed-d39865232c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:10.443778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c9ddb41-7504-44d1-a3ed-d39865232c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:10.444227 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c9ddb41-7504-44d1-a3ed-d39865232c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:10.444921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3c9ddb41-7504-44d1-a3ed-d39865232c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:10.505880 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3c9ddb41-7504-44d1-a3ed-d39865232c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:10.515046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3c9ddb41-7504-44d1-a3ed-d39865232c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:10.516504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3c9ddb41-7504-44d1-a3ed-d39865232c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:10.517630 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3c9ddb41-7504-44d1-a3ed-d39865232c97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087039 Aug 30 15:03:10.518179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 964/1922] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:10 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:10.959539 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-17002eb5-bc57-4004-b915-64229fd7502d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:10.960138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-17002eb5-bc57-4004-b915-64229fd7502d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:10.966720 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17002eb5-bc57-4004-b915-64229fd7502d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:10.967218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17002eb5-bc57-4004-b915-64229fd7502d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:10.967674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17002eb5-bc57-4004-b915-64229fd7502d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:10.968370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17002eb5-bc57-4004-b915-64229fd7502d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:10.968822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17002eb5-bc57-4004-b915-64229fd7502d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:10.969242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17002eb5-bc57-4004-b915-64229fd7502d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:11.046045 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c3cf4dfa-c4c5-4650-9e68-2bcb0884641b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:11.046792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c3cf4dfa-c4c5-4650-9e68-2bcb0884641b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:11.053129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3cf4dfa-c4c5-4650-9e68-2bcb0884641b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:11.053617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3cf4dfa-c4c5-4650-9e68-2bcb0884641b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:11.054052 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3cf4dfa-c4c5-4650-9e68-2bcb0884641b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:11.054749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3cf4dfa-c4c5-4650-9e68-2bcb0884641b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:11.055201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3cf4dfa-c4c5-4650-9e68-2bcb0884641b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:11.055649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3cf4dfa-c4c5-4650-9e68-2bcb0884641b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:11.098729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-17002eb5-bc57-4004-b915-64229fd7502d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:11.107052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-17002eb5-bc57-4004-b915-64229fd7502d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152171 Aug 30 15:03:11.107666 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 959/1923] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:10 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:11.186954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c3cf4dfa-c4c5-4650-9e68-2bcb0884641b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:11.195279 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c3cf4dfa-c4c5-4650-9e68-2bcb0884641b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153011 Aug 30 15:03:11.195844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 965/1924] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:11 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:11.540124 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a1e4b8fe-efac-4186-b70a-954383c510d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:11.540642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a1e4b8fe-efac-4186-b70a-954383c510d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:11.546436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1e4b8fe-efac-4186-b70a-954383c510d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:11.546908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1e4b8fe-efac-4186-b70a-954383c510d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:11.547377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1e4b8fe-efac-4186-b70a-954383c510d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:11.548056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1e4b8fe-efac-4186-b70a-954383c510d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:11.548499 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1e4b8fe-efac-4186-b70a-954383c510d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:11.548912 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1e4b8fe-efac-4186-b70a-954383c510d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:11.609961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a1e4b8fe-efac-4186-b70a-954383c510d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:11.619304 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a1e4b8fe-efac-4186-b70a-954383c510d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:11.620753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a1e4b8fe-efac-4186-b70a-954383c510d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:11.621903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a1e4b8fe-efac-4186-b70a-954383c510d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085912 Aug 30 15:03:11.622576 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 960/1925] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:11 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:12.128097 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b006a699-7c31-45ab-881d-f9b50fc7e320 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:12.128701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b006a699-7c31-45ab-881d-f9b50fc7e320 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:12.135386 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b006a699-7c31-45ab-881d-f9b50fc7e320 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:12.135858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b006a699-7c31-45ab-881d-f9b50fc7e320 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:12.136285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b006a699-7c31-45ab-881d-f9b50fc7e320 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:12.136961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b006a699-7c31-45ab-881d-f9b50fc7e320 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:12.137424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b006a699-7c31-45ab-881d-f9b50fc7e320 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:12.137820 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b006a699-7c31-45ab-881d-f9b50fc7e320 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:12.216564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-74ffdd04-7dcd-4d00-b18b-6e6eaab9c1ff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:12.217223 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-74ffdd04-7dcd-4d00-b18b-6e6eaab9c1ff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:12.224387 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-74ffdd04-7dcd-4d00-b18b-6e6eaab9c1ff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:12.224872 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-74ffdd04-7dcd-4d00-b18b-6e6eaab9c1ff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:12.225303 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-74ffdd04-7dcd-4d00-b18b-6e6eaab9c1ff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:12.225994 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-74ffdd04-7dcd-4d00-b18b-6e6eaab9c1ff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:12.226437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-74ffdd04-7dcd-4d00-b18b-6e6eaab9c1ff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:12.226876 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-74ffdd04-7dcd-4d00-b18b-6e6eaab9c1ff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:12.267010 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b006a699-7c31-45ab-881d-f9b50fc7e320 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:12.275824 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b006a699-7c31-45ab-881d-f9b50fc7e320 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151530 Aug 30 15:03:12.276398 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 966/1926] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:12 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:12.359443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-74ffdd04-7dcd-4d00-b18b-6e6eaab9c1ff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:12.368382 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-74ffdd04-7dcd-4d00-b18b-6e6eaab9c1ff tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.155693 Aug 30 15:03:12.368935 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 961/1927] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:12 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:12.645651 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1f1eec16-0d93-4aac-96be-a29361aaf95b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:12.646251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1f1eec16-0d93-4aac-96be-a29361aaf95b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:12.652094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f1eec16-0d93-4aac-96be-a29361aaf95b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:12.652566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f1eec16-0d93-4aac-96be-a29361aaf95b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:12.652998 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f1eec16-0d93-4aac-96be-a29361aaf95b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:12.653677 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f1eec16-0d93-4aac-96be-a29361aaf95b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:12.654122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f1eec16-0d93-4aac-96be-a29361aaf95b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:12.654545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f1eec16-0d93-4aac-96be-a29361aaf95b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:12.715188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1f1eec16-0d93-4aac-96be-a29361aaf95b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:12.724410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1f1eec16-0d93-4aac-96be-a29361aaf95b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:12.725867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1f1eec16-0d93-4aac-96be-a29361aaf95b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:12.727012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1f1eec16-0d93-4aac-96be-a29361aaf95b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085860 Aug 30 15:03:12.727611 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 967/1928] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:12 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:13.297720 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-51ecc2d3-5c27-433a-a93a-2a57850853b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:13.298323 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-51ecc2d3-5c27-433a-a93a-2a57850853b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:13.305311 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-51ecc2d3-5c27-433a-a93a-2a57850853b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:13.305787 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-51ecc2d3-5c27-433a-a93a-2a57850853b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:13.306218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-51ecc2d3-5c27-433a-a93a-2a57850853b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:13.306921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-51ecc2d3-5c27-433a-a93a-2a57850853b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:13.307510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-51ecc2d3-5c27-433a-a93a-2a57850853b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:13.307937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-51ecc2d3-5c27-433a-a93a-2a57850853b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:13.395461 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c50f9eda-3d80-4bbf-9020-fc66996d6dd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:13.396102 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c50f9eda-3d80-4bbf-9020-fc66996d6dd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:13.402569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c50f9eda-3d80-4bbf-9020-fc66996d6dd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:13.403054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c50f9eda-3d80-4bbf-9020-fc66996d6dd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:13.403526 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c50f9eda-3d80-4bbf-9020-fc66996d6dd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:13.404232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c50f9eda-3d80-4bbf-9020-fc66996d6dd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:13.404686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c50f9eda-3d80-4bbf-9020-fc66996d6dd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:13.405114 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c50f9eda-3d80-4bbf-9020-fc66996d6dd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:13.434228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-51ecc2d3-5c27-433a-a93a-2a57850853b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:13.443407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-51ecc2d3-5c27-433a-a93a-2a57850853b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149551 Aug 30 15:03:13.443980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 962/1929] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:13 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:13.534777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c50f9eda-3d80-4bbf-9020-fc66996d6dd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:13.543535 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c50f9eda-3d80-4bbf-9020-fc66996d6dd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.157994 Aug 30 15:03:13.544109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 968/1930] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:13 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:13.749788 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-466285f8-d053-4eba-a03f-efbb49828c3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:13.750313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-466285f8-d053-4eba-a03f-efbb49828c3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:13.756290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-466285f8-d053-4eba-a03f-efbb49828c3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:13.756759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-466285f8-d053-4eba-a03f-efbb49828c3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:13.757183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-466285f8-d053-4eba-a03f-efbb49828c3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:13.757859 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-466285f8-d053-4eba-a03f-efbb49828c3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:13.758298 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-466285f8-d053-4eba-a03f-efbb49828c3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:13.758712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-466285f8-d053-4eba-a03f-efbb49828c3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:13.821360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-466285f8-d053-4eba-a03f-efbb49828c3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:13.830054 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-466285f8-d053-4eba-a03f-efbb49828c3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:13.831529 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-466285f8-d053-4eba-a03f-efbb49828c3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:13.832671 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-466285f8-d053-4eba-a03f-efbb49828c3d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086932 Aug 30 15:03:13.833218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 963/1931] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:13 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:14.464968 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-806b00f3-e5e3-45e3-9942-3db4a7c0b74d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:14.465496 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-806b00f3-e5e3-45e3-9942-3db4a7c0b74d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:14.471854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-806b00f3-e5e3-45e3-9942-3db4a7c0b74d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:14.472331 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-806b00f3-e5e3-45e3-9942-3db4a7c0b74d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:14.472761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-806b00f3-e5e3-45e3-9942-3db4a7c0b74d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:14.473525 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-806b00f3-e5e3-45e3-9942-3db4a7c0b74d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:14.473971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-806b00f3-e5e3-45e3-9942-3db4a7c0b74d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:14.474389 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-806b00f3-e5e3-45e3-9942-3db4a7c0b74d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:14.564864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-43fc529b-5790-47f1-823e-5ebf3e8ad4d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:14.565476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-43fc529b-5790-47f1-823e-5ebf3e8ad4d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:14.573070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43fc529b-5790-47f1-823e-5ebf3e8ad4d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:14.573554 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43fc529b-5790-47f1-823e-5ebf3e8ad4d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:14.573988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43fc529b-5790-47f1-823e-5ebf3e8ad4d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:14.574678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43fc529b-5790-47f1-823e-5ebf3e8ad4d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:14.575128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43fc529b-5790-47f1-823e-5ebf3e8ad4d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:14.575580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43fc529b-5790-47f1-823e-5ebf3e8ad4d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:14.602310 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-806b00f3-e5e3-45e3-9942-3db4a7c0b74d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:14.610484 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-806b00f3-e5e3-45e3-9942-3db4a7c0b74d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149469 Aug 30 15:03:14.611054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 969/1932] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:14 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:14.702295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-43fc529b-5790-47f1-823e-5ebf3e8ad4d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:14.710675 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-43fc529b-5790-47f1-823e-5ebf3e8ad4d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149570 Aug 30 15:03:14.711255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 964/1933] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:14 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:14.854829 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-822b653d-0ebb-4bbe-98a9-177f2ce4aa26 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:14.855474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-822b653d-0ebb-4bbe-98a9-177f2ce4aa26 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:14.861303 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-822b653d-0ebb-4bbe-98a9-177f2ce4aa26 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:14.861782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-822b653d-0ebb-4bbe-98a9-177f2ce4aa26 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:14.862222 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-822b653d-0ebb-4bbe-98a9-177f2ce4aa26 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:14.862911 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-822b653d-0ebb-4bbe-98a9-177f2ce4aa26 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:14.863904 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-822b653d-0ebb-4bbe-98a9-177f2ce4aa26 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:14.864336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-822b653d-0ebb-4bbe-98a9-177f2ce4aa26 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:14.923728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-822b653d-0ebb-4bbe-98a9-177f2ce4aa26 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:14.932687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-822b653d-0ebb-4bbe-98a9-177f2ce4aa26 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:14.934146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-822b653d-0ebb-4bbe-98a9-177f2ce4aa26 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:14.935319 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-822b653d-0ebb-4bbe-98a9-177f2ce4aa26 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084366 Aug 30 15:03:14.935882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 970/1934] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:14 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:15.632512 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2fdb49aa-1ccb-49eb-aab1-d37f0283a49e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:15.633109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2fdb49aa-1ccb-49eb-aab1-d37f0283a49e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:15.639457 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fdb49aa-1ccb-49eb-aab1-d37f0283a49e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:15.639931 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fdb49aa-1ccb-49eb-aab1-d37f0283a49e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:15.640358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fdb49aa-1ccb-49eb-aab1-d37f0283a49e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:15.641032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fdb49aa-1ccb-49eb-aab1-d37f0283a49e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:15.641477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fdb49aa-1ccb-49eb-aab1-d37f0283a49e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:15.641892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fdb49aa-1ccb-49eb-aab1-d37f0283a49e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:15.731408 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c6c6ee94-4079-4870-92eb-32d8004ec472 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:15.732106 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c6c6ee94-4079-4870-92eb-32d8004ec472 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:15.738723 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6c6ee94-4079-4870-92eb-32d8004ec472 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:15.740598 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6c6ee94-4079-4870-92eb-32d8004ec472 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:15.740598 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6c6ee94-4079-4870-92eb-32d8004ec472 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:15.741044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6c6ee94-4079-4870-92eb-32d8004ec472 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:15.741490 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6c6ee94-4079-4870-92eb-32d8004ec472 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:15.741913 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c6c6ee94-4079-4870-92eb-32d8004ec472 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:15.770548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2fdb49aa-1ccb-49eb-aab1-d37f0283a49e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:15.778899 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2fdb49aa-1ccb-49eb-aab1-d37f0283a49e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150323 Aug 30 15:03:15.779506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 965/1935] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:15 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:15.871773 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c6c6ee94-4079-4870-92eb-32d8004ec472 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:15.880437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c6c6ee94-4079-4870-92eb-32d8004ec472 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152937 Aug 30 15:03:15.881006 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 971/1936] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:15 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:15.958509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1bc8fd10-465c-4a48-acf6-5e4668b3a1e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:15.959047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1bc8fd10-465c-4a48-acf6-5e4668b3a1e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:15.964899 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bc8fd10-465c-4a48-acf6-5e4668b3a1e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:15.965376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bc8fd10-465c-4a48-acf6-5e4668b3a1e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:15.965810 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bc8fd10-465c-4a48-acf6-5e4668b3a1e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:15.966496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bc8fd10-465c-4a48-acf6-5e4668b3a1e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:15.966946 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bc8fd10-465c-4a48-acf6-5e4668b3a1e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:15.967401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1bc8fd10-465c-4a48-acf6-5e4668b3a1e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:16.031907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1bc8fd10-465c-4a48-acf6-5e4668b3a1e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:16.040377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1bc8fd10-465c-4a48-acf6-5e4668b3a1e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:16.041820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1bc8fd10-465c-4a48-acf6-5e4668b3a1e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:16.042966 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1bc8fd10-465c-4a48-acf6-5e4668b3a1e3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089077 Aug 30 15:03:16.043558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 966/1937] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:15 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:16.799465 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-329db206-09c8-4493-98ca-6556c878f1d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:16.800079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-329db206-09c8-4493-98ca-6556c878f1d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:16.807150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-329db206-09c8-4493-98ca-6556c878f1d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:16.807657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-329db206-09c8-4493-98ca-6556c878f1d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:16.808086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-329db206-09c8-4493-98ca-6556c878f1d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:16.808763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-329db206-09c8-4493-98ca-6556c878f1d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:16.809206 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-329db206-09c8-4493-98ca-6556c878f1d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:16.809619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-329db206-09c8-4493-98ca-6556c878f1d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:16.901478 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5cec1639-9f19-417f-9dc8-3866842249cb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:16.902192 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5cec1639-9f19-417f-9dc8-3866842249cb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:16.908655 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cec1639-9f19-417f-9dc8-3866842249cb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:16.909214 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cec1639-9f19-417f-9dc8-3866842249cb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:16.909744 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cec1639-9f19-417f-9dc8-3866842249cb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:16.911182 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cec1639-9f19-417f-9dc8-3866842249cb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:16.911807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cec1639-9f19-417f-9dc8-3866842249cb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:16.912238 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5cec1639-9f19-417f-9dc8-3866842249cb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:16.938019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-329db206-09c8-4493-98ca-6556c878f1d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:16.946252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-329db206-09c8-4493-98ca-6556c878f1d0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150682 Aug 30 15:03:16.946832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 972/1938] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:16 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:17.038448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5cec1639-9f19-417f-9dc8-3866842249cb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:17.046594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5cec1639-9f19-417f-9dc8-3866842249cb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149001 Aug 30 15:03:17.047186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 967/1939] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:16 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:17.065431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cbd5f7a6-a9fb-435e-a5b3-591d959b7832 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:17.066045 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cbd5f7a6-a9fb-435e-a5b3-591d959b7832 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:17.072305 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbd5f7a6-a9fb-435e-a5b3-591d959b7832 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:17.072786 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbd5f7a6-a9fb-435e-a5b3-591d959b7832 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:17.073221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbd5f7a6-a9fb-435e-a5b3-591d959b7832 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:17.073914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbd5f7a6-a9fb-435e-a5b3-591d959b7832 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:17.074365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbd5f7a6-a9fb-435e-a5b3-591d959b7832 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:17.074793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cbd5f7a6-a9fb-435e-a5b3-591d959b7832 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:17.135736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cbd5f7a6-a9fb-435e-a5b3-591d959b7832 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:17.144168 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cbd5f7a6-a9fb-435e-a5b3-591d959b7832 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:17.146338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cbd5f7a6-a9fb-435e-a5b3-591d959b7832 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:17.147515 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cbd5f7a6-a9fb-435e-a5b3-591d959b7832 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086012 Aug 30 15:03:17.148071 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 973/1940] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:17 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:17.968879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b3ce0d8a-b307-472f-b01b-5a6f67cee79a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:17.969496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b3ce0d8a-b307-472f-b01b-5a6f67cee79a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:17.976500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3ce0d8a-b307-472f-b01b-5a6f67cee79a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:17.976981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3ce0d8a-b307-472f-b01b-5a6f67cee79a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:17.977417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3ce0d8a-b307-472f-b01b-5a6f67cee79a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:17.978104 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3ce0d8a-b307-472f-b01b-5a6f67cee79a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:17.978555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3ce0d8a-b307-472f-b01b-5a6f67cee79a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:17.978977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3ce0d8a-b307-472f-b01b-5a6f67cee79a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:18.068442 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-62307282-b0cd-4471-9837-f337053a9655 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:18.069054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-62307282-b0cd-4471-9837-f337053a9655 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:18.075674 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62307282-b0cd-4471-9837-f337053a9655 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:18.076157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62307282-b0cd-4471-9837-f337053a9655 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:18.076593 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62307282-b0cd-4471-9837-f337053a9655 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:18.077426 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62307282-b0cd-4471-9837-f337053a9655 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:18.077885 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62307282-b0cd-4471-9837-f337053a9655 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:18.078310 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62307282-b0cd-4471-9837-f337053a9655 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:18.106634 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b3ce0d8a-b307-472f-b01b-5a6f67cee79a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:18.115917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b3ce0d8a-b307-472f-b01b-5a6f67cee79a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150934 Aug 30 15:03:18.116491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 968/1941] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:17 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:18.169892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d8601542-9e37-40fb-86fb-fa3f5df4dc4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:18.170502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d8601542-9e37-40fb-86fb-fa3f5df4dc4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:18.176404 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8601542-9e37-40fb-86fb-fa3f5df4dc4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:18.177873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8601542-9e37-40fb-86fb-fa3f5df4dc4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:18.178309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8601542-9e37-40fb-86fb-fa3f5df4dc4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:18.178999 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8601542-9e37-40fb-86fb-fa3f5df4dc4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:18.179478 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8601542-9e37-40fb-86fb-fa3f5df4dc4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:18.179903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8601542-9e37-40fb-86fb-fa3f5df4dc4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:18.211646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-62307282-b0cd-4471-9837-f337053a9655 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:18.220237 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-62307282-b0cd-4471-9837-f337053a9655 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.155659 Aug 30 15:03:18.222590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 974/1942] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:18 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:18.245186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d8601542-9e37-40fb-86fb-fa3f5df4dc4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:18.253846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d8601542-9e37-40fb-86fb-fa3f5df4dc4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:18.255785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d8601542-9e37-40fb-86fb-fa3f5df4dc4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:18.256916 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d8601542-9e37-40fb-86fb-fa3f5df4dc4f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090985 Aug 30 15:03:18.257627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 969/1943] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:18 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:03:19.137036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-126cf902-bcff-4821-b808-546910461ed8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:19.137652 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-126cf902-bcff-4821-b808-546910461ed8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:19.144857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-126cf902-bcff-4821-b808-546910461ed8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:19.145440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-126cf902-bcff-4821-b808-546910461ed8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:19.146050 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-126cf902-bcff-4821-b808-546910461ed8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:19.146744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-126cf902-bcff-4821-b808-546910461ed8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:19.147195 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-126cf902-bcff-4821-b808-546910461ed8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:19.147642 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-126cf902-bcff-4821-b808-546910461ed8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:19.241272 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0dc4fbef-e6ce-4041-a9a9-0a029aa33a0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:19.241883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0dc4fbef-e6ce-4041-a9a9-0a029aa33a0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:19.248158 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dc4fbef-e6ce-4041-a9a9-0a029aa33a0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:19.248635 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dc4fbef-e6ce-4041-a9a9-0a029aa33a0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:19.249063 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dc4fbef-e6ce-4041-a9a9-0a029aa33a0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:19.249749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dc4fbef-e6ce-4041-a9a9-0a029aa33a0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:19.250192 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dc4fbef-e6ce-4041-a9a9-0a029aa33a0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:19.250610 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dc4fbef-e6ce-4041-a9a9-0a029aa33a0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:19.276715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-126cf902-bcff-4821-b808-546910461ed8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:19.285246 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-126cf902-bcff-4821-b808-546910461ed8 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152118 Aug 30 15:03:19.286090 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 975/1944] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:19 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:19.290546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0068fc3a-250a-4cf1-bee3-960a739fed21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:19.291244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0068fc3a-250a-4cf1-bee3-960a739fed21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:19.297513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0068fc3a-250a-4cf1-bee3-960a739fed21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:19.298314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0068fc3a-250a-4cf1-bee3-960a739fed21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:19.299057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0068fc3a-250a-4cf1-bee3-960a739fed21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:19.299988 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0068fc3a-250a-4cf1-bee3-960a739fed21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:19.300553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0068fc3a-250a-4cf1-bee3-960a739fed21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:19.300978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0068fc3a-250a-4cf1-bee3-960a739fed21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:19.313662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:03:19.313875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 15:03:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 (ip 10.222.0.30) !!! Aug 30 15:03:19.368119 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0068fc3a-250a-4cf1-bee3-960a739fed21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:19.376596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0068fc3a-250a-4cf1-bee3-960a739fed21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:19.378025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0068fc3a-250a-4cf1-bee3-960a739fed21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:19.379161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0068fc3a-250a-4cf1-bee3-960a739fed21 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.092230 Aug 30 15:03:19.379854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 976/1945] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:19 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:19.381953 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0dc4fbef-e6ce-4041-a9a9-0a029aa33a0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:19.390173 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0dc4fbef-e6ce-4041-a9a9-0a029aa33a0b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153412 Aug 30 15:03:19.390672 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 970/1946] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:19 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:20.306222 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-65491241-88d2-4af6-9342-b1464c8b6602 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:20.306832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-65491241-88d2-4af6-9342-b1464c8b6602 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:20.312922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65491241-88d2-4af6-9342-b1464c8b6602 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:20.313400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65491241-88d2-4af6-9342-b1464c8b6602 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:20.313828 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65491241-88d2-4af6-9342-b1464c8b6602 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:20.314506 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65491241-88d2-4af6-9342-b1464c8b6602 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:20.314949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65491241-88d2-4af6-9342-b1464c8b6602 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:20.315410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-65491241-88d2-4af6-9342-b1464c8b6602 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:20.402702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9b6e088a-0cfe-4166-9a34-1b57db83b404 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:20.403751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9b6e088a-0cfe-4166-9a34-1b57db83b404 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:20.412020 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b6e088a-0cfe-4166-9a34-1b57db83b404 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:20.412551 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b6e088a-0cfe-4166-9a34-1b57db83b404 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:20.413060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b6e088a-0cfe-4166-9a34-1b57db83b404 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:20.413865 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b6e088a-0cfe-4166-9a34-1b57db83b404 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:20.414356 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b6e088a-0cfe-4166-9a34-1b57db83b404 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:20.414728 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b6e088a-0cfe-4166-9a34-1b57db83b404 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:20.433281 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:20.479946 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b6e088a-0cfe-4166-9a34-1b57db83b404 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:20.488477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b6e088a-0cfe-4166-9a34-1b57db83b404 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:20.490127 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b6e088a-0cfe-4166-9a34-1b57db83b404 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:20.491429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9b6e088a-0cfe-4166-9a34-1b57db83b404 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.092775 Aug 30 15:03:20.492094 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 971/1947] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:20 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:03:20.496552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-17991138-a86d-469c-b76a-d9790a46c78c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:20.497151 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-17991138-a86d-469c-b76a-d9790a46c78c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:20.502984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17991138-a86d-469c-b76a-d9790a46c78c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:20.503494 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17991138-a86d-469c-b76a-d9790a46c78c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:20.503929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17991138-a86d-469c-b76a-d9790a46c78c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:20.505185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17991138-a86d-469c-b76a-d9790a46c78c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:20.505634 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17991138-a86d-469c-b76a-d9790a46c78c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:20.506057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-17991138-a86d-469c-b76a-d9790a46c78c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:20.549271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-65491241-88d2-4af6-9342-b1464c8b6602 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:20.553016 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:20.558738 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-65491241-88d2-4af6-9342-b1464c8b6602 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.256501 Aug 30 15:03:20.559326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 977/1948] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:20 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:20.636279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-17991138-a86d-469c-b76a-d9790a46c78c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:20.644322 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-17991138-a86d-469c-b76a-d9790a46c78c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151301 Aug 30 15:03:20.644887 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 972/1949] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:20 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:21.515724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-868296c2-7099-4e5b-a4c4-cb6384aae89a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:21.516265 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-868296c2-7099-4e5b-a4c4-cb6384aae89a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:21.523645 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-868296c2-7099-4e5b-a4c4-cb6384aae89a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:21.524123 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-868296c2-7099-4e5b-a4c4-cb6384aae89a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:21.524553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-868296c2-7099-4e5b-a4c4-cb6384aae89a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:21.525233 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-868296c2-7099-4e5b-a4c4-cb6384aae89a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:21.525674 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-868296c2-7099-4e5b-a4c4-cb6384aae89a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:21.526088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-868296c2-7099-4e5b-a4c4-cb6384aae89a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:21.580692 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0e69adfa-637e-47c3-bebf-bb4b48b328a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:21.581286 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0e69adfa-637e-47c3-bebf-bb4b48b328a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:21.587984 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-868296c2-7099-4e5b-a4c4-cb6384aae89a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:21.588407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e69adfa-637e-47c3-bebf-bb4b48b328a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:21.588892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e69adfa-637e-47c3-bebf-bb4b48b328a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:21.589363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e69adfa-637e-47c3-bebf-bb4b48b328a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:21.590055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e69adfa-637e-47c3-bebf-bb4b48b328a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:21.590505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e69adfa-637e-47c3-bebf-bb4b48b328a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:21.590926 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e69adfa-637e-47c3-bebf-bb4b48b328a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:21.596690 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-868296c2-7099-4e5b-a4c4-cb6384aae89a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:21.598124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-868296c2-7099-4e5b-a4c4-cb6384aae89a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:21.600298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-868296c2-7099-4e5b-a4c4-cb6384aae89a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088537 Aug 30 15:03:21.600859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 978/1950] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:21 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:21.666016 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-13ddef85-6f90-4148-bcc8-a28ce0a96fdb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:21.666647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-13ddef85-6f90-4148-bcc8-a28ce0a96fdb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:21.672693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-13ddef85-6f90-4148-bcc8-a28ce0a96fdb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:21.673172 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-13ddef85-6f90-4148-bcc8-a28ce0a96fdb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:21.673599 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-13ddef85-6f90-4148-bcc8-a28ce0a96fdb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:21.674284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-13ddef85-6f90-4148-bcc8-a28ce0a96fdb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:21.674733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-13ddef85-6f90-4148-bcc8-a28ce0a96fdb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:21.675151 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-13ddef85-6f90-4148-bcc8-a28ce0a96fdb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:21.720061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0e69adfa-637e-47c3-bebf-bb4b48b328a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:21.734617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0e69adfa-637e-47c3-bebf-bb4b48b328a6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.157924 Aug 30 15:03:21.735395 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 973/1951] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:21 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:21.806800 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-13ddef85-6f90-4148-bcc8-a28ce0a96fdb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:21.814941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-13ddef85-6f90-4148-bcc8-a28ce0a96fdb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153743 Aug 30 15:03:21.815533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 979/1952] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:21 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:22.622366 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d2a36128-57c9-473c-b276-887f0f05fef1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:22.622988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d2a36128-57c9-473c-b276-887f0f05fef1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:22.629377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2a36128-57c9-473c-b276-887f0f05fef1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:22.630126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2a36128-57c9-473c-b276-887f0f05fef1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:22.630559 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2a36128-57c9-473c-b276-887f0f05fef1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:22.631264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2a36128-57c9-473c-b276-887f0f05fef1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:22.631717 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2a36128-57c9-473c-b276-887f0f05fef1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:22.632139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2a36128-57c9-473c-b276-887f0f05fef1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:22.696890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d2a36128-57c9-473c-b276-887f0f05fef1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:22.706292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d2a36128-57c9-473c-b276-887f0f05fef1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:22.707822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d2a36128-57c9-473c-b276-887f0f05fef1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:22.709445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d2a36128-57c9-473c-b276-887f0f05fef1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091020 Aug 30 15:03:22.710038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 974/1953] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:22 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:22.760506 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6a2ac5a3-0e97-4d15-87fa-0f630fdbbee0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:22.761150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6a2ac5a3-0e97-4d15-87fa-0f630fdbbee0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:22.767927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a2ac5a3-0e97-4d15-87fa-0f630fdbbee0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:22.768415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a2ac5a3-0e97-4d15-87fa-0f630fdbbee0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:22.768854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a2ac5a3-0e97-4d15-87fa-0f630fdbbee0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:22.769562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a2ac5a3-0e97-4d15-87fa-0f630fdbbee0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:22.770012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a2ac5a3-0e97-4d15-87fa-0f630fdbbee0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:22.770477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a2ac5a3-0e97-4d15-87fa-0f630fdbbee0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:22.836492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-15cde825-84c6-4a9e-8868-f87c0de0b9ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:22.837114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-15cde825-84c6-4a9e-8868-f87c0de0b9ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:22.843185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15cde825-84c6-4a9e-8868-f87c0de0b9ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:22.843701 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15cde825-84c6-4a9e-8868-f87c0de0b9ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:22.844136 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15cde825-84c6-4a9e-8868-f87c0de0b9ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:22.844830 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15cde825-84c6-4a9e-8868-f87c0de0b9ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:22.845280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15cde825-84c6-4a9e-8868-f87c0de0b9ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:22.845703 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15cde825-84c6-4a9e-8868-f87c0de0b9ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:22.901990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6a2ac5a3-0e97-4d15-87fa-0f630fdbbee0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:22.910325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6a2ac5a3-0e97-4d15-87fa-0f630fdbbee0 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156657 Aug 30 15:03:22.911668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 980/1954] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:22 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:22.979561 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-15cde825-84c6-4a9e-8868-f87c0de0b9ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:22.987822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-15cde825-84c6-4a9e-8868-f87c0de0b9ac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.155232 Aug 30 15:03:22.988395 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 975/1955] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:22 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:23.732752 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1062f4ed-fc20-4e54-b97d-79ed9c6febea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:23.733398 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1062f4ed-fc20-4e54-b97d-79ed9c6febea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:23.735290 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=82 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:23.741402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1062f4ed-fc20-4e54-b97d-79ed9c6febea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:23.741875 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1062f4ed-fc20-4e54-b97d-79ed9c6febea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:23.742304 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1062f4ed-fc20-4e54-b97d-79ed9c6febea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:23.742978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1062f4ed-fc20-4e54-b97d-79ed9c6febea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:23.743459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1062f4ed-fc20-4e54-b97d-79ed9c6febea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:23.743871 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1062f4ed-fc20-4e54-b97d-79ed9c6febea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:23.804005 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1062f4ed-fc20-4e54-b97d-79ed9c6febea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:23.813668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1062f4ed-fc20-4e54-b97d-79ed9c6febea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:23.815123 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1062f4ed-fc20-4e54-b97d-79ed9c6febea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:23.816296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1062f4ed-fc20-4e54-b97d-79ed9c6febea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087518 Aug 30 15:03:23.816857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 981/1956] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:23 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:23.932434 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-206f2dec-6106-4ffd-a670-14db7acf527d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:23.933064 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-206f2dec-6106-4ffd-a670-14db7acf527d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:23.935421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=76 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:23.940850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-206f2dec-6106-4ffd-a670-14db7acf527d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:23.941321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-206f2dec-6106-4ffd-a670-14db7acf527d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:23.941750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-206f2dec-6106-4ffd-a670-14db7acf527d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:23.943059 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-206f2dec-6106-4ffd-a670-14db7acf527d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:23.943529 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-206f2dec-6106-4ffd-a670-14db7acf527d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:23.943949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-206f2dec-6106-4ffd-a670-14db7acf527d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:24.008963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c3fc8654-45fc-4bdd-a0a5-2d5bef6da7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:24.009500 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c3fc8654-45fc-4bdd-a0a5-2d5bef6da7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:24.015394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3fc8654-45fc-4bdd-a0a5-2d5bef6da7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:24.015877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3fc8654-45fc-4bdd-a0a5-2d5bef6da7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:24.016309 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3fc8654-45fc-4bdd-a0a5-2d5bef6da7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:24.017008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3fc8654-45fc-4bdd-a0a5-2d5bef6da7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:24.017682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3fc8654-45fc-4bdd-a0a5-2d5bef6da7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:24.018112 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c3fc8654-45fc-4bdd-a0a5-2d5bef6da7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:24.076875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-206f2dec-6106-4ffd-a670-14db7acf527d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:24.085407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-206f2dec-6106-4ffd-a670-14db7acf527d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156801 Aug 30 15:03:24.085982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 976/1957] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:23 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:24.150817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c3fc8654-45fc-4bdd-a0a5-2d5bef6da7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:24.158955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c3fc8654-45fc-4bdd-a0a5-2d5bef6da7b3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153998 Aug 30 15:03:24.159555 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 982/1958] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:24 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:24.839580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0fead756-985b-4f9b-8973-428400130e2b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:24.840187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0fead756-985b-4f9b-8973-428400130e2b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:24.846162 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0fead756-985b-4f9b-8973-428400130e2b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:24.846641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0fead756-985b-4f9b-8973-428400130e2b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:24.847072 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0fead756-985b-4f9b-8973-428400130e2b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:24.847785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0fead756-985b-4f9b-8973-428400130e2b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:24.848233 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0fead756-985b-4f9b-8973-428400130e2b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:24.848654 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0fead756-985b-4f9b-8973-428400130e2b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:24.910176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0fead756-985b-4f9b-8973-428400130e2b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:24.919799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0fead756-985b-4f9b-8973-428400130e2b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:24.921347 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0fead756-985b-4f9b-8973-428400130e2b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:24.922493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0fead756-985b-4f9b-8973-428400130e2b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086828 Aug 30 15:03:24.923044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 977/1959] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:24 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:25.106542 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-52e939e4-dd64-452b-9509-461d52d56c11 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:25.107105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-52e939e4-dd64-452b-9509-461d52d56c11 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:25.113498 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52e939e4-dd64-452b-9509-461d52d56c11 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:25.113978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52e939e4-dd64-452b-9509-461d52d56c11 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:25.114454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52e939e4-dd64-452b-9509-461d52d56c11 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:25.115292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52e939e4-dd64-452b-9509-461d52d56c11 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:25.115696 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52e939e4-dd64-452b-9509-461d52d56c11 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:25.116119 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-52e939e4-dd64-452b-9509-461d52d56c11 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:25.180131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-896617d7-bd1e-4dd3-945d-65c3ca2d9676 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:25.180721 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-896617d7-bd1e-4dd3-945d-65c3ca2d9676 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:25.186962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-896617d7-bd1e-4dd3-945d-65c3ca2d9676 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:25.187479 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-896617d7-bd1e-4dd3-945d-65c3ca2d9676 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:25.187941 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-896617d7-bd1e-4dd3-945d-65c3ca2d9676 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:25.188624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-896617d7-bd1e-4dd3-945d-65c3ca2d9676 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:25.189072 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-896617d7-bd1e-4dd3-945d-65c3ca2d9676 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:25.189489 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-896617d7-bd1e-4dd3-945d-65c3ca2d9676 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:25.245546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-52e939e4-dd64-452b-9509-461d52d56c11 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:25.253725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-52e939e4-dd64-452b-9509-461d52d56c11 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151143 Aug 30 15:03:25.254300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 983/1960] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:25 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:25.320986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-896617d7-bd1e-4dd3-945d-65c3ca2d9676 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:25.329528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-896617d7-bd1e-4dd3-945d-65c3ca2d9676 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153283 Aug 30 15:03:25.330214 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 978/1961] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:25 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:25.945407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1bad7b2e-caf0-45c3-8060-5f54e36758c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:25.946011 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1bad7b2e-caf0-45c3-8060-5f54e36758c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:25.952158 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1bad7b2e-caf0-45c3-8060-5f54e36758c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:25.952635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1bad7b2e-caf0-45c3-8060-5f54e36758c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:25.953063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1bad7b2e-caf0-45c3-8060-5f54e36758c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:25.953742 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1bad7b2e-caf0-45c3-8060-5f54e36758c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:25.954188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1bad7b2e-caf0-45c3-8060-5f54e36758c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:25.954607 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1bad7b2e-caf0-45c3-8060-5f54e36758c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:26.015280 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1bad7b2e-caf0-45c3-8060-5f54e36758c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:26.023630 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1bad7b2e-caf0-45c3-8060-5f54e36758c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:26.025059 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1bad7b2e-caf0-45c3-8060-5f54e36758c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:26.026186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1bad7b2e-caf0-45c3-8060-5f54e36758c8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084898 Aug 30 15:03:26.026742 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 984/1962] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:25 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:26.275983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-636b0558-176c-46ae-b27f-2e14f4716989 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:26.276613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-636b0558-176c-46ae-b27f-2e14f4716989 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:26.283001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636b0558-176c-46ae-b27f-2e14f4716989 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:26.283506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636b0558-176c-46ae-b27f-2e14f4716989 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:26.283937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636b0558-176c-46ae-b27f-2e14f4716989 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:26.284611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636b0558-176c-46ae-b27f-2e14f4716989 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:26.285056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636b0558-176c-46ae-b27f-2e14f4716989 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:26.285470 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-636b0558-176c-46ae-b27f-2e14f4716989 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:26.350597 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bd9c000b-75ca-4bf8-ae4f-5939f4adc8c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:26.351200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bd9c000b-75ca-4bf8-ae4f-5939f4adc8c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:26.357485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd9c000b-75ca-4bf8-ae4f-5939f4adc8c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:26.357971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd9c000b-75ca-4bf8-ae4f-5939f4adc8c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:26.358408 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd9c000b-75ca-4bf8-ae4f-5939f4adc8c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:26.359104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd9c000b-75ca-4bf8-ae4f-5939f4adc8c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:26.359591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd9c000b-75ca-4bf8-ae4f-5939f4adc8c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:26.360011 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd9c000b-75ca-4bf8-ae4f-5939f4adc8c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:26.415328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-636b0558-176c-46ae-b27f-2e14f4716989 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:26.423696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-636b0558-176c-46ae-b27f-2e14f4716989 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151495 Aug 30 15:03:26.424278 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 979/1963] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:26 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:26.491870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bd9c000b-75ca-4bf8-ae4f-5939f4adc8c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:26.499917 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bd9c000b-75ca-4bf8-ae4f-5939f4adc8c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153927 Aug 30 15:03:26.500483 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 985/1964] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:26 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:27.049389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-30c5caeb-0877-4fcd-97e8-1acf6067707d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:27.049997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-30c5caeb-0877-4fcd-97e8-1acf6067707d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:27.056903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30c5caeb-0877-4fcd-97e8-1acf6067707d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:27.057379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30c5caeb-0877-4fcd-97e8-1acf6067707d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:27.057824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30c5caeb-0877-4fcd-97e8-1acf6067707d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:27.058496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30c5caeb-0877-4fcd-97e8-1acf6067707d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:27.058947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30c5caeb-0877-4fcd-97e8-1acf6067707d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:27.059405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-30c5caeb-0877-4fcd-97e8-1acf6067707d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:27.119920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-30c5caeb-0877-4fcd-97e8-1acf6067707d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:27.128677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-30c5caeb-0877-4fcd-97e8-1acf6067707d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:27.130199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-30c5caeb-0877-4fcd-97e8-1acf6067707d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:27.131349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-30c5caeb-0877-4fcd-97e8-1acf6067707d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085837 Aug 30 15:03:27.131904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 980/1965] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:27 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:27.445208 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d823260a-1bb5-45de-b27c-4b7e171ab8dd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:27.445844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d823260a-1bb5-45de-b27c-4b7e171ab8dd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:27.452527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d823260a-1bb5-45de-b27c-4b7e171ab8dd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:27.453010 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d823260a-1bb5-45de-b27c-4b7e171ab8dd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:27.453434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d823260a-1bb5-45de-b27c-4b7e171ab8dd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:27.454117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d823260a-1bb5-45de-b27c-4b7e171ab8dd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:27.454565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d823260a-1bb5-45de-b27c-4b7e171ab8dd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:27.454981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d823260a-1bb5-45de-b27c-4b7e171ab8dd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:27.522700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f112de5d-9cc1-446a-8450-3bf776668edd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:27.523336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f112de5d-9cc1-446a-8450-3bf776668edd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:27.530081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f112de5d-9cc1-446a-8450-3bf776668edd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:27.530561 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f112de5d-9cc1-446a-8450-3bf776668edd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:27.530991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f112de5d-9cc1-446a-8450-3bf776668edd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:27.531753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f112de5d-9cc1-446a-8450-3bf776668edd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:27.532151 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f112de5d-9cc1-446a-8450-3bf776668edd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:27.532573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f112de5d-9cc1-446a-8450-3bf776668edd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:27.584758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d823260a-1bb5-45de-b27c-4b7e171ab8dd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:27.592965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d823260a-1bb5-45de-b27c-4b7e171ab8dd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151764 Aug 30 15:03:27.593533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 986/1966] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:27 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:27.667019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f112de5d-9cc1-446a-8450-3bf776668edd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:27.675050 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f112de5d-9cc1-446a-8450-3bf776668edd tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.157299 Aug 30 15:03:27.675637 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 981/1967] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:27 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:28.153771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f0d8bcb9-1e53-4a50-9772-ce437c890e84 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:28.154382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f0d8bcb9-1e53-4a50-9772-ce437c890e84 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:28.160283 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f0d8bcb9-1e53-4a50-9772-ce437c890e84 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:28.160762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f0d8bcb9-1e53-4a50-9772-ce437c890e84 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:28.161231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f0d8bcb9-1e53-4a50-9772-ce437c890e84 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:28.161982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f0d8bcb9-1e53-4a50-9772-ce437c890e84 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:28.162465 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f0d8bcb9-1e53-4a50-9772-ce437c890e84 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:28.162891 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f0d8bcb9-1e53-4a50-9772-ce437c890e84 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:28.226632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f0d8bcb9-1e53-4a50-9772-ce437c890e84 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:28.235114 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f0d8bcb9-1e53-4a50-9772-ce437c890e84 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:28.236606 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f0d8bcb9-1e53-4a50-9772-ce437c890e84 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:28.237726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f0d8bcb9-1e53-4a50-9772-ce437c890e84 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087940 Aug 30 15:03:28.238290 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 987/1968] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:28 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:28.616102 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7434165c-0f94-4241-a5e1-10d8901b3d82 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:28.616713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7434165c-0f94-4241-a5e1-10d8901b3d82 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:28.623518 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7434165c-0f94-4241-a5e1-10d8901b3d82 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:28.623997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7434165c-0f94-4241-a5e1-10d8901b3d82 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:28.624429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7434165c-0f94-4241-a5e1-10d8901b3d82 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:28.625115 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7434165c-0f94-4241-a5e1-10d8901b3d82 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:28.625560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7434165c-0f94-4241-a5e1-10d8901b3d82 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:28.625978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7434165c-0f94-4241-a5e1-10d8901b3d82 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:28.695718 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e05f9976-546d-44fb-b379-703cf848bcd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:28.696334 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e05f9976-546d-44fb-b379-703cf848bcd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:28.703297 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e05f9976-546d-44fb-b379-703cf848bcd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:28.703789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e05f9976-546d-44fb-b379-703cf848bcd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:28.704223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e05f9976-546d-44fb-b379-703cf848bcd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:28.704923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e05f9976-546d-44fb-b379-703cf848bcd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:28.705373 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e05f9976-546d-44fb-b379-703cf848bcd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:28.705793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e05f9976-546d-44fb-b379-703cf848bcd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:28.753935 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7434165c-0f94-4241-a5e1-10d8901b3d82 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:28.762208 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7434165c-0f94-4241-a5e1-10d8901b3d82 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150648 Aug 30 15:03:28.762769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 982/1969] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:28 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:28.837519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e05f9976-546d-44fb-b379-703cf848bcd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:28.845569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e05f9976-546d-44fb-b379-703cf848bcd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153761 Aug 30 15:03:28.846134 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 988/1970] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:28 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:29.261802 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-de414479-c133-429f-b2bb-cd0e0e423954 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:29.262415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-de414479-c133-429f-b2bb-cd0e0e423954 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:29.268358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de414479-c133-429f-b2bb-cd0e0e423954 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:29.268838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de414479-c133-429f-b2bb-cd0e0e423954 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:29.269273 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de414479-c133-429f-b2bb-cd0e0e423954 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:29.269961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de414479-c133-429f-b2bb-cd0e0e423954 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:29.270416 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de414479-c133-429f-b2bb-cd0e0e423954 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:29.271406 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-de414479-c133-429f-b2bb-cd0e0e423954 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:29.339313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-de414479-c133-429f-b2bb-cd0e0e423954 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:29.348221 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-de414479-c133-429f-b2bb-cd0e0e423954 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:29.349723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-de414479-c133-429f-b2bb-cd0e0e423954 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:29.350877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-de414479-c133-429f-b2bb-cd0e0e423954 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.092976 Aug 30 15:03:29.351472 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 983/1971] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:29 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:29.783469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-779c3ba4-76ad-434e-988b-7eaa9a470ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:29.784124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-779c3ba4-76ad-434e-988b-7eaa9a470ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:29.790447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-779c3ba4-76ad-434e-988b-7eaa9a470ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:29.790933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-779c3ba4-76ad-434e-988b-7eaa9a470ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:29.791404 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-779c3ba4-76ad-434e-988b-7eaa9a470ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:29.792097 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-779c3ba4-76ad-434e-988b-7eaa9a470ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:29.792542 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-779c3ba4-76ad-434e-988b-7eaa9a470ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:29.792968 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-779c3ba4-76ad-434e-988b-7eaa9a470ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:29.867256 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4898c9da-08cc-4a8e-90f2-8d998198ad23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:29.868090 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4898c9da-08cc-4a8e-90f2-8d998198ad23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:29.874585 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4898c9da-08cc-4a8e-90f2-8d998198ad23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:29.875067 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4898c9da-08cc-4a8e-90f2-8d998198ad23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:29.875535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4898c9da-08cc-4a8e-90f2-8d998198ad23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:29.876223 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4898c9da-08cc-4a8e-90f2-8d998198ad23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:29.876675 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4898c9da-08cc-4a8e-90f2-8d998198ad23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:29.877092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4898c9da-08cc-4a8e-90f2-8d998198ad23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:29.923014 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-779c3ba4-76ad-434e-988b-7eaa9a470ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:29.931703 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-779c3ba4-76ad-434e-988b-7eaa9a470ca7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152163 Aug 30 15:03:29.932278 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 989/1972] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:29 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:30.008761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4898c9da-08cc-4a8e-90f2-8d998198ad23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:30.016915 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4898c9da-08cc-4a8e-90f2-8d998198ad23 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.154199 Aug 30 15:03:30.017473 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 984/1973] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:29 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:30.373430 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7c9f91f5-890e-471c-8e94-bed20f4d1445 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:30.374027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7c9f91f5-890e-471c-8e94-bed20f4d1445 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:30.380859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c9f91f5-890e-471c-8e94-bed20f4d1445 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:30.381538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c9f91f5-890e-471c-8e94-bed20f4d1445 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:30.381977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c9f91f5-890e-471c-8e94-bed20f4d1445 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:30.382671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c9f91f5-890e-471c-8e94-bed20f4d1445 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:30.383122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c9f91f5-890e-471c-8e94-bed20f4d1445 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:30.383565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7c9f91f5-890e-471c-8e94-bed20f4d1445 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:30.447525 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7c9f91f5-890e-471c-8e94-bed20f4d1445 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:30.456016 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7c9f91f5-890e-471c-8e94-bed20f4d1445 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:30.457458 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7c9f91f5-890e-471c-8e94-bed20f4d1445 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:30.458877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7c9f91f5-890e-471c-8e94-bed20f4d1445 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089288 Aug 30 15:03:30.459461 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 990/1974] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:30 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:30.954044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1af6ca45-d2f3-4f4e-a8d5-d998ed4c4ff3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:30.954659 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1af6ca45-d2f3-4f4e-a8d5-d998ed4c4ff3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:30.961623 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1af6ca45-d2f3-4f4e-a8d5-d998ed4c4ff3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:30.962101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1af6ca45-d2f3-4f4e-a8d5-d998ed4c4ff3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:30.962531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1af6ca45-d2f3-4f4e-a8d5-d998ed4c4ff3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:30.963702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1af6ca45-d2f3-4f4e-a8d5-d998ed4c4ff3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:30.964282 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1af6ca45-d2f3-4f4e-a8d5-d998ed4c4ff3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:30.964732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1af6ca45-d2f3-4f4e-a8d5-d998ed4c4ff3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:31.038657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-37a742fb-e356-4742-83f7-5df95058acab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:31.040126 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-37a742fb-e356-4742-83f7-5df95058acab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:31.046813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-37a742fb-e356-4742-83f7-5df95058acab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:31.047328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-37a742fb-e356-4742-83f7-5df95058acab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:31.047762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-37a742fb-e356-4742-83f7-5df95058acab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:31.048465 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-37a742fb-e356-4742-83f7-5df95058acab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:31.048914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-37a742fb-e356-4742-83f7-5df95058acab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:31.049362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-37a742fb-e356-4742-83f7-5df95058acab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:31.124318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1af6ca45-d2f3-4f4e-a8d5-d998ed4c4ff3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:31.133544 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1af6ca45-d2f3-4f4e-a8d5-d998ed4c4ff3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.183277 Aug 30 15:03:31.134132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 985/1975] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:30 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:31.201495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-37a742fb-e356-4742-83f7-5df95058acab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:31.210592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-37a742fb-e356-4742-83f7-5df95058acab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.176451 Aug 30 15:03:31.211098 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 991/1976] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:31 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:31.481601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cb0ec979-a952-454b-bd15-dea618d930cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:31.482135 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cb0ec979-a952-454b-bd15-dea618d930cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:31.488130 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb0ec979-a952-454b-bd15-dea618d930cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:31.488611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb0ec979-a952-454b-bd15-dea618d930cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:31.489044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb0ec979-a952-454b-bd15-dea618d930cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:31.489792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb0ec979-a952-454b-bd15-dea618d930cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:31.490363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb0ec979-a952-454b-bd15-dea618d930cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:31.490791 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb0ec979-a952-454b-bd15-dea618d930cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:31.556490 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cb0ec979-a952-454b-bd15-dea618d930cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:31.565229 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cb0ec979-a952-454b-bd15-dea618d930cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:31.566690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cb0ec979-a952-454b-bd15-dea618d930cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:31.568061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cb0ec979-a952-454b-bd15-dea618d930cf tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090431 Aug 30 15:03:31.568614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 986/1977] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:31 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:32.155987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1ac43b44-c5b1-4e2f-8fc5-1c5dc58a3c16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:32.156600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1ac43b44-c5b1-4e2f-8fc5-1c5dc58a3c16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:32.163935 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ac43b44-c5b1-4e2f-8fc5-1c5dc58a3c16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:32.164422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ac43b44-c5b1-4e2f-8fc5-1c5dc58a3c16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:32.164855 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ac43b44-c5b1-4e2f-8fc5-1c5dc58a3c16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:32.165545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ac43b44-c5b1-4e2f-8fc5-1c5dc58a3c16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:32.165997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ac43b44-c5b1-4e2f-8fc5-1c5dc58a3c16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:32.166440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1ac43b44-c5b1-4e2f-8fc5-1c5dc58a3c16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:32.231762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b16559dc-3eeb-4569-bd1d-163b831454b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:32.232409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b16559dc-3eeb-4569-bd1d-163b831454b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:32.239659 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b16559dc-3eeb-4569-bd1d-163b831454b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:32.240189 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b16559dc-3eeb-4569-bd1d-163b831454b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:32.240622 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b16559dc-3eeb-4569-bd1d-163b831454b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:32.241336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b16559dc-3eeb-4569-bd1d-163b831454b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:32.241786 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b16559dc-3eeb-4569-bd1d-163b831454b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:32.242265 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b16559dc-3eeb-4569-bd1d-163b831454b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:32.379455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b16559dc-3eeb-4569-bd1d-163b831454b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:32.388505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b16559dc-3eeb-4569-bd1d-163b831454b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.160820 Aug 30 15:03:32.389081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 987/1978] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:32 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:32.448894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1ac43b44-c5b1-4e2f-8fc5-1c5dc58a3c16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:32.457117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1ac43b44-c5b1-4e2f-8fc5-1c5dc58a3c16 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.304996 Aug 30 15:03:32.457687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 992/1979] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:32 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:32.590435 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-45f11c13-c676-43e5-8e2e-e5714624b917 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:32.591048 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-45f11c13-c676-43e5-8e2e-e5714624b917 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:32.597014 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45f11c13-c676-43e5-8e2e-e5714624b917 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:32.597491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45f11c13-c676-43e5-8e2e-e5714624b917 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:32.597926 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45f11c13-c676-43e5-8e2e-e5714624b917 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:32.598681 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45f11c13-c676-43e5-8e2e-e5714624b917 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:32.599164 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45f11c13-c676-43e5-8e2e-e5714624b917 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:32.599666 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45f11c13-c676-43e5-8e2e-e5714624b917 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:32.603716 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:32.660192 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45f11c13-c676-43e5-8e2e-e5714624b917 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:32.668812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45f11c13-c676-43e5-8e2e-e5714624b917 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:32.670291 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45f11c13-c676-43e5-8e2e-e5714624b917 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:32.671468 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-45f11c13-c676-43e5-8e2e-e5714624b917 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084975 Aug 30 15:03:32.672022 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 988/1980] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:32 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:33.409730 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-927fe32e-29ce-4cc3-ae93-84918968b26a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:33.410333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-927fe32e-29ce-4cc3-ae93-84918968b26a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:33.417398 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-927fe32e-29ce-4cc3-ae93-84918968b26a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:33.417871 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-927fe32e-29ce-4cc3-ae93-84918968b26a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:33.418299 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-927fe32e-29ce-4cc3-ae93-84918968b26a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:33.418975 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-927fe32e-29ce-4cc3-ae93-84918968b26a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:33.419446 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-927fe32e-29ce-4cc3-ae93-84918968b26a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:33.419858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-927fe32e-29ce-4cc3-ae93-84918968b26a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:33.479351 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bf15dcf6-f472-4c5e-9d0a-b4cdb03acddd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:33.479888 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bf15dcf6-f472-4c5e-9d0a-b4cdb03acddd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:33.485983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf15dcf6-f472-4c5e-9d0a-b4cdb03acddd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:33.486453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf15dcf6-f472-4c5e-9d0a-b4cdb03acddd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:33.486880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf15dcf6-f472-4c5e-9d0a-b4cdb03acddd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:33.487594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf15dcf6-f472-4c5e-9d0a-b4cdb03acddd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:33.488038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf15dcf6-f472-4c5e-9d0a-b4cdb03acddd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:33.488452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf15dcf6-f472-4c5e-9d0a-b4cdb03acddd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:33.550421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-927fe32e-29ce-4cc3-ae93-84918968b26a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:33.559942 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-927fe32e-29ce-4cc3-ae93-84918968b26a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.154016 Aug 30 15:03:33.560844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 993/1981] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:33 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:33.619916 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bf15dcf6-f472-4c5e-9d0a-b4cdb03acddd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:33.628041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bf15dcf6-f472-4c5e-9d0a-b4cdb03acddd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153400 Aug 30 15:03:33.628636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 989/1982] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:33 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:33.694874 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6c398a6d-12d3-413f-808a-7405b438d118 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:33.695519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6c398a6d-12d3-413f-808a-7405b438d118 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:33.701558 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c398a6d-12d3-413f-808a-7405b438d118 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:33.702035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c398a6d-12d3-413f-808a-7405b438d118 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:33.702463 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c398a6d-12d3-413f-808a-7405b438d118 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:33.703140 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c398a6d-12d3-413f-808a-7405b438d118 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:33.703610 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c398a6d-12d3-413f-808a-7405b438d118 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:33.704025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6c398a6d-12d3-413f-808a-7405b438d118 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:33.721102 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:33.764709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6c398a6d-12d3-413f-808a-7405b438d118 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:33.773691 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6c398a6d-12d3-413f-808a-7405b438d118 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:33.775125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6c398a6d-12d3-413f-808a-7405b438d118 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:33.776284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6c398a6d-12d3-413f-808a-7405b438d118 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085960 Aug 30 15:03:33.776832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 994/1983] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:33 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:34.581900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9ff4342d-f220-4f91-8fdc-0b14ad77335d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:34.582534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9ff4342d-f220-4f91-8fdc-0b14ad77335d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:34.589505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ff4342d-f220-4f91-8fdc-0b14ad77335d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:34.589978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ff4342d-f220-4f91-8fdc-0b14ad77335d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:34.590402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ff4342d-f220-4f91-8fdc-0b14ad77335d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:34.591079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ff4342d-f220-4f91-8fdc-0b14ad77335d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:34.591555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ff4342d-f220-4f91-8fdc-0b14ad77335d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:34.591972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ff4342d-f220-4f91-8fdc-0b14ad77335d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:34.650014 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b89004d8-e821-46f5-a4c0-3985bae750d3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:34.650612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b89004d8-e821-46f5-a4c0-3985bae750d3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:34.656865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b89004d8-e821-46f5-a4c0-3985bae750d3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:34.657337 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b89004d8-e821-46f5-a4c0-3985bae750d3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:34.657766 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b89004d8-e821-46f5-a4c0-3985bae750d3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:34.658459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b89004d8-e821-46f5-a4c0-3985bae750d3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:34.658900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b89004d8-e821-46f5-a4c0-3985bae750d3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:34.659342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b89004d8-e821-46f5-a4c0-3985bae750d3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:34.720651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9ff4342d-f220-4f91-8fdc-0b14ad77335d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:34.729590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9ff4342d-f220-4f91-8fdc-0b14ad77335d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151533 Aug 30 15:03:34.730158 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 990/1984] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:34 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:34.785752 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b89004d8-e821-46f5-a4c0-3985bae750d3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:34.794278 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b89004d8-e821-46f5-a4c0-3985bae750d3 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148806 Aug 30 15:03:34.794830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 995/1985] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:34 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:34.799156 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-edd9be97-89f9-4442-ade5-0841d9703666 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:34.799812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-edd9be97-89f9-4442-ade5-0841d9703666 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:34.806637 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-edd9be97-89f9-4442-ade5-0841d9703666 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:34.807118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-edd9be97-89f9-4442-ade5-0841d9703666 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:34.807611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-edd9be97-89f9-4442-ade5-0841d9703666 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:34.808310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-edd9be97-89f9-4442-ade5-0841d9703666 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:34.808765 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-edd9be97-89f9-4442-ade5-0841d9703666 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:34.809188 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-edd9be97-89f9-4442-ade5-0841d9703666 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:34.869592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-edd9be97-89f9-4442-ade5-0841d9703666 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:34.878073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-edd9be97-89f9-4442-ade5-0841d9703666 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:34.879543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-edd9be97-89f9-4442-ade5-0841d9703666 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:34.881060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-edd9be97-89f9-4442-ade5-0841d9703666 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085813 Aug 30 15:03:34.881622 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 991/1986] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:34 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:03:35.750519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4213c26d-9921-493d-881c-7c125a217124 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:35.751129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4213c26d-9921-493d-881c-7c125a217124 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:35.758327 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4213c26d-9921-493d-881c-7c125a217124 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:35.758810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4213c26d-9921-493d-881c-7c125a217124 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:35.759275 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4213c26d-9921-493d-881c-7c125a217124 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:35.759969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4213c26d-9921-493d-881c-7c125a217124 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:35.760419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4213c26d-9921-493d-881c-7c125a217124 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:35.760843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4213c26d-9921-493d-881c-7c125a217124 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:35.815520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-310fe433-3b88-4dbc-8a83-780c11101745 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:35.816271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-310fe433-3b88-4dbc-8a83-780c11101745 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:35.823941 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-310fe433-3b88-4dbc-8a83-780c11101745 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:35.824452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-310fe433-3b88-4dbc-8a83-780c11101745 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:35.824959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-310fe433-3b88-4dbc-8a83-780c11101745 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:35.825723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-310fe433-3b88-4dbc-8a83-780c11101745 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:35.826245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-310fe433-3b88-4dbc-8a83-780c11101745 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:35.826734 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-310fe433-3b88-4dbc-8a83-780c11101745 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:35.894307 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-4213c26d-9921-493d-881c-7c125a217124 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:35.903595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4213c26d-9921-493d-881c-7c125a217124 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.156868 Aug 30 15:03:35.909014 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 996/1987] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:35 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:35.909014 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-079a330e-a469-4e30-833e-cb41156ab3e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:35.909298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-079a330e-a469-4e30-833e-cb41156ab3e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:35.915772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-079a330e-a469-4e30-833e-cb41156ab3e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:35.916261 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-079a330e-a469-4e30-833e-cb41156ab3e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:35.916690 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-079a330e-a469-4e30-833e-cb41156ab3e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:35.917483 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-079a330e-a469-4e30-833e-cb41156ab3e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:35.917935 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-079a330e-a469-4e30-833e-cb41156ab3e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:35.918350 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-079a330e-a469-4e30-833e-cb41156ab3e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:35.963135 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-310fe433-3b88-4dbc-8a83-780c11101745 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:35.971407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-310fe433-3b88-4dbc-8a83-780c11101745 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.159788 Aug 30 15:03:35.971976 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 992/1988] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:35 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:35.980432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-079a330e-a469-4e30-833e-cb41156ab3e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:35.989056 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-079a330e-a469-4e30-833e-cb41156ab3e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:35.990544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-079a330e-a469-4e30-833e-cb41156ab3e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:35.991725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-079a330e-a469-4e30-833e-cb41156ab3e8 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086647 Aug 30 15:03:35.992273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 997/1989] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:35 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:36.925396 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-006df237-5796-429d-b0a1-e53dd5a0d1f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:36.926010 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-006df237-5796-429d-b0a1-e53dd5a0d1f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:36.932466 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-006df237-5796-429d-b0a1-e53dd5a0d1f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:36.932946 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-006df237-5796-429d-b0a1-e53dd5a0d1f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:36.933378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-006df237-5796-429d-b0a1-e53dd5a0d1f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:36.934062 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-006df237-5796-429d-b0a1-e53dd5a0d1f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:36.934509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-006df237-5796-429d-b0a1-e53dd5a0d1f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:36.934938 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-006df237-5796-429d-b0a1-e53dd5a0d1f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:36.993578 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-afee7cb1-fb88-4061-a212-42c0cc67ab60 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:36.994188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-afee7cb1-fb88-4061-a212-42c0cc67ab60 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:37.000560 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afee7cb1-fb88-4061-a212-42c0cc67ab60 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:37.001522 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afee7cb1-fb88-4061-a212-42c0cc67ab60 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:37.001961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afee7cb1-fb88-4061-a212-42c0cc67ab60 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:37.002656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afee7cb1-fb88-4061-a212-42c0cc67ab60 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:37.003111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afee7cb1-fb88-4061-a212-42c0cc67ab60 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:37.003564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-afee7cb1-fb88-4061-a212-42c0cc67ab60 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:37.065016 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-006df237-5796-429d-b0a1-e53dd5a0d1f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:37.073550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-006df237-5796-429d-b0a1-e53dd5a0d1f0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152067 Aug 30 15:03:37.074108 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 993/1990] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:36 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:37.078803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cb03ba21-78fb-4e1a-ba70-0016ae37bf1c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:37.079435 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cb03ba21-78fb-4e1a-ba70-0016ae37bf1c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:37.085808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb03ba21-78fb-4e1a-ba70-0016ae37bf1c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:37.086048 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb03ba21-78fb-4e1a-ba70-0016ae37bf1c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:37.086477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb03ba21-78fb-4e1a-ba70-0016ae37bf1c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:37.087228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb03ba21-78fb-4e1a-ba70-0016ae37bf1c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:37.087625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb03ba21-78fb-4e1a-ba70-0016ae37bf1c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:37.088038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb03ba21-78fb-4e1a-ba70-0016ae37bf1c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:37.141402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-afee7cb1-fb88-4061-a212-42c0cc67ab60 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:37.150211 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-afee7cb1-fb88-4061-a212-42c0cc67ab60 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.160614 Aug 30 15:03:37.150385 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cb03ba21-78fb-4e1a-ba70-0016ae37bf1c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:37.150791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 998/1991] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:36 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:37.158990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cb03ba21-78fb-4e1a-ba70-0016ae37bf1c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:37.160442 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cb03ba21-78fb-4e1a-ba70-0016ae37bf1c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:37.162196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cb03ba21-78fb-4e1a-ba70-0016ae37bf1c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086562 Aug 30 15:03:37.162746 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 994/1992] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:37 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:38.095124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8cd5f5e3-ef46-4aec-88ae-27e068d5f4ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:38.095809 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8cd5f5e3-ef46-4aec-88ae-27e068d5f4ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:38.102875 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8cd5f5e3-ef46-4aec-88ae-27e068d5f4ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:38.103396 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8cd5f5e3-ef46-4aec-88ae-27e068d5f4ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:38.103838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8cd5f5e3-ef46-4aec-88ae-27e068d5f4ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:38.104537 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8cd5f5e3-ef46-4aec-88ae-27e068d5f4ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:38.104995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8cd5f5e3-ef46-4aec-88ae-27e068d5f4ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:38.105422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8cd5f5e3-ef46-4aec-88ae-27e068d5f4ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:38.171638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-46044849-681f-4869-b8dc-04d80a46842e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:38.172228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-46044849-681f-4869-b8dc-04d80a46842e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:38.178559 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46044849-681f-4869-b8dc-04d80a46842e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:38.179374 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46044849-681f-4869-b8dc-04d80a46842e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:38.179603 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46044849-681f-4869-b8dc-04d80a46842e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:38.180285 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46044849-681f-4869-b8dc-04d80a46842e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:38.180732 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46044849-681f-4869-b8dc-04d80a46842e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:38.181172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46044849-681f-4869-b8dc-04d80a46842e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:38.234508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8cd5f5e3-ef46-4aec-88ae-27e068d5f4ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:38.243268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8cd5f5e3-ef46-4aec-88ae-27e068d5f4ed tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152003 Aug 30 15:03:38.244735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 999/1993] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:38 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:38.248253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6f0134ed-ad02-40a7-836e-a0cfb32a59e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:38.249348 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6f0134ed-ad02-40a7-836e-a0cfb32a59e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:38.254367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f0134ed-ad02-40a7-836e-a0cfb32a59e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:38.254844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f0134ed-ad02-40a7-836e-a0cfb32a59e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:38.255306 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f0134ed-ad02-40a7-836e-a0cfb32a59e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:38.256523 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f0134ed-ad02-40a7-836e-a0cfb32a59e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:38.256956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f0134ed-ad02-40a7-836e-a0cfb32a59e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:38.257370 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f0134ed-ad02-40a7-836e-a0cfb32a59e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:38.315657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-46044849-681f-4869-b8dc-04d80a46842e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:38.316965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6f0134ed-ad02-40a7-836e-a0cfb32a59e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:38.324784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-46044849-681f-4869-b8dc-04d80a46842e tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156978 Aug 30 15:03:38.325366 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 995/1994] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:38 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:38.326202 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6f0134ed-ad02-40a7-836e-a0cfb32a59e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:38.327676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6f0134ed-ad02-40a7-836e-a0cfb32a59e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:38.328808 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6f0134ed-ad02-40a7-836e-a0cfb32a59e5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084052 Aug 30 15:03:38.329345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1000/1995] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:38 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:39.264208 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7cbf4e83-06d4-48b2-9b8a-91770f0fe1ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:39.264824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7cbf4e83-06d4-48b2-9b8a-91770f0fe1ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:39.271177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cbf4e83-06d4-48b2-9b8a-91770f0fe1ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:39.271680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cbf4e83-06d4-48b2-9b8a-91770f0fe1ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:39.272116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cbf4e83-06d4-48b2-9b8a-91770f0fe1ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:39.272801 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cbf4e83-06d4-48b2-9b8a-91770f0fe1ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:39.273254 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cbf4e83-06d4-48b2-9b8a-91770f0fe1ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:39.273679 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7cbf4e83-06d4-48b2-9b8a-91770f0fe1ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:39.346048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b3f8e794-5867-4e51-a88c-745c9759f8e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:39.346665 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b3f8e794-5867-4e51-a88c-745c9759f8e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:39.353709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3f8e794-5867-4e51-a88c-745c9759f8e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:39.354188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3f8e794-5867-4e51-a88c-745c9759f8e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:39.354625 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3f8e794-5867-4e51-a88c-745c9759f8e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:39.355423 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3f8e794-5867-4e51-a88c-745c9759f8e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:39.355875 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3f8e794-5867-4e51-a88c-745c9759f8e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:39.356293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b3f8e794-5867-4e51-a88c-745c9759f8e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:39.402379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7cbf4e83-06d4-48b2-9b8a-91770f0fe1ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:39.410722 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7cbf4e83-06d4-48b2-9b8a-91770f0fe1ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150390 Aug 30 15:03:39.411310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 996/1996] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:39 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:39.416583 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-15c3b601-46b5-4fcf-8632-e2b1261d75c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:39.417191 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-15c3b601-46b5-4fcf-8632-e2b1261d75c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:39.422941 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15c3b601-46b5-4fcf-8632-e2b1261d75c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:39.423461 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15c3b601-46b5-4fcf-8632-e2b1261d75c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:39.423900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15c3b601-46b5-4fcf-8632-e2b1261d75c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:39.424599 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15c3b601-46b5-4fcf-8632-e2b1261d75c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:39.425051 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15c3b601-46b5-4fcf-8632-e2b1261d75c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:39.425475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15c3b601-46b5-4fcf-8632-e2b1261d75c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:39.489066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-15c3b601-46b5-4fcf-8632-e2b1261d75c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:39.489343 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b3f8e794-5867-4e51-a88c-745c9759f8e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:39.497363 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b3f8e794-5867-4e51-a88c-745c9759f8e6 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.155288 Aug 30 15:03:39.498002 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1001/1997] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:39 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:39.498321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-15c3b601-46b5-4fcf-8632-e2b1261d75c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:39.499824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-15c3b601-46b5-4fcf-8632-e2b1261d75c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:39.500972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-15c3b601-46b5-4fcf-8632-e2b1261d75c6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087992 Aug 30 15:03:39.501522 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 997/1998] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:39 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:40.432601 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3b335dbc-1f8c-40c4-a906-b77925ff2c07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:40.433349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3b335dbc-1f8c-40c4-a906-b77925ff2c07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:40.439749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b335dbc-1f8c-40c4-a906-b77925ff2c07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:40.440225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b335dbc-1f8c-40c4-a906-b77925ff2c07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:40.440655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b335dbc-1f8c-40c4-a906-b77925ff2c07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:40.441336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b335dbc-1f8c-40c4-a906-b77925ff2c07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:40.441801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b335dbc-1f8c-40c4-a906-b77925ff2c07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:40.442206 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b335dbc-1f8c-40c4-a906-b77925ff2c07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:40.518035 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-aa476115-5423-44b2-bdbb-f0c97b637d22 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:40.519120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-aa476115-5423-44b2-bdbb-f0c97b637d22 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:40.525485 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa476115-5423-44b2-bdbb-f0c97b637d22 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:40.525972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa476115-5423-44b2-bdbb-f0c97b637d22 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:40.526422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa476115-5423-44b2-bdbb-f0c97b637d22 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:40.527109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa476115-5423-44b2-bdbb-f0c97b637d22 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:40.527589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa476115-5423-44b2-bdbb-f0c97b637d22 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:40.528014 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa476115-5423-44b2-bdbb-f0c97b637d22 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:40.570855 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3b335dbc-1f8c-40c4-a906-b77925ff2c07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:40.579343 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3b335dbc-1f8c-40c4-a906-b77925ff2c07 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151150 Aug 30 15:03:40.579914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1002/1999] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:40 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:40.584917 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ee9cf0f1-e048-487f-8fd3-094e7f1e82de tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:40.585525 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ee9cf0f1-e048-487f-8fd3-094e7f1e82de tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:40.591310 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee9cf0f1-e048-487f-8fd3-094e7f1e82de tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:40.591789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee9cf0f1-e048-487f-8fd3-094e7f1e82de tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:40.592220 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee9cf0f1-e048-487f-8fd3-094e7f1e82de tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:40.592911 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee9cf0f1-e048-487f-8fd3-094e7f1e82de tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:40.593352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee9cf0f1-e048-487f-8fd3-094e7f1e82de tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:40.593768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee9cf0f1-e048-487f-8fd3-094e7f1e82de tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:40.654317 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ee9cf0f1-e048-487f-8fd3-094e7f1e82de tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:40.662680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-aa476115-5423-44b2-bdbb-f0c97b637d22 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:40.663095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ee9cf0f1-e048-487f-8fd3-094e7f1e82de tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:40.664591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ee9cf0f1-e048-487f-8fd3-094e7f1e82de tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:40.665753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ee9cf0f1-e048-487f-8fd3-094e7f1e82de tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084797 Aug 30 15:03:40.666316 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1003/2000] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:40 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:40.671341 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-aa476115-5423-44b2-bdbb-f0c97b637d22 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.157265 Aug 30 15:03:40.671901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 998/2001] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:40 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:41.600214 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1aee4224-cf7a-442c-bc4b-c9d2d95fcef4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:41.600867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1aee4224-cf7a-442c-bc4b-c9d2d95fcef4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:41.607223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1aee4224-cf7a-442c-bc4b-c9d2d95fcef4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:41.607714 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1aee4224-cf7a-442c-bc4b-c9d2d95fcef4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:41.608149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1aee4224-cf7a-442c-bc4b-c9d2d95fcef4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:41.608869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1aee4224-cf7a-442c-bc4b-c9d2d95fcef4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:41.609326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1aee4224-cf7a-442c-bc4b-c9d2d95fcef4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:41.609749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1aee4224-cf7a-442c-bc4b-c9d2d95fcef4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:41.689201 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-11c65a94-02ce-4414-96ed-bbf4dd7ba2fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:41.689595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-11c65a94-02ce-4414-96ed-bbf4dd7ba2fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:41.696647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11c65a94-02ce-4414-96ed-bbf4dd7ba2fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:41.697382 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11c65a94-02ce-4414-96ed-bbf4dd7ba2fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:41.697812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11c65a94-02ce-4414-96ed-bbf4dd7ba2fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:41.698501 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11c65a94-02ce-4414-96ed-bbf4dd7ba2fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:41.698945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11c65a94-02ce-4414-96ed-bbf4dd7ba2fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:41.699388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11c65a94-02ce-4414-96ed-bbf4dd7ba2fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:41.741811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1aee4224-cf7a-442c-bc4b-c9d2d95fcef4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:41.750007 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1aee4224-cf7a-442c-bc4b-c9d2d95fcef4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.154296 Aug 30 15:03:41.750581 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1004/2002] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:41 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:41.754960 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6d8c49f1-5dd4-4b4f-bc20-185c34a1213f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:41.756306 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6d8c49f1-5dd4-4b4f-bc20-185c34a1213f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:41.762229 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d8c49f1-5dd4-4b4f-bc20-185c34a1213f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:41.762475 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d8c49f1-5dd4-4b4f-bc20-185c34a1213f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:41.762910 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d8c49f1-5dd4-4b4f-bc20-185c34a1213f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:41.763626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d8c49f1-5dd4-4b4f-bc20-185c34a1213f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:41.764081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d8c49f1-5dd4-4b4f-bc20-185c34a1213f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:41.764501 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6d8c49f1-5dd4-4b4f-bc20-185c34a1213f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:41.765119 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-11c65a94-02ce-4414-96ed-bbf4dd7ba2fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:41.774537 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-11c65a94-02ce-4414-96ed-bbf4dd7ba2fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:41.776011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-11c65a94-02ce-4414-96ed-bbf4dd7ba2fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:41.777155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-11c65a94-02ce-4414-96ed-bbf4dd7ba2fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.092545 Aug 30 15:03:41.777713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 999/2003] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:41 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:03:41.890312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6d8c49f1-5dd4-4b4f-bc20-185c34a1213f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:41.899130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6d8c49f1-5dd4-4b4f-bc20-185c34a1213f tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147592 Aug 30 15:03:41.899725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1005/2004] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:41 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:42.771934 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9f04e40b-3151-4dec-8137-1ee3c8b37adb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:42.772531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9f04e40b-3151-4dec-8137-1ee3c8b37adb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:42.779392 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f04e40b-3151-4dec-8137-1ee3c8b37adb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:42.779875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f04e40b-3151-4dec-8137-1ee3c8b37adb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:42.780307 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f04e40b-3151-4dec-8137-1ee3c8b37adb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:42.780991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f04e40b-3151-4dec-8137-1ee3c8b37adb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:42.781436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f04e40b-3151-4dec-8137-1ee3c8b37adb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:42.781851 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f04e40b-3151-4dec-8137-1ee3c8b37adb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:42.799480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d1e37226-f065-439d-9dcb-b53adb131ce5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:42.800098 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d1e37226-f065-439d-9dcb-b53adb131ce5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:42.806560 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1e37226-f065-439d-9dcb-b53adb131ce5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:42.807045 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1e37226-f065-439d-9dcb-b53adb131ce5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:42.807517 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1e37226-f065-439d-9dcb-b53adb131ce5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:42.808225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1e37226-f065-439d-9dcb-b53adb131ce5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:42.808678 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1e37226-f065-439d-9dcb-b53adb131ce5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:42.809147 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1e37226-f065-439d-9dcb-b53adb131ce5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:42.872546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d1e37226-f065-439d-9dcb-b53adb131ce5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:42.881192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d1e37226-f065-439d-9dcb-b53adb131ce5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:42.882656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d1e37226-f065-439d-9dcb-b53adb131ce5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:42.883839 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d1e37226-f065-439d-9dcb-b53adb131ce5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088372 Aug 30 15:03:42.884401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1006/2005] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:42 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:03:42.916831 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9f04e40b-3151-4dec-8137-1ee3c8b37adb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:42.919912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b75d9970-300f-4054-9537-6c7bc2518205 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:42.920536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b75d9970-300f-4054-9537-6c7bc2518205 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:42.925158 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9f04e40b-3151-4dec-8137-1ee3c8b37adb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.157599 Aug 30 15:03:42.925808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1000/2006] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:42 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:42.926561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b75d9970-300f-4054-9537-6c7bc2518205 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:42.927053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b75d9970-300f-4054-9537-6c7bc2518205 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:42.927564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b75d9970-300f-4054-9537-6c7bc2518205 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:42.928357 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b75d9970-300f-4054-9537-6c7bc2518205 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:42.928816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b75d9970-300f-4054-9537-6c7bc2518205 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:42.929241 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b75d9970-300f-4054-9537-6c7bc2518205 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:43.057011 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b75d9970-300f-4054-9537-6c7bc2518205 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:43.065115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b75d9970-300f-4054-9537-6c7bc2518205 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148975 Aug 30 15:03:43.065724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1007/2007] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:42 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:43.906954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-92deda71-2a64-449a-816b-8abf365ab244 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:43.907582 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-92deda71-2a64-449a-816b-8abf365ab244 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:43.914478 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92deda71-2a64-449a-816b-8abf365ab244 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:43.914947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92deda71-2a64-449a-816b-8abf365ab244 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:43.915405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92deda71-2a64-449a-816b-8abf365ab244 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:43.916079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92deda71-2a64-449a-816b-8abf365ab244 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:43.916517 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92deda71-2a64-449a-816b-8abf365ab244 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:43.916929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92deda71-2a64-449a-816b-8abf365ab244 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:43.946106 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2744cdec-393e-4ec3-adfe-bb3c0ea9fdda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:43.946817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2744cdec-393e-4ec3-adfe-bb3c0ea9fdda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:43.953737 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2744cdec-393e-4ec3-adfe-bb3c0ea9fdda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:43.954232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2744cdec-393e-4ec3-adfe-bb3c0ea9fdda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:43.954666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2744cdec-393e-4ec3-adfe-bb3c0ea9fdda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:43.955401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2744cdec-393e-4ec3-adfe-bb3c0ea9fdda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:43.955853 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2744cdec-393e-4ec3-adfe-bb3c0ea9fdda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:43.956270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2744cdec-393e-4ec3-adfe-bb3c0ea9fdda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:43.978958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-92deda71-2a64-449a-816b-8abf365ab244 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:43.987507 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-92deda71-2a64-449a-816b-8abf365ab244 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:43.988972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-92deda71-2a64-449a-816b-8abf365ab244 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:43.990696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-92deda71-2a64-449a-816b-8abf365ab244 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087670 Aug 30 15:03:43.991378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1001/2008] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:43 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:44.084318 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2744cdec-393e-4ec3-adfe-bb3c0ea9fdda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:44.086261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-52953b4d-c93f-4945-ab3e-22ce61da3dd1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:44.086878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-52953b4d-c93f-4945-ab3e-22ce61da3dd1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:44.092600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2744cdec-393e-4ec3-adfe-bb3c0ea9fdda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150630 Aug 30 15:03:44.092937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52953b4d-c93f-4945-ab3e-22ce61da3dd1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:44.093171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1008/2009] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:43 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:44.093425 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52953b4d-c93f-4945-ab3e-22ce61da3dd1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:44.093862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52953b4d-c93f-4945-ab3e-22ce61da3dd1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:44.094557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52953b4d-c93f-4945-ab3e-22ce61da3dd1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:44.095015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52953b4d-c93f-4945-ab3e-22ce61da3dd1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:44.095451 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52953b4d-c93f-4945-ab3e-22ce61da3dd1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:44.223739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-52953b4d-c93f-4945-ab3e-22ce61da3dd1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:44.232706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-52953b4d-c93f-4945-ab3e-22ce61da3dd1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150313 Aug 30 15:03:44.233272 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1002/2010] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:44 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:45.012476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5e4c6575-c973-4dad-85ca-78eb2b1632f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:45.013092 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5e4c6575-c973-4dad-85ca-78eb2b1632f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:45.019511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e4c6575-c973-4dad-85ca-78eb2b1632f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:45.019998 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e4c6575-c973-4dad-85ca-78eb2b1632f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:45.020435 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e4c6575-c973-4dad-85ca-78eb2b1632f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:45.021676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e4c6575-c973-4dad-85ca-78eb2b1632f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:45.022127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e4c6575-c973-4dad-85ca-78eb2b1632f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:45.022554 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e4c6575-c973-4dad-85ca-78eb2b1632f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:45.085600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5e4c6575-c973-4dad-85ca-78eb2b1632f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:45.094054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5e4c6575-c973-4dad-85ca-78eb2b1632f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:45.095518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5e4c6575-c973-4dad-85ca-78eb2b1632f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:45.096637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5e4c6575-c973-4dad-85ca-78eb2b1632f0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088119 Aug 30 15:03:45.097192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1009/2011] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:45 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:45.113655 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d716f040-1522-4db4-b117-aa2b88e720d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:45.114263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d716f040-1522-4db4-b117-aa2b88e720d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:45.121269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d716f040-1522-4db4-b117-aa2b88e720d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:45.121747 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d716f040-1522-4db4-b117-aa2b88e720d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:45.122189 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d716f040-1522-4db4-b117-aa2b88e720d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:45.122878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d716f040-1522-4db4-b117-aa2b88e720d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:45.123359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d716f040-1522-4db4-b117-aa2b88e720d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:45.123780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d716f040-1522-4db4-b117-aa2b88e720d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:45.254074 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a82f5d30-93b3-4af0-bfd3-cb760c1c57d4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:45.254783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a82f5d30-93b3-4af0-bfd3-cb760c1c57d4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:45.261760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a82f5d30-93b3-4af0-bfd3-cb760c1c57d4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:45.262248 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a82f5d30-93b3-4af0-bfd3-cb760c1c57d4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:45.262732 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a82f5d30-93b3-4af0-bfd3-cb760c1c57d4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:45.263407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a82f5d30-93b3-4af0-bfd3-cb760c1c57d4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:45.263862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a82f5d30-93b3-4af0-bfd3-cb760c1c57d4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:45.264288 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a82f5d30-93b3-4af0-bfd3-cb760c1c57d4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:45.336839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d716f040-1522-4db4-b117-aa2b88e720d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:45.345804 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d716f040-1522-4db4-b117-aa2b88e720d0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.235774 Aug 30 15:03:45.346229 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1003/2012] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:45 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:45.401354 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a82f5d30-93b3-4af0-bfd3-cb760c1c57d4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:45.409587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a82f5d30-93b3-4af0-bfd3-cb760c1c57d4 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.159381 Aug 30 15:03:45.410161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1010/2013] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:45 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:46.118896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6d6b11dc-2122-4c67-886f-3bfc5a02adab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:46.119516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6d6b11dc-2122-4c67-886f-3bfc5a02adab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:46.125821 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d6b11dc-2122-4c67-886f-3bfc5a02adab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:46.126293 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d6b11dc-2122-4c67-886f-3bfc5a02adab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:46.126717 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d6b11dc-2122-4c67-886f-3bfc5a02adab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:46.127425 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d6b11dc-2122-4c67-886f-3bfc5a02adab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:46.127874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d6b11dc-2122-4c67-886f-3bfc5a02adab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:46.128287 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d6b11dc-2122-4c67-886f-3bfc5a02adab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:46.190271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6d6b11dc-2122-4c67-886f-3bfc5a02adab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:46.193719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:46.200160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6d6b11dc-2122-4c67-886f-3bfc5a02adab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:46.201590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6d6b11dc-2122-4c67-886f-3bfc5a02adab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:46.202724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6d6b11dc-2122-4c67-886f-3bfc5a02adab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087831 Aug 30 15:03:46.203292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1004/2014] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:46 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:46.366545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5412b484-b980-4a76-be65-57246d1513d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:46.367193 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5412b484-b980-4a76-be65-57246d1513d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:46.373695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5412b484-b980-4a76-be65-57246d1513d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:46.374122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5412b484-b980-4a76-be65-57246d1513d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:46.374561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5412b484-b980-4a76-be65-57246d1513d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:46.375278 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5412b484-b980-4a76-be65-57246d1513d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:46.375744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5412b484-b980-4a76-be65-57246d1513d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:46.376171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5412b484-b980-4a76-be65-57246d1513d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:46.380060 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:46.431191 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2fd31f17-33a1-49fd-b6a8-d7735b42eaaa tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:46.431974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2fd31f17-33a1-49fd-b6a8-d7735b42eaaa tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:46.437969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fd31f17-33a1-49fd-b6a8-d7735b42eaaa tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:46.438449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fd31f17-33a1-49fd-b6a8-d7735b42eaaa tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:46.438889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fd31f17-33a1-49fd-b6a8-d7735b42eaaa tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:46.439605 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fd31f17-33a1-49fd-b6a8-d7735b42eaaa tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:46.440054 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fd31f17-33a1-49fd-b6a8-d7735b42eaaa tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:46.440474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2fd31f17-33a1-49fd-b6a8-d7735b42eaaa tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:46.505537 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5412b484-b980-4a76-be65-57246d1513d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:46.513660 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5412b484-b980-4a76-be65-57246d1513d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151608 Aug 30 15:03:46.514233 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1011/2015] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:46 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:46.569756 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2fd31f17-33a1-49fd-b6a8-d7735b42eaaa tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:46.578164 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2fd31f17-33a1-49fd-b6a8-d7735b42eaaa tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151386 Aug 30 15:03:46.578729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1005/2016] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:46 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:47.225532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-53a8246d-00f3-415d-ba20-72e0c3530a56 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:47.226137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-53a8246d-00f3-415d-ba20-72e0c3530a56 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:47.232030 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53a8246d-00f3-415d-ba20-72e0c3530a56 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:47.232505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53a8246d-00f3-415d-ba20-72e0c3530a56 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:47.232930 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53a8246d-00f3-415d-ba20-72e0c3530a56 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:47.233611 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53a8246d-00f3-415d-ba20-72e0c3530a56 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:47.234056 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53a8246d-00f3-415d-ba20-72e0c3530a56 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:47.234471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-53a8246d-00f3-415d-ba20-72e0c3530a56 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:47.300194 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-53a8246d-00f3-415d-ba20-72e0c3530a56 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:47.309289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-53a8246d-00f3-415d-ba20-72e0c3530a56 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:47.310739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-53a8246d-00f3-415d-ba20-72e0c3530a56 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:47.311920 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-53a8246d-00f3-415d-ba20-72e0c3530a56 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090721 Aug 30 15:03:47.312474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1012/2017] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:47 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:47.535159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fd26c849-ba48-4cbc-8f23-8d69b4a2ffda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:47.535743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fd26c849-ba48-4cbc-8f23-8d69b4a2ffda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:47.542195 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd26c849-ba48-4cbc-8f23-8d69b4a2ffda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:47.542676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd26c849-ba48-4cbc-8f23-8d69b4a2ffda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:47.543109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd26c849-ba48-4cbc-8f23-8d69b4a2ffda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:47.543823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd26c849-ba48-4cbc-8f23-8d69b4a2ffda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:47.544278 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd26c849-ba48-4cbc-8f23-8d69b4a2ffda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:47.544723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd26c849-ba48-4cbc-8f23-8d69b4a2ffda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:47.599995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2bae4507-2781-4373-a7a2-cfb95daea535 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:47.600616 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2bae4507-2781-4373-a7a2-cfb95daea535 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:47.606939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bae4507-2781-4373-a7a2-cfb95daea535 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:47.607473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bae4507-2781-4373-a7a2-cfb95daea535 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:47.607914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bae4507-2781-4373-a7a2-cfb95daea535 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:47.609175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bae4507-2781-4373-a7a2-cfb95daea535 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:47.609175 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bae4507-2781-4373-a7a2-cfb95daea535 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:47.609465 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2bae4507-2781-4373-a7a2-cfb95daea535 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:47.679655 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fd26c849-ba48-4cbc-8f23-8d69b4a2ffda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:47.687816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fd26c849-ba48-4cbc-8f23-8d69b4a2ffda tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.156596 Aug 30 15:03:47.688606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1006/2018] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:47 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:47.737260 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2bae4507-2781-4373-a7a2-cfb95daea535 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:47.745958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2bae4507-2781-4373-a7a2-cfb95daea535 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149873 Aug 30 15:03:47.746759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1013/2019] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:47 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:48.334407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-76d4305e-a9f9-4266-bad3-e43f077d1a5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:48.335010 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-76d4305e-a9f9-4266-bad3-e43f077d1a5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:48.340886 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76d4305e-a9f9-4266-bad3-e43f077d1a5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:48.341357 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76d4305e-a9f9-4266-bad3-e43f077d1a5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:48.341782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76d4305e-a9f9-4266-bad3-e43f077d1a5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:48.342452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76d4305e-a9f9-4266-bad3-e43f077d1a5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:48.342891 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76d4305e-a9f9-4266-bad3-e43f077d1a5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:48.343330 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-76d4305e-a9f9-4266-bad3-e43f077d1a5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:48.405482 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-76d4305e-a9f9-4266-bad3-e43f077d1a5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:48.414232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-76d4305e-a9f9-4266-bad3-e43f077d1a5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:48.415691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-76d4305e-a9f9-4266-bad3-e43f077d1a5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:48.416844 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-76d4305e-a9f9-4266-bad3-e43f077d1a5d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086854 Aug 30 15:03:48.417399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1007/2020] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:48 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:48.709827 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b989388a-9239-4901-b743-efd31e1e23ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:48.710454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b989388a-9239-4901-b743-efd31e1e23ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:48.716892 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b989388a-9239-4901-b743-efd31e1e23ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:48.717375 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b989388a-9239-4901-b743-efd31e1e23ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:48.717820 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b989388a-9239-4901-b743-efd31e1e23ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:48.718513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b989388a-9239-4901-b743-efd31e1e23ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:48.718967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b989388a-9239-4901-b743-efd31e1e23ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:48.719419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b989388a-9239-4901-b743-efd31e1e23ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:48.766707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5c1c44f6-e8b4-4df2-a85f-068244331b50 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:48.767355 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5c1c44f6-e8b4-4df2-a85f-068244331b50 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:48.773687 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c1c44f6-e8b4-4df2-a85f-068244331b50 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:48.774165 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c1c44f6-e8b4-4df2-a85f-068244331b50 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:48.774595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c1c44f6-e8b4-4df2-a85f-068244331b50 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:48.775310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c1c44f6-e8b4-4df2-a85f-068244331b50 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:48.775764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c1c44f6-e8b4-4df2-a85f-068244331b50 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:48.776188 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c1c44f6-e8b4-4df2-a85f-068244331b50 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:48.848311 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b989388a-9239-4901-b743-efd31e1e23ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:48.856735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b989388a-9239-4901-b743-efd31e1e23ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151485 Aug 30 15:03:48.857458 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1014/2021] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:48 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:48.904139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5c1c44f6-e8b4-4df2-a85f-068244331b50 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:48.912323 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5c1c44f6-e8b4-4df2-a85f-068244331b50 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149367 Aug 30 15:03:48.912889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1008/2022] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:48 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:49.438927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-37912922-df0f-4a2c-bd1a-86183c4f1f02 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:49.439570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-37912922-df0f-4a2c-bd1a-86183c4f1f02 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:49.446055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-37912922-df0f-4a2c-bd1a-86183c4f1f02 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:49.446642 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-37912922-df0f-4a2c-bd1a-86183c4f1f02 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:49.447083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-37912922-df0f-4a2c-bd1a-86183c4f1f02 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:49.448083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-37912922-df0f-4a2c-bd1a-86183c4f1f02 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:49.448542 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-37912922-df0f-4a2c-bd1a-86183c4f1f02 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:49.448967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-37912922-df0f-4a2c-bd1a-86183c4f1f02 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:49.513401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-37912922-df0f-4a2c-bd1a-86183c4f1f02 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:49.522748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-37912922-df0f-4a2c-bd1a-86183c4f1f02 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:49.524243 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-37912922-df0f-4a2c-bd1a-86183c4f1f02 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:49.525427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-37912922-df0f-4a2c-bd1a-86183c4f1f02 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090424 Aug 30 15:03:49.525985 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1015/2023] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:49 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:49.878041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-64684cd7-2f36-414a-96d3-3f18e72cbd86 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:49.878663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-64684cd7-2f36-414a-96d3-3f18e72cbd86 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:49.885464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64684cd7-2f36-414a-96d3-3f18e72cbd86 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:49.885939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64684cd7-2f36-414a-96d3-3f18e72cbd86 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:49.886368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64684cd7-2f36-414a-96d3-3f18e72cbd86 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:49.887047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64684cd7-2f36-414a-96d3-3f18e72cbd86 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:49.887515 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64684cd7-2f36-414a-96d3-3f18e72cbd86 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:49.887933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64684cd7-2f36-414a-96d3-3f18e72cbd86 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:49.933140 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7d5e328b-9362-4153-addf-50caaaddb1a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:49.933730 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7d5e328b-9362-4153-addf-50caaaddb1a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:49.939756 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7d5e328b-9362-4153-addf-50caaaddb1a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:49.940234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7d5e328b-9362-4153-addf-50caaaddb1a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:49.940691 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7d5e328b-9362-4153-addf-50caaaddb1a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:49.941375 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7d5e328b-9362-4153-addf-50caaaddb1a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:49.941845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7d5e328b-9362-4153-addf-50caaaddb1a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:49.942282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7d5e328b-9362-4153-addf-50caaaddb1a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:50.019312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-64684cd7-2f36-414a-96d3-3f18e72cbd86 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:50.028258 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-64684cd7-2f36-414a-96d3-3f18e72cbd86 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.154090 Aug 30 15:03:50.028842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1009/2024] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:49 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:50.070741 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7d5e328b-9362-4153-addf-50caaaddb1a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:50.079016 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7d5e328b-9362-4153-addf-50caaaddb1a7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149917 Aug 30 15:03:50.079617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1016/2025] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:49 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:50.548193 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a0e62672-5b7c-4a42-a8f7-66fce67c527f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:50.548726 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a0e62672-5b7c-4a42-a8f7-66fce67c527f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:50.555193 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0e62672-5b7c-4a42-a8f7-66fce67c527f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:50.555691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0e62672-5b7c-4a42-a8f7-66fce67c527f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:50.556115 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0e62672-5b7c-4a42-a8f7-66fce67c527f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:50.556787 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0e62672-5b7c-4a42-a8f7-66fce67c527f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:50.557227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0e62672-5b7c-4a42-a8f7-66fce67c527f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:50.557639 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a0e62672-5b7c-4a42-a8f7-66fce67c527f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:50.618140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a0e62672-5b7c-4a42-a8f7-66fce67c527f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:50.626588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a0e62672-5b7c-4a42-a8f7-66fce67c527f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:50.628041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a0e62672-5b7c-4a42-a8f7-66fce67c527f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:50.629170 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a0e62672-5b7c-4a42-a8f7-66fce67c527f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084987 Aug 30 15:03:50.629722 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1010/2026] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:50 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:51.048827 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9f043030-365a-4632-acde-0c1036bbb5c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:51.049440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9f043030-365a-4632-acde-0c1036bbb5c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:51.055865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9f043030-365a-4632-acde-0c1036bbb5c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:51.056351 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9f043030-365a-4632-acde-0c1036bbb5c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:51.056787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9f043030-365a-4632-acde-0c1036bbb5c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:51.057503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9f043030-365a-4632-acde-0c1036bbb5c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:51.057956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9f043030-365a-4632-acde-0c1036bbb5c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:51.058377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9f043030-365a-4632-acde-0c1036bbb5c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:51.101374 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9962bba8-97fd-45e4-9dd3-0167ab9a43ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:51.101991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9962bba8-97fd-45e4-9dd3-0167ab9a43ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:51.107842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9962bba8-97fd-45e4-9dd3-0167ab9a43ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:51.108324 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9962bba8-97fd-45e4-9dd3-0167ab9a43ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:51.108756 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9962bba8-97fd-45e4-9dd3-0167ab9a43ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:51.109450 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9962bba8-97fd-45e4-9dd3-0167ab9a43ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:51.109900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9962bba8-97fd-45e4-9dd3-0167ab9a43ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:51.110329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9962bba8-97fd-45e4-9dd3-0167ab9a43ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:51.185931 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9f043030-365a-4632-acde-0c1036bbb5c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:51.194450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9f043030-365a-4632-acde-0c1036bbb5c3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149448 Aug 30 15:03:51.195036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1017/2027] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:51 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:51.240312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9962bba8-97fd-45e4-9dd3-0167ab9a43ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:51.248423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9962bba8-97fd-45e4-9dd3-0167ab9a43ca tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152024 Aug 30 15:03:51.249019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1011/2028] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:51 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:51.651688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-556083cf-4771-4feb-829b-9ecffddffd79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:51.652227 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-556083cf-4771-4feb-829b-9ecffddffd79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:51.658247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-556083cf-4771-4feb-829b-9ecffddffd79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:51.658722 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-556083cf-4771-4feb-829b-9ecffddffd79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:51.659157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-556083cf-4771-4feb-829b-9ecffddffd79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:51.659880 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-556083cf-4771-4feb-829b-9ecffddffd79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:51.660330 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-556083cf-4771-4feb-829b-9ecffddffd79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:51.660745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-556083cf-4771-4feb-829b-9ecffddffd79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:51.723833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-556083cf-4771-4feb-829b-9ecffddffd79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:51.732385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-556083cf-4771-4feb-829b-9ecffddffd79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:51.733820 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-556083cf-4771-4feb-829b-9ecffddffd79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:51.734949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-556083cf-4771-4feb-829b-9ecffddffd79 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087279 Aug 30 15:03:51.735542 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1018/2029] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:51 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:52.215739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ee4d73ce-8dc0-4ebe-99b1-694b73915bd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:52.216348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ee4d73ce-8dc0-4ebe-99b1-694b73915bd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:52.222710 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee4d73ce-8dc0-4ebe-99b1-694b73915bd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:52.223190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee4d73ce-8dc0-4ebe-99b1-694b73915bd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:52.223642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee4d73ce-8dc0-4ebe-99b1-694b73915bd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:52.224329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee4d73ce-8dc0-4ebe-99b1-694b73915bd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:52.225665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee4d73ce-8dc0-4ebe-99b1-694b73915bd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:52.226122 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ee4d73ce-8dc0-4ebe-99b1-694b73915bd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:52.268248 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1167e486-48c9-4ef2-98e6-4479c8af47c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:52.268976 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1167e486-48c9-4ef2-98e6-4479c8af47c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:52.275839 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1167e486-48c9-4ef2-98e6-4479c8af47c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:52.276322 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1167e486-48c9-4ef2-98e6-4479c8af47c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:52.276751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1167e486-48c9-4ef2-98e6-4479c8af47c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:52.277447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1167e486-48c9-4ef2-98e6-4479c8af47c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:52.277896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1167e486-48c9-4ef2-98e6-4479c8af47c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:52.278318 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1167e486-48c9-4ef2-98e6-4479c8af47c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:52.357385 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ee4d73ce-8dc0-4ebe-99b1-694b73915bd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:52.370271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ee4d73ce-8dc0-4ebe-99b1-694b73915bd8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.158455 Aug 30 15:03:52.370858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1012/2030] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:52 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:52.410113 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1167e486-48c9-4ef2-98e6-4479c8af47c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:52.419119 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1167e486-48c9-4ef2-98e6-4479c8af47c7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.154700 Aug 30 15:03:52.419750 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1019/2031] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:52 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:52.757889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cb0db74b-f800-4b7f-bf50-3117be7c2a3c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:52.758524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cb0db74b-f800-4b7f-bf50-3117be7c2a3c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:52.764407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb0db74b-f800-4b7f-bf50-3117be7c2a3c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:52.764878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb0db74b-f800-4b7f-bf50-3117be7c2a3c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:52.765313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb0db74b-f800-4b7f-bf50-3117be7c2a3c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:52.765988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb0db74b-f800-4b7f-bf50-3117be7c2a3c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:52.766429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb0db74b-f800-4b7f-bf50-3117be7c2a3c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:52.766845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb0db74b-f800-4b7f-bf50-3117be7c2a3c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:52.826874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cb0db74b-f800-4b7f-bf50-3117be7c2a3c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:52.836191 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cb0db74b-f800-4b7f-bf50-3117be7c2a3c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:52.837854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cb0db74b-f800-4b7f-bf50-3117be7c2a3c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:52.839007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cb0db74b-f800-4b7f-bf50-3117be7c2a3c tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085213 Aug 30 15:03:52.839598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1013/2032] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:52 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:53.390731 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-db6fd10d-a23f-4328-bfb7-7f8306949d28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:53.391395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-db6fd10d-a23f-4328-bfb7-7f8306949d28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:53.398659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db6fd10d-a23f-4328-bfb7-7f8306949d28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:53.399139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db6fd10d-a23f-4328-bfb7-7f8306949d28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:53.399596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db6fd10d-a23f-4328-bfb7-7f8306949d28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:53.400287 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db6fd10d-a23f-4328-bfb7-7f8306949d28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:53.400736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db6fd10d-a23f-4328-bfb7-7f8306949d28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:53.401152 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-db6fd10d-a23f-4328-bfb7-7f8306949d28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:53.440592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e12e65e5-288c-428f-946b-b577b8553956 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:53.441178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e12e65e5-288c-428f-946b-b577b8553956 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:53.448386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e12e65e5-288c-428f-946b-b577b8553956 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:53.448872 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e12e65e5-288c-428f-946b-b577b8553956 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:53.449304 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e12e65e5-288c-428f-946b-b577b8553956 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:53.450060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e12e65e5-288c-428f-946b-b577b8553956 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:53.450509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e12e65e5-288c-428f-946b-b577b8553956 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:53.450931 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e12e65e5-288c-428f-946b-b577b8553956 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:53.532729 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-db6fd10d-a23f-4328-bfb7-7f8306949d28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:53.542004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-db6fd10d-a23f-4328-bfb7-7f8306949d28 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.155104 Aug 30 15:03:53.542583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1020/2033] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:53 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:53.584587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e12e65e5-288c-428f-946b-b577b8553956 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:53.592851 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e12e65e5-288c-428f-946b-b577b8553956 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156020 Aug 30 15:03:53.593416 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1014/2034] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:53 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:53.862071 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-008e338f-790c-4c85-8601-9399231d70d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:53.862719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-008e338f-790c-4c85-8601-9399231d70d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:53.864560 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=80 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:53.870478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-008e338f-790c-4c85-8601-9399231d70d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:53.870954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-008e338f-790c-4c85-8601-9399231d70d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:53.871433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-008e338f-790c-4c85-8601-9399231d70d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:53.872129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-008e338f-790c-4c85-8601-9399231d70d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:53.872578 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-008e338f-790c-4c85-8601-9399231d70d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:53.872997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-008e338f-790c-4c85-8601-9399231d70d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:53.935654 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-008e338f-790c-4c85-8601-9399231d70d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:53.944558 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-008e338f-790c-4c85-8601-9399231d70d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:53.946030 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-008e338f-790c-4c85-8601-9399231d70d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:53.947440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-008e338f-790c-4c85-8601-9399231d70d7 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089275 Aug 30 15:03:53.947997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1021/2035] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:53 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:54.561846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7c9c6910-f94f-4fdd-87bd-606f533db47c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:54.562471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7c9c6910-f94f-4fdd-87bd-606f533db47c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:54.564852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=78 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:54.570760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c9c6910-f94f-4fdd-87bd-606f533db47c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:54.571260 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c9c6910-f94f-4fdd-87bd-606f533db47c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:54.571699 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c9c6910-f94f-4fdd-87bd-606f533db47c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:54.572647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c9c6910-f94f-4fdd-87bd-606f533db47c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:54.573095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c9c6910-f94f-4fdd-87bd-606f533db47c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:54.573526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c9c6910-f94f-4fdd-87bd-606f533db47c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:54.614286 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e42eaf67-30f0-4c41-b520-144cbbf929f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:54.614971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e42eaf67-30f0-4c41-b520-144cbbf929f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:54.621543 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e42eaf67-30f0-4c41-b520-144cbbf929f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:54.622035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e42eaf67-30f0-4c41-b520-144cbbf929f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:54.622471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e42eaf67-30f0-4c41-b520-144cbbf929f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:54.623173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e42eaf67-30f0-4c41-b520-144cbbf929f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:54.623649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e42eaf67-30f0-4c41-b520-144cbbf929f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:54.624073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e42eaf67-30f0-4c41-b520-144cbbf929f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:54.702730 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7c9c6910-f94f-4fdd-87bd-606f533db47c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:54.711187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7c9c6910-f94f-4fdd-87bd-606f533db47c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153179 Aug 30 15:03:54.711780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1015/2036] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:54 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:54.754282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e42eaf67-30f0-4c41-b520-144cbbf929f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:54.762443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e42eaf67-30f0-4c41-b520-144cbbf929f2 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151961 Aug 30 15:03:54.763047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1022/2037] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:54 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:54.969967 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6a802323-658c-485b-ac75-70b137c8c8b9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:54.970599 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6a802323-658c-485b-ac75-70b137c8c8b9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:54.977260 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a802323-658c-485b-ac75-70b137c8c8b9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:54.977735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a802323-658c-485b-ac75-70b137c8c8b9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:54.978167 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a802323-658c-485b-ac75-70b137c8c8b9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:54.978866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a802323-658c-485b-ac75-70b137c8c8b9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:54.979328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a802323-658c-485b-ac75-70b137c8c8b9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:54.979753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a802323-658c-485b-ac75-70b137c8c8b9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:55.041554 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6a802323-658c-485b-ac75-70b137c8c8b9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:55.050193 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6a802323-658c-485b-ac75-70b137c8c8b9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:55.051657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6a802323-658c-485b-ac75-70b137c8c8b9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:55.052923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6a802323-658c-485b-ac75-70b137c8c8b9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086796 Aug 30 15:03:55.053485 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1016/2038] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:54 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:55.732431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-342d1b31-1ed9-4d67-b565-a13c79444377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:55.733079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-342d1b31-1ed9-4d67-b565-a13c79444377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:55.739476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-342d1b31-1ed9-4d67-b565-a13c79444377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:55.740506 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-342d1b31-1ed9-4d67-b565-a13c79444377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:55.741146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-342d1b31-1ed9-4d67-b565-a13c79444377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:55.741878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-342d1b31-1ed9-4d67-b565-a13c79444377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:55.742339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-342d1b31-1ed9-4d67-b565-a13c79444377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:55.742765 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-342d1b31-1ed9-4d67-b565-a13c79444377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:55.782979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-389b8308-b1b0-46cc-a99e-686fb0d93471 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:55.783600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-389b8308-b1b0-46cc-a99e-686fb0d93471 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:55.790016 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-389b8308-b1b0-46cc-a99e-686fb0d93471 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:55.790493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-389b8308-b1b0-46cc-a99e-686fb0d93471 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:55.790918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-389b8308-b1b0-46cc-a99e-686fb0d93471 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:55.791638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-389b8308-b1b0-46cc-a99e-686fb0d93471 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:55.792090 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-389b8308-b1b0-46cc-a99e-686fb0d93471 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:55.792504 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-389b8308-b1b0-46cc-a99e-686fb0d93471 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:55.878489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-342d1b31-1ed9-4d67-b565-a13c79444377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:55.886924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-342d1b31-1ed9-4d67-b565-a13c79444377 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.158455 Aug 30 15:03:55.887844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1023/2039] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:55 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:55.925841 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-389b8308-b1b0-46cc-a99e-686fb0d93471 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:55.934676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-389b8308-b1b0-46cc-a99e-686fb0d93471 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.155525 Aug 30 15:03:55.935266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1017/2040] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:55 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:56.075292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-201dd106-7a71-435f-93a8-14946a71b2f6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:56.075906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-201dd106-7a71-435f-93a8-14946a71b2f6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:56.081818 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-201dd106-7a71-435f-93a8-14946a71b2f6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:56.082304 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-201dd106-7a71-435f-93a8-14946a71b2f6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:56.082744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-201dd106-7a71-435f-93a8-14946a71b2f6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:56.083463 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-201dd106-7a71-435f-93a8-14946a71b2f6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:56.084150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-201dd106-7a71-435f-93a8-14946a71b2f6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:56.084588 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-201dd106-7a71-435f-93a8-14946a71b2f6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:56.148083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-201dd106-7a71-435f-93a8-14946a71b2f6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:56.156533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-201dd106-7a71-435f-93a8-14946a71b2f6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:56.157995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-201dd106-7a71-435f-93a8-14946a71b2f6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:56.159141 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-201dd106-7a71-435f-93a8-14946a71b2f6 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088090 Aug 30 15:03:56.159737 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1024/2041] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:56 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:56.907521 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-849cfc54-3ddb-42c5-bf58-8f0b3418d503 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:56.908119 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-849cfc54-3ddb-42c5-bf58-8f0b3418d503 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:56.915264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-849cfc54-3ddb-42c5-bf58-8f0b3418d503 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:56.915917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-849cfc54-3ddb-42c5-bf58-8f0b3418d503 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:56.916370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-849cfc54-3ddb-42c5-bf58-8f0b3418d503 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:56.917064 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-849cfc54-3ddb-42c5-bf58-8f0b3418d503 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:56.917514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-849cfc54-3ddb-42c5-bf58-8f0b3418d503 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:56.917936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-849cfc54-3ddb-42c5-bf58-8f0b3418d503 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:56.955811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-753d1fec-d35c-4ad6-83bf-3362a334351d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:56.956426 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-753d1fec-d35c-4ad6-83bf-3362a334351d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:56.963769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-753d1fec-d35c-4ad6-83bf-3362a334351d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:56.964261 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-753d1fec-d35c-4ad6-83bf-3362a334351d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:56.964699 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-753d1fec-d35c-4ad6-83bf-3362a334351d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:56.965404 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-753d1fec-d35c-4ad6-83bf-3362a334351d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:56.965861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-753d1fec-d35c-4ad6-83bf-3362a334351d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:56.966288 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-753d1fec-d35c-4ad6-83bf-3362a334351d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:57.045030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-849cfc54-3ddb-42c5-bf58-8f0b3418d503 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:57.053162 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-849cfc54-3ddb-42c5-bf58-8f0b3418d503 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149534 Aug 30 15:03:57.054016 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1018/2042] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:56 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:57.094497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-753d1fec-d35c-4ad6-83bf-3362a334351d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:57.103479 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-753d1fec-d35c-4ad6-83bf-3362a334351d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.151446 Aug 30 15:03:57.104046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1025/2043] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:56 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:57.182161 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b09c79d1-5a2d-4cfb-bcae-af1e577644d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:57.182696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b09c79d1-5a2d-4cfb-bcae-af1e577644d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:57.188599 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b09c79d1-5a2d-4cfb-bcae-af1e577644d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:57.189078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b09c79d1-5a2d-4cfb-bcae-af1e577644d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:57.189510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b09c79d1-5a2d-4cfb-bcae-af1e577644d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:57.190190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b09c79d1-5a2d-4cfb-bcae-af1e577644d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:57.190637 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b09c79d1-5a2d-4cfb-bcae-af1e577644d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:57.191056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b09c79d1-5a2d-4cfb-bcae-af1e577644d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:57.251095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b09c79d1-5a2d-4cfb-bcae-af1e577644d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:57.259811 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b09c79d1-5a2d-4cfb-bcae-af1e577644d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:57.261259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b09c79d1-5a2d-4cfb-bcae-af1e577644d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:57.262398 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b09c79d1-5a2d-4cfb-bcae-af1e577644d3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.084486 Aug 30 15:03:57.262961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1019/2044] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:57 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:58.074266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cc7b4431-c5a3-4669-8f5f-526f2fe1f64b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:58.074875 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cc7b4431-c5a3-4669-8f5f-526f2fe1f64b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:58.081874 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc7b4431-c5a3-4669-8f5f-526f2fe1f64b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:58.082350 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc7b4431-c5a3-4669-8f5f-526f2fe1f64b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:58.082780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc7b4431-c5a3-4669-8f5f-526f2fe1f64b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:58.083489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc7b4431-c5a3-4669-8f5f-526f2fe1f64b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:58.083937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc7b4431-c5a3-4669-8f5f-526f2fe1f64b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:58.084856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc7b4431-c5a3-4669-8f5f-526f2fe1f64b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:58.125717 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6ba0aab5-ed08-403d-ac91-fa3139369524 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:58.126457 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6ba0aab5-ed08-403d-ac91-fa3139369524 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:58.133567 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ba0aab5-ed08-403d-ac91-fa3139369524 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:58.134126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ba0aab5-ed08-403d-ac91-fa3139369524 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:58.134630 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ba0aab5-ed08-403d-ac91-fa3139369524 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:58.135453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ba0aab5-ed08-403d-ac91-fa3139369524 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:58.135997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ba0aab5-ed08-403d-ac91-fa3139369524 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:58.136491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6ba0aab5-ed08-403d-ac91-fa3139369524 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:58.211824 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cc7b4431-c5a3-4669-8f5f-526f2fe1f64b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:58.221291 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cc7b4431-c5a3-4669-8f5f-526f2fe1f64b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151043 Aug 30 15:03:58.221945 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1026/2045] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:58 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:58.269932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6ba0aab5-ed08-403d-ac91-fa3139369524 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:58.278772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6ba0aab5-ed08-403d-ac91-fa3139369524 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156886 Aug 30 15:03:58.279363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1020/2046] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:58 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:58.285253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-08d7c406-3393-49e7-8798-da56a7299080 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:58.285862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-08d7c406-3393-49e7-8798-da56a7299080 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:58.292091 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08d7c406-3393-49e7-8798-da56a7299080 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:58.292564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08d7c406-3393-49e7-8798-da56a7299080 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:58.292990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08d7c406-3393-49e7-8798-da56a7299080 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:58.293691 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08d7c406-3393-49e7-8798-da56a7299080 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:58.294140 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08d7c406-3393-49e7-8798-da56a7299080 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:58.294554 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08d7c406-3393-49e7-8798-da56a7299080 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:58.357946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-08d7c406-3393-49e7-8798-da56a7299080 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:58.361288 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:58.367674 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-08d7c406-3393-49e7-8798-da56a7299080 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:58.369108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-08d7c406-3393-49e7-8798-da56a7299080 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:58.370234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-08d7c406-3393-49e7-8798-da56a7299080 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088797 Aug 30 15:03:58.370787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1027/2047] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:58 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:03:59.241608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c5232229-aec4-48f8-88f7-b13a703d3ac7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:59.242247 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c5232229-aec4-48f8-88f7-b13a703d3ac7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:59.248640 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c5232229-aec4-48f8-88f7-b13a703d3ac7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:59.249118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c5232229-aec4-48f8-88f7-b13a703d3ac7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:59.249554 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c5232229-aec4-48f8-88f7-b13a703d3ac7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:59.250233 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c5232229-aec4-48f8-88f7-b13a703d3ac7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:59.250682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c5232229-aec4-48f8-88f7-b13a703d3ac7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:59.251120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c5232229-aec4-48f8-88f7-b13a703d3ac7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:59.269121 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:03:59.299505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bd59018c-653a-42ac-b6fc-502a6c95476b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:59.300145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bd59018c-653a-42ac-b6fc-502a6c95476b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:59.307191 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd59018c-653a-42ac-b6fc-502a6c95476b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:59.307704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd59018c-653a-42ac-b6fc-502a6c95476b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:59.308145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd59018c-653a-42ac-b6fc-502a6c95476b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:59.308841 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd59018c-653a-42ac-b6fc-502a6c95476b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:59.309298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd59018c-653a-42ac-b6fc-502a6c95476b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:59.309724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd59018c-653a-42ac-b6fc-502a6c95476b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:59.382858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c5232229-aec4-48f8-88f7-b13a703d3ac7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:59.391051 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c5232229-aec4-48f8-88f7-b13a703d3ac7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153772 Aug 30 15:03:59.391647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1021/2048] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:59 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:03:59.396135 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c98ed04d-2d3e-4d44-a2c2-3d779961926d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:03:59.396761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c98ed04d-2d3e-4d44-a2c2-3d779961926d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:03:59.403108 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c98ed04d-2d3e-4d44-a2c2-3d779961926d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:59.403612 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c98ed04d-2d3e-4d44-a2c2-3d779961926d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:59.404041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c98ed04d-2d3e-4d44-a2c2-3d779961926d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:59.404729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c98ed04d-2d3e-4d44-a2c2-3d779961926d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:03:59.405171 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c98ed04d-2d3e-4d44-a2c2-3d779961926d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:03:59.405586 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c98ed04d-2d3e-4d44-a2c2-3d779961926d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:03:59.439503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bd59018c-653a-42ac-b6fc-502a6c95476b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:59.448674 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bd59018c-653a-42ac-b6fc-502a6c95476b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.153034 Aug 30 15:03:59.449255 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1028/2049] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:03:59 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:03:59.469557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c98ed04d-2d3e-4d44-a2c2-3d779961926d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:59.479040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c98ed04d-2d3e-4d44-a2c2-3d779961926d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:59.480500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c98ed04d-2d3e-4d44-a2c2-3d779961926d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:03:59.481636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c98ed04d-2d3e-4d44-a2c2-3d779961926d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089093 Aug 30 15:03:59.482186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1022/2050] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:03:59 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:00.413638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-04151bbc-f6c7-4a05-97e2-c9b75df0638b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:00.414244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-04151bbc-f6c7-4a05-97e2-c9b75df0638b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:00.420704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04151bbc-f6c7-4a05-97e2-c9b75df0638b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:00.421178 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04151bbc-f6c7-4a05-97e2-c9b75df0638b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:00.421606 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04151bbc-f6c7-4a05-97e2-c9b75df0638b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:00.422286 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04151bbc-f6c7-4a05-97e2-c9b75df0638b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:00.422732 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04151bbc-f6c7-4a05-97e2-c9b75df0638b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:00.423146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-04151bbc-f6c7-4a05-97e2-c9b75df0638b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:00.469695 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b95268d2-4bb4-434b-ade2-cf8387f6f056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:00.470229 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b95268d2-4bb4-434b-ade2-cf8387f6f056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:00.477344 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b95268d2-4bb4-434b-ade2-cf8387f6f056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:00.477818 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b95268d2-4bb4-434b-ade2-cf8387f6f056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:00.478255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b95268d2-4bb4-434b-ade2-cf8387f6f056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:00.478949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b95268d2-4bb4-434b-ade2-cf8387f6f056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:00.479456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b95268d2-4bb4-434b-ade2-cf8387f6f056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:00.479872 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b95268d2-4bb4-434b-ade2-cf8387f6f056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:00.551708 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-04151bbc-f6c7-4a05-97e2-c9b75df0638b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:00.560786 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-04151bbc-f6c7-4a05-97e2-c9b75df0638b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151566 Aug 30 15:04:00.561363 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1029/2051] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:00 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:00.565951 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-63edd299-b3e2-411b-badc-445619005e8f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:00.566564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-63edd299-b3e2-411b-badc-445619005e8f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:00.572872 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63edd299-b3e2-411b-badc-445619005e8f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:00.573297 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63edd299-b3e2-411b-badc-445619005e8f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:00.573726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63edd299-b3e2-411b-badc-445619005e8f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:00.574423 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63edd299-b3e2-411b-badc-445619005e8f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:00.574877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63edd299-b3e2-411b-badc-445619005e8f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:00.575323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-63edd299-b3e2-411b-badc-445619005e8f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:00.616444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b95268d2-4bb4-434b-ade2-cf8387f6f056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:00.624661 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b95268d2-4bb4-434b-ade2-cf8387f6f056 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.158934 Aug 30 15:04:00.625236 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1023/2052] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:00 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:04:00.638993 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-63edd299-b3e2-411b-badc-445619005e8f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:00.647876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-63edd299-b3e2-411b-badc-445619005e8f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:00.649370 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-63edd299-b3e2-411b-badc-445619005e8f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:00.650504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-63edd299-b3e2-411b-badc-445619005e8f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088228 Aug 30 15:04:00.651052 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1030/2053] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:00 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:01.582045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-881b0450-a9c2-4818-9bce-fb56b5f7720c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:01.582655 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-881b0450-a9c2-4818-9bce-fb56b5f7720c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:01.589046 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-881b0450-a9c2-4818-9bce-fb56b5f7720c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:01.589516 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-881b0450-a9c2-4818-9bce-fb56b5f7720c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:01.589947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-881b0450-a9c2-4818-9bce-fb56b5f7720c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:01.590623 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-881b0450-a9c2-4818-9bce-fb56b5f7720c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:01.591066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-881b0450-a9c2-4818-9bce-fb56b5f7720c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:01.591513 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-881b0450-a9c2-4818-9bce-fb56b5f7720c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:01.645521 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-788ef9b3-3d63-4fdd-a574-350d620630e9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:01.646139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-788ef9b3-3d63-4fdd-a574-350d620630e9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:01.652868 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-788ef9b3-3d63-4fdd-a574-350d620630e9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:01.653351 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-788ef9b3-3d63-4fdd-a574-350d620630e9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:01.653784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-788ef9b3-3d63-4fdd-a574-350d620630e9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:01.654482 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-788ef9b3-3d63-4fdd-a574-350d620630e9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:01.654988 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-788ef9b3-3d63-4fdd-a574-350d620630e9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:01.655440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-788ef9b3-3d63-4fdd-a574-350d620630e9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:01.722850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-881b0450-a9c2-4818-9bce-fb56b5f7720c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:01.731161 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-881b0450-a9c2-4818-9bce-fb56b5f7720c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152936 Aug 30 15:04:01.731763 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1024/2054] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:01 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:01.736253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9f523b2d-811f-4fe8-86d9-1b1b8510fd97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:01.736854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9f523b2d-811f-4fe8-86d9-1b1b8510fd97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:01.743445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f523b2d-811f-4fe8-86d9-1b1b8510fd97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:01.743927 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f523b2d-811f-4fe8-86d9-1b1b8510fd97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:01.744372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f523b2d-811f-4fe8-86d9-1b1b8510fd97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:01.745115 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f523b2d-811f-4fe8-86d9-1b1b8510fd97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:01.745616 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f523b2d-811f-4fe8-86d9-1b1b8510fd97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:01.746043 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f523b2d-811f-4fe8-86d9-1b1b8510fd97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:01.786881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-788ef9b3-3d63-4fdd-a574-350d620630e9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:01.797063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-788ef9b3-3d63-4fdd-a574-350d620630e9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.154780 Aug 30 15:04:01.798122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1031/2055] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:01 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:04:01.811858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9f523b2d-811f-4fe8-86d9-1b1b8510fd97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:01.821239 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9f523b2d-811f-4fe8-86d9-1b1b8510fd97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:01.822948 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9f523b2d-811f-4fe8-86d9-1b1b8510fd97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:01.824126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9f523b2d-811f-4fe8-86d9-1b1b8510fd97 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091411 Aug 30 15:04:01.824678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1025/2056] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:01 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:02.751926 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-260a6de3-b4fc-44ab-b684-6395dbf24a46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:02.752540 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-260a6de3-b4fc-44ab-b684-6395dbf24a46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:02.759732 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-260a6de3-b4fc-44ab-b684-6395dbf24a46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:02.760211 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-260a6de3-b4fc-44ab-b684-6395dbf24a46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:02.760646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-260a6de3-b4fc-44ab-b684-6395dbf24a46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:02.761333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-260a6de3-b4fc-44ab-b684-6395dbf24a46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:02.761782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-260a6de3-b4fc-44ab-b684-6395dbf24a46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:02.762203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-260a6de3-b4fc-44ab-b684-6395dbf24a46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:02.819052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-336c5aa7-e14e-47f4-8544-cc3255caacbd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:02.819923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-336c5aa7-e14e-47f4-8544-cc3255caacbd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:02.826647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-336c5aa7-e14e-47f4-8544-cc3255caacbd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:02.827123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-336c5aa7-e14e-47f4-8544-cc3255caacbd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:02.827592 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-336c5aa7-e14e-47f4-8544-cc3255caacbd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:02.828274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-336c5aa7-e14e-47f4-8544-cc3255caacbd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:02.828715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-336c5aa7-e14e-47f4-8544-cc3255caacbd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:02.829155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-336c5aa7-e14e-47f4-8544-cc3255caacbd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:02.891216 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-260a6de3-b4fc-44ab-b684-6395dbf24a46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:02.900079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-260a6de3-b4fc-44ab-b684-6395dbf24a46 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152032 Aug 30 15:04:02.900657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1032/2057] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:02 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:02.905128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cfdd3b5e-c296-4cd2-a02a-e8e6f52e26fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:02.905731 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cfdd3b5e-c296-4cd2-a02a-e8e6f52e26fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:02.911531 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cfdd3b5e-c296-4cd2-a02a-e8e6f52e26fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:02.912015 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cfdd3b5e-c296-4cd2-a02a-e8e6f52e26fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:02.912562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cfdd3b5e-c296-4cd2-a02a-e8e6f52e26fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:02.913409 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cfdd3b5e-c296-4cd2-a02a-e8e6f52e26fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:02.913858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cfdd3b5e-c296-4cd2-a02a-e8e6f52e26fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:02.914290 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cfdd3b5e-c296-4cd2-a02a-e8e6f52e26fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:02.962485 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-336c5aa7-e14e-47f4-8544-cc3255caacbd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:02.970897 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-336c5aa7-e14e-47f4-8544-cc3255caacbd tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.156149 Aug 30 15:04:02.971602 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1026/2058] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:02 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:04:02.981032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cfdd3b5e-c296-4cd2-a02a-e8e6f52e26fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:02.989555 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cfdd3b5e-c296-4cd2-a02a-e8e6f52e26fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:02.991706 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cfdd3b5e-c296-4cd2-a02a-e8e6f52e26fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:02.992844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cfdd3b5e-c296-4cd2-a02a-e8e6f52e26fc tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091273 Aug 30 15:04:02.993580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1033/2059] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:02 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:03.921352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-90ee7c72-7756-4119-90a1-32b49f04ed4b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:03.921986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-90ee7c72-7756-4119-90a1-32b49f04ed4b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:03.928370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90ee7c72-7756-4119-90a1-32b49f04ed4b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:03.928838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90ee7c72-7756-4119-90a1-32b49f04ed4b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:03.929262 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90ee7c72-7756-4119-90a1-32b49f04ed4b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:03.929962 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90ee7c72-7756-4119-90a1-32b49f04ed4b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:03.930383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90ee7c72-7756-4119-90a1-32b49f04ed4b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:03.930798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90ee7c72-7756-4119-90a1-32b49f04ed4b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:03.992024 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-874ce93f-3304-4520-b443-8c8b76668e97 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:03.992619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-874ce93f-3304-4520-b443-8c8b76668e97 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:03.999979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-874ce93f-3304-4520-b443-8c8b76668e97 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:04.000462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-874ce93f-3304-4520-b443-8c8b76668e97 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:04.000897 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-874ce93f-3304-4520-b443-8c8b76668e97 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:04.001613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-874ce93f-3304-4520-b443-8c8b76668e97 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:04.002064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-874ce93f-3304-4520-b443-8c8b76668e97 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:04.002486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-874ce93f-3304-4520-b443-8c8b76668e97 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:04.071452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-90ee7c72-7756-4119-90a1-32b49f04ed4b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:04.080601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-90ee7c72-7756-4119-90a1-32b49f04ed4b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.163006 Aug 30 15:04:04.091708 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1027/2060] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:03 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:04.101728 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ff519946-3869-4cbb-a7f2-9bc3c54d8c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:04.102353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ff519946-3869-4cbb-a7f2-9bc3c54d8c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:04.108816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff519946-3869-4cbb-a7f2-9bc3c54d8c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:04.109305 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff519946-3869-4cbb-a7f2-9bc3c54d8c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:04.109745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff519946-3869-4cbb-a7f2-9bc3c54d8c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:04.110456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff519946-3869-4cbb-a7f2-9bc3c54d8c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:04.110911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff519946-3869-4cbb-a7f2-9bc3c54d8c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:04.111368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff519946-3869-4cbb-a7f2-9bc3c54d8c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:04.182578 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ff519946-3869-4cbb-a7f2-9bc3c54d8c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:04.192267 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ff519946-3869-4cbb-a7f2-9bc3c54d8c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:04.194561 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ff519946-3869-4cbb-a7f2-9bc3c54d8c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:04.195990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ff519946-3869-4cbb-a7f2-9bc3c54d8c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.103368 Aug 30 15:04:04.196557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1028/2061] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:04 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:04.358481 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-874ce93f-3304-4520-b443-8c8b76668e97 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:04.366569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-874ce93f-3304-4520-b443-8c8b76668e97 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.378386 Aug 30 15:04:04.367141 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1034/2062] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:03 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:05.104473 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b5acb534-1589-4bc9-92db-1dcb54ef2de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:05.105066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b5acb534-1589-4bc9-92db-1dcb54ef2de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:05.111534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5acb534-1589-4bc9-92db-1dcb54ef2de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:05.112014 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5acb534-1589-4bc9-92db-1dcb54ef2de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:05.112447 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5acb534-1589-4bc9-92db-1dcb54ef2de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:05.113136 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5acb534-1589-4bc9-92db-1dcb54ef2de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:05.113587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5acb534-1589-4bc9-92db-1dcb54ef2de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:05.114009 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5acb534-1589-4bc9-92db-1dcb54ef2de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:05.219241 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a060abd8-13c8-47ed-918f-24af0e7c1271 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:05.220006 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a060abd8-13c8-47ed-918f-24af0e7c1271 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:05.227280 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a060abd8-13c8-47ed-918f-24af0e7c1271 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:05.227771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a060abd8-13c8-47ed-918f-24af0e7c1271 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:05.228211 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a060abd8-13c8-47ed-918f-24af0e7c1271 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:05.228914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a060abd8-13c8-47ed-918f-24af0e7c1271 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:05.229369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a060abd8-13c8-47ed-918f-24af0e7c1271 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:05.229790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a060abd8-13c8-47ed-918f-24af0e7c1271 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:05.245079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b5acb534-1589-4bc9-92db-1dcb54ef2de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:05.253085 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b5acb534-1589-4bc9-92db-1dcb54ef2de2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152441 Aug 30 15:04:05.253652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1029/2063] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:05 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:05.291751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a060abd8-13c8-47ed-918f-24af0e7c1271 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:05.300199 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a060abd8-13c8-47ed-918f-24af0e7c1271 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:05.301656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a060abd8-13c8-47ed-918f-24af0e7c1271 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:05.302794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a060abd8-13c8-47ed-918f-24af0e7c1271 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087634 Aug 30 15:04:05.303384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1035/2064] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:05 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:04:05.386328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cad0835f-eb82-4354-a259-41c2455ac7d9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:05.386871 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cad0835f-eb82-4354-a259-41c2455ac7d9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:05.392760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cad0835f-eb82-4354-a259-41c2455ac7d9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:05.393248 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cad0835f-eb82-4354-a259-41c2455ac7d9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:05.393683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cad0835f-eb82-4354-a259-41c2455ac7d9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:05.394361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cad0835f-eb82-4354-a259-41c2455ac7d9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:05.394808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cad0835f-eb82-4354-a259-41c2455ac7d9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:05.395245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cad0835f-eb82-4354-a259-41c2455ac7d9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:05.522758 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cad0835f-eb82-4354-a259-41c2455ac7d9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:05.532314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cad0835f-eb82-4354-a259-41c2455ac7d9 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149767 Aug 30 15:04:05.537132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1030/2065] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:05 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:06.273809 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ae4482d3-4cf0-4c1b-bef5-7872b056d9bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:06.274425 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ae4482d3-4cf0-4c1b-bef5-7872b056d9bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:06.280927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae4482d3-4cf0-4c1b-bef5-7872b056d9bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:06.281403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae4482d3-4cf0-4c1b-bef5-7872b056d9bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:06.281834 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae4482d3-4cf0-4c1b-bef5-7872b056d9bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:06.282557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae4482d3-4cf0-4c1b-bef5-7872b056d9bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:06.283008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae4482d3-4cf0-4c1b-bef5-7872b056d9bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:06.283466 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ae4482d3-4cf0-4c1b-bef5-7872b056d9bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:06.326095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-00c342b9-0abf-4cda-93c7-597f8f9206ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:06.326718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-00c342b9-0abf-4cda-93c7-597f8f9206ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:06.333071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00c342b9-0abf-4cda-93c7-597f8f9206ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:06.333551 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00c342b9-0abf-4cda-93c7-597f8f9206ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:06.333994 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00c342b9-0abf-4cda-93c7-597f8f9206ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:06.334737 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00c342b9-0abf-4cda-93c7-597f8f9206ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:06.335188 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00c342b9-0abf-4cda-93c7-597f8f9206ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:06.335638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00c342b9-0abf-4cda-93c7-597f8f9206ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:06.399912 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-00c342b9-0abf-4cda-93c7-597f8f9206ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:06.408519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-00c342b9-0abf-4cda-93c7-597f8f9206ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:06.410028 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-00c342b9-0abf-4cda-93c7-597f8f9206ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:06.411248 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-00c342b9-0abf-4cda-93c7-597f8f9206ed tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089362 Aug 30 15:04:06.411797 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1031/2066] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:06 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:06.413975 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ae4482d3-4cf0-4c1b-bef5-7872b056d9bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:06.422135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ae4482d3-4cf0-4c1b-bef5-7872b056d9bf tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152230 Aug 30 15:04:06.422698 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1036/2067] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:06 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:06.554880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-219d8e9a-9226-4ee3-8f98-da0746b08b03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:06.555534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-219d8e9a-9226-4ee3-8f98-da0746b08b03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:06.561398 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-219d8e9a-9226-4ee3-8f98-da0746b08b03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:06.561878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-219d8e9a-9226-4ee3-8f98-da0746b08b03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:06.562307 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-219d8e9a-9226-4ee3-8f98-da0746b08b03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:06.563016 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-219d8e9a-9226-4ee3-8f98-da0746b08b03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:06.563487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-219d8e9a-9226-4ee3-8f98-da0746b08b03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:06.563908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-219d8e9a-9226-4ee3-8f98-da0746b08b03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:06.689496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-219d8e9a-9226-4ee3-8f98-da0746b08b03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:06.698213 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-219d8e9a-9226-4ee3-8f98-da0746b08b03 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148284 Aug 30 15:04:06.698775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1032/2068] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:06 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:07.434118 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-62656ab0-8e18-4375-8f92-43962740736d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:07.434730 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-62656ab0-8e18-4375-8f92-43962740736d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:07.441178 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62656ab0-8e18-4375-8f92-43962740736d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:07.441658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62656ab0-8e18-4375-8f92-43962740736d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:07.442095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62656ab0-8e18-4375-8f92-43962740736d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:07.442787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62656ab0-8e18-4375-8f92-43962740736d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:07.442910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-df8d536f-012a-458c-88fd-a0eff235895f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:07.443338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62656ab0-8e18-4375-8f92-43962740736d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:07.443979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-df8d536f-012a-458c-88fd-a0eff235895f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:07.444177 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-62656ab0-8e18-4375-8f92-43962740736d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:07.450747 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df8d536f-012a-458c-88fd-a0eff235895f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:07.451237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df8d536f-012a-458c-88fd-a0eff235895f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:07.451678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df8d536f-012a-458c-88fd-a0eff235895f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:07.452356 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df8d536f-012a-458c-88fd-a0eff235895f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:07.452803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df8d536f-012a-458c-88fd-a0eff235895f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:07.453223 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df8d536f-012a-458c-88fd-a0eff235895f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:07.506647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-62656ab0-8e18-4375-8f92-43962740736d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:07.515349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-62656ab0-8e18-4375-8f92-43962740736d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:07.516798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-62656ab0-8e18-4375-8f92-43962740736d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:07.517930 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-62656ab0-8e18-4375-8f92-43962740736d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087834 Aug 30 15:04:07.518483 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1037/2069] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:07 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:07.581869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-df8d536f-012a-458c-88fd-a0eff235895f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:07.590106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-df8d536f-012a-458c-88fd-a0eff235895f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151095 Aug 30 15:04:07.590667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1033/2070] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:07 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:04:07.719677 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8b839f95-9b85-497a-a86d-18a867eea209 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:07.720290 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8b839f95-9b85-497a-a86d-18a867eea209 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:07.726240 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b839f95-9b85-497a-a86d-18a867eea209 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:07.726711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b839f95-9b85-497a-a86d-18a867eea209 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:07.727137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b839f95-9b85-497a-a86d-18a867eea209 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:07.727852 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b839f95-9b85-497a-a86d-18a867eea209 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:07.728298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b839f95-9b85-497a-a86d-18a867eea209 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:07.728714 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8b839f95-9b85-497a-a86d-18a867eea209 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:07.855265 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8b839f95-9b85-497a-a86d-18a867eea209 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:07.863323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8b839f95-9b85-497a-a86d-18a867eea209 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147494 Aug 30 15:04:07.863887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1038/2071] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:07 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:08.541100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ab17c613-d44e-4f96-bbff-078bc757a4fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:08.541648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ab17c613-d44e-4f96-bbff-078bc757a4fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:08.548037 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab17c613-d44e-4f96-bbff-078bc757a4fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:08.548511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab17c613-d44e-4f96-bbff-078bc757a4fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:08.548944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab17c613-d44e-4f96-bbff-078bc757a4fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:08.549653 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab17c613-d44e-4f96-bbff-078bc757a4fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:08.550099 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab17c613-d44e-4f96-bbff-078bc757a4fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:08.550520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ab17c613-d44e-4f96-bbff-078bc757a4fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:08.609857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-57e284ee-d482-4f3f-877e-b2ab64a66bae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:08.610461 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-57e284ee-d482-4f3f-877e-b2ab64a66bae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:08.614874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ab17c613-d44e-4f96-bbff-078bc757a4fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:08.616800 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-57e284ee-d482-4f3f-877e-b2ab64a66bae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:08.617243 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-57e284ee-d482-4f3f-877e-b2ab64a66bae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:08.617681 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-57e284ee-d482-4f3f-877e-b2ab64a66bae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:08.618383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-57e284ee-d482-4f3f-877e-b2ab64a66bae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:08.618836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-57e284ee-d482-4f3f-877e-b2ab64a66bae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:08.619284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-57e284ee-d482-4f3f-877e-b2ab64a66bae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:08.623512 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ab17c613-d44e-4f96-bbff-078bc757a4fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:08.624965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ab17c613-d44e-4f96-bbff-078bc757a4fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:08.626108 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ab17c613-d44e-4f96-bbff-078bc757a4fe tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089585 Aug 30 15:04:08.626910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1034/2072] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:08 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:08.748039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-57e284ee-d482-4f3f-877e-b2ab64a66bae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:08.756544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-57e284ee-d482-4f3f-877e-b2ab64a66bae tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150039 Aug 30 15:04:08.757146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1039/2073] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:08 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:04:08.885779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f58ae372-46a5-4ccb-baad-2b6e2fc7794d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:08.886383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f58ae372-46a5-4ccb-baad-2b6e2fc7794d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:08.892291 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f58ae372-46a5-4ccb-baad-2b6e2fc7794d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:08.892760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f58ae372-46a5-4ccb-baad-2b6e2fc7794d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:08.893186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f58ae372-46a5-4ccb-baad-2b6e2fc7794d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:08.893854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f58ae372-46a5-4ccb-baad-2b6e2fc7794d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:08.894299 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f58ae372-46a5-4ccb-baad-2b6e2fc7794d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:08.894709 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f58ae372-46a5-4ccb-baad-2b6e2fc7794d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:09.021038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f58ae372-46a5-4ccb-baad-2b6e2fc7794d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:09.029147 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f58ae372-46a5-4ccb-baad-2b6e2fc7794d tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147211 Aug 30 15:04:09.029704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1035/2074] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:08 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:09.649447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a5f9f6af-305d-4d18-adc9-3984d0708ad0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:09.650055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a5f9f6af-305d-4d18-adc9-3984d0708ad0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:09.656611 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5f9f6af-305d-4d18-adc9-3984d0708ad0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:09.657087 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5f9f6af-305d-4d18-adc9-3984d0708ad0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:09.657521 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5f9f6af-305d-4d18-adc9-3984d0708ad0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:09.658206 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5f9f6af-305d-4d18-adc9-3984d0708ad0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:09.658657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5f9f6af-305d-4d18-adc9-3984d0708ad0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:09.659096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a5f9f6af-305d-4d18-adc9-3984d0708ad0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:09.719638 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a5f9f6af-305d-4d18-adc9-3984d0708ad0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:09.728791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a5f9f6af-305d-4d18-adc9-3984d0708ad0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:09.730238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a5f9f6af-305d-4d18-adc9-3984d0708ad0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:09.731462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a5f9f6af-305d-4d18-adc9-3984d0708ad0 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086203 Aug 30 15:04:09.732035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1040/2075] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:09 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:09.777982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-46d566c8-d24d-48d9-bdd5-f8391e955470 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:09.778586 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-46d566c8-d24d-48d9-bdd5-f8391e955470 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:09.784886 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46d566c8-d24d-48d9-bdd5-f8391e955470 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:09.785365 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46d566c8-d24d-48d9-bdd5-f8391e955470 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:09.785791 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46d566c8-d24d-48d9-bdd5-f8391e955470 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:09.786471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46d566c8-d24d-48d9-bdd5-f8391e955470 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:09.786910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46d566c8-d24d-48d9-bdd5-f8391e955470 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:09.787948 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-46d566c8-d24d-48d9-bdd5-f8391e955470 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:09.917385 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-46d566c8-d24d-48d9-bdd5-f8391e955470 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:09.925361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-46d566c8-d24d-48d9-bdd5-f8391e955470 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151194 Aug 30 15:04:09.925917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1036/2076] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:09 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:10.049911 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9c218fcf-90f8-42b0-8bc8-6001ad6bd45a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:10.050556 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9c218fcf-90f8-42b0-8bc8-6001ad6bd45a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:10.056774 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c218fcf-90f8-42b0-8bc8-6001ad6bd45a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:10.057252 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c218fcf-90f8-42b0-8bc8-6001ad6bd45a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:10.057683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c218fcf-90f8-42b0-8bc8-6001ad6bd45a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:10.058368 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c218fcf-90f8-42b0-8bc8-6001ad6bd45a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:10.058821 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c218fcf-90f8-42b0-8bc8-6001ad6bd45a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:10.059269 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9c218fcf-90f8-42b0-8bc8-6001ad6bd45a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:10.184442 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9c218fcf-90f8-42b0-8bc8-6001ad6bd45a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:10.192496 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9c218fcf-90f8-42b0-8bc8-6001ad6bd45a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.146484 Aug 30 15:04:10.193066 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1041/2077] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:10 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:10.755715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3411f062-b757-4e84-935c-1ab37a730d78 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:10.756742 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3411f062-b757-4e84-935c-1ab37a730d78 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:10.762601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3411f062-b757-4e84-935c-1ab37a730d78 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:10.763080 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3411f062-b757-4e84-935c-1ab37a730d78 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:10.763541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3411f062-b757-4e84-935c-1ab37a730d78 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:10.764219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3411f062-b757-4e84-935c-1ab37a730d78 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:10.764696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3411f062-b757-4e84-935c-1ab37a730d78 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:10.765116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3411f062-b757-4e84-935c-1ab37a730d78 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:10.830531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3411f062-b757-4e84-935c-1ab37a730d78 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:10.839569 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3411f062-b757-4e84-935c-1ab37a730d78 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:10.840997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3411f062-b757-4e84-935c-1ab37a730d78 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:10.842134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3411f062-b757-4e84-935c-1ab37a730d78 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090346 Aug 30 15:04:10.842683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1037/2078] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:10 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:10.945471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-44d0ec08-81f4-4a98-ab2f-f76b5ab7e673 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:10.946176 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-44d0ec08-81f4-4a98-ab2f-f76b5ab7e673 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:10.952887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44d0ec08-81f4-4a98-ab2f-f76b5ab7e673 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:10.953372 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44d0ec08-81f4-4a98-ab2f-f76b5ab7e673 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:10.953807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44d0ec08-81f4-4a98-ab2f-f76b5ab7e673 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:10.954494 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44d0ec08-81f4-4a98-ab2f-f76b5ab7e673 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:10.954948 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44d0ec08-81f4-4a98-ab2f-f76b5ab7e673 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:10.955403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-44d0ec08-81f4-4a98-ab2f-f76b5ab7e673 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:11.085624 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-44d0ec08-81f4-4a98-ab2f-f76b5ab7e673 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:11.093726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-44d0ec08-81f4-4a98-ab2f-f76b5ab7e673 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152671 Aug 30 15:04:11.094293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1042/2079] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:10 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:11.214514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bfcdbea9-8f8a-4291-98f0-0d628e6d2b9b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:11.215120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bfcdbea9-8f8a-4291-98f0-0d628e6d2b9b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:11.221032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bfcdbea9-8f8a-4291-98f0-0d628e6d2b9b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:11.221514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bfcdbea9-8f8a-4291-98f0-0d628e6d2b9b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:11.221943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bfcdbea9-8f8a-4291-98f0-0d628e6d2b9b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:11.222626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bfcdbea9-8f8a-4291-98f0-0d628e6d2b9b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:11.223073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bfcdbea9-8f8a-4291-98f0-0d628e6d2b9b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:11.223514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bfcdbea9-8f8a-4291-98f0-0d628e6d2b9b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:11.227588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:11.350843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bfcdbea9-8f8a-4291-98f0-0d628e6d2b9b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:11.359110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bfcdbea9-8f8a-4291-98f0-0d628e6d2b9b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.148403 Aug 30 15:04:11.359707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1038/2080] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:11 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:04:11.865048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5a374842-96db-4719-87f7-c7c8d4361a65 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:11.866251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5a374842-96db-4719-87f7-c7c8d4361a65 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:11.872304 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a374842-96db-4719-87f7-c7c8d4361a65 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:11.872785 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a374842-96db-4719-87f7-c7c8d4361a65 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:11.873219 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a374842-96db-4719-87f7-c7c8d4361a65 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:11.873913 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a374842-96db-4719-87f7-c7c8d4361a65 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:11.874365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a374842-96db-4719-87f7-c7c8d4361a65 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:11.874786 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a374842-96db-4719-87f7-c7c8d4361a65 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:11.935142 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5a374842-96db-4719-87f7-c7c8d4361a65 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:11.943755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5a374842-96db-4719-87f7-c7c8d4361a65 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:11.945185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5a374842-96db-4719-87f7-c7c8d4361a65 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:11.946316 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5a374842-96db-4719-87f7-c7c8d4361a65 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085214 Aug 30 15:04:11.946867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1043/2081] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:11 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:12.113739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-45042e03-3d9b-4177-aa1e-7ed8ccf1366c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:12.114349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-45042e03-3d9b-4177-aa1e-7ed8ccf1366c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:12.120811 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45042e03-3d9b-4177-aa1e-7ed8ccf1366c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:12.121229 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45042e03-3d9b-4177-aa1e-7ed8ccf1366c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:12.121662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45042e03-3d9b-4177-aa1e-7ed8ccf1366c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:12.122335 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45042e03-3d9b-4177-aa1e-7ed8ccf1366c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:12.122788 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45042e03-3d9b-4177-aa1e-7ed8ccf1366c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:12.123223 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-45042e03-3d9b-4177-aa1e-7ed8ccf1366c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:12.250484 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-45042e03-3d9b-4177-aa1e-7ed8ccf1366c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:12.258597 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-45042e03-3d9b-4177-aa1e-7ed8ccf1366c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148703 Aug 30 15:04:12.259164 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1039/2082] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:12 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:12.380300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-356d73ed-1dd0-4d1a-9f5e-69f88f7f8926 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:12.381387 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-356d73ed-1dd0-4d1a-9f5e-69f88f7f8926 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:12.387903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-356d73ed-1dd0-4d1a-9f5e-69f88f7f8926 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:12.388392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-356d73ed-1dd0-4d1a-9f5e-69f88f7f8926 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:12.388828 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-356d73ed-1dd0-4d1a-9f5e-69f88f7f8926 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:12.389528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-356d73ed-1dd0-4d1a-9f5e-69f88f7f8926 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:12.389982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-356d73ed-1dd0-4d1a-9f5e-69f88f7f8926 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:12.390408 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-356d73ed-1dd0-4d1a-9f5e-69f88f7f8926 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:12.408759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:12.520199 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-356d73ed-1dd0-4d1a-9f5e-69f88f7f8926 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:12.528922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-356d73ed-1dd0-4d1a-9f5e-69f88f7f8926 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.152609 Aug 30 15:04:12.529494 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1044/2083] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:12 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:12.969350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ad9418ac-5e0c-4b5a-b6e3-0aad8c573349 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:12.969965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ad9418ac-5e0c-4b5a-b6e3-0aad8c573349 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:12.976262 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad9418ac-5e0c-4b5a-b6e3-0aad8c573349 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:12.976746 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad9418ac-5e0c-4b5a-b6e3-0aad8c573349 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:12.977183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad9418ac-5e0c-4b5a-b6e3-0aad8c573349 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:12.977871 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad9418ac-5e0c-4b5a-b6e3-0aad8c573349 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:12.978322 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad9418ac-5e0c-4b5a-b6e3-0aad8c573349 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:12.978749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ad9418ac-5e0c-4b5a-b6e3-0aad8c573349 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:13.042855 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ad9418ac-5e0c-4b5a-b6e3-0aad8c573349 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:13.051394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ad9418ac-5e0c-4b5a-b6e3-0aad8c573349 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:13.053410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ad9418ac-5e0c-4b5a-b6e3-0aad8c573349 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:13.054465 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ad9418ac-5e0c-4b5a-b6e3-0aad8c573349 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089103 Aug 30 15:04:13.055028 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1040/2084] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:12 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:13.279586 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3ac8d6aa-730a-4959-b3ad-13ed620bf209 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:13.280236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3ac8d6aa-730a-4959-b3ad-13ed620bf209 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:13.286263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ac8d6aa-730a-4959-b3ad-13ed620bf209 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:13.286748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ac8d6aa-730a-4959-b3ad-13ed620bf209 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:13.287819 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ac8d6aa-730a-4959-b3ad-13ed620bf209 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:13.288667 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ac8d6aa-730a-4959-b3ad-13ed620bf209 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:13.289125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ac8d6aa-730a-4959-b3ad-13ed620bf209 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:13.289551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3ac8d6aa-730a-4959-b3ad-13ed620bf209 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:13.417139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3ac8d6aa-730a-4959-b3ad-13ed620bf209 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:13.425255 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3ac8d6aa-730a-4959-b3ad-13ed620bf209 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149510 Aug 30 15:04:13.425813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1045/2085] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:13 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:13.549460 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-71f55337-2bda-4b8a-adfc-522039965e5b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:13.550075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-71f55337-2bda-4b8a-adfc-522039965e5b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:13.556447 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71f55337-2bda-4b8a-adfc-522039965e5b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:13.556927 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71f55337-2bda-4b8a-adfc-522039965e5b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:13.557362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71f55337-2bda-4b8a-adfc-522039965e5b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:13.558046 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71f55337-2bda-4b8a-adfc-522039965e5b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:13.558494 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71f55337-2bda-4b8a-adfc-522039965e5b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:13.558914 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71f55337-2bda-4b8a-adfc-522039965e5b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:13.684936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-71f55337-2bda-4b8a-adfc-522039965e5b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:13.693012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-71f55337-2bda-4b8a-adfc-522039965e5b tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.147443 Aug 30 15:04:13.693643 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1041/2086] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:13 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:14.077826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-07acfff2-7dc6-4787-bb40-8c974ca6f1db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:14.078441 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-07acfff2-7dc6-4787-bb40-8c974ca6f1db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:14.084993 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-07acfff2-7dc6-4787-bb40-8c974ca6f1db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:14.085472 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-07acfff2-7dc6-4787-bb40-8c974ca6f1db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:14.085906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-07acfff2-7dc6-4787-bb40-8c974ca6f1db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:14.086588 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-07acfff2-7dc6-4787-bb40-8c974ca6f1db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:14.087039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-07acfff2-7dc6-4787-bb40-8c974ca6f1db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:14.087489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-07acfff2-7dc6-4787-bb40-8c974ca6f1db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:14.148876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-07acfff2-7dc6-4787-bb40-8c974ca6f1db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:14.157245 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-07acfff2-7dc6-4787-bb40-8c974ca6f1db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:14.158692 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-07acfff2-7dc6-4787-bb40-8c974ca6f1db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:14.159859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-07acfff2-7dc6-4787-bb40-8c974ca6f1db tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086010 Aug 30 15:04:14.160421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1046/2087] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:14 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:14.447591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fab52088-e69f-4f3d-b8ce-30573b8d8b5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:14.448127 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fab52088-e69f-4f3d-b8ce-30573b8d8b5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:14.455104 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fab52088-e69f-4f3d-b8ce-30573b8d8b5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:14.455602 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fab52088-e69f-4f3d-b8ce-30573b8d8b5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:14.456034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fab52088-e69f-4f3d-b8ce-30573b8d8b5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:14.456706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fab52088-e69f-4f3d-b8ce-30573b8d8b5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:14.457153 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fab52088-e69f-4f3d-b8ce-30573b8d8b5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:14.457569 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fab52088-e69f-4f3d-b8ce-30573b8d8b5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:14.630882 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fab52088-e69f-4f3d-b8ce-30573b8d8b5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:14.639024 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fab52088-e69f-4f3d-b8ce-30573b8d8b5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.195594 Aug 30 15:04:14.639626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1042/2088] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:14 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:14.714118 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-56842cef-ed9f-4e08-b79b-798bc31a2d6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:14.714701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-56842cef-ed9f-4e08-b79b-798bc31a2d6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:14.721045 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-56842cef-ed9f-4e08-b79b-798bc31a2d6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:14.721536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-56842cef-ed9f-4e08-b79b-798bc31a2d6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:14.721974 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-56842cef-ed9f-4e08-b79b-798bc31a2d6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:14.722666 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-56842cef-ed9f-4e08-b79b-798bc31a2d6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:14.723117 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-56842cef-ed9f-4e08-b79b-798bc31a2d6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:14.723568 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-56842cef-ed9f-4e08-b79b-798bc31a2d6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:14.851987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-56842cef-ed9f-4e08-b79b-798bc31a2d6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:14.860149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-56842cef-ed9f-4e08-b79b-798bc31a2d6a tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149913 Aug 30 15:04:14.860739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1047/2089] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:14 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:15.181820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bc1a2ba3-b785-49a2-83cf-40ce9041cd0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:15.182427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bc1a2ba3-b785-49a2-83cf-40ce9041cd0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:15.188528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc1a2ba3-b785-49a2-83cf-40ce9041cd0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:15.189001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc1a2ba3-b785-49a2-83cf-40ce9041cd0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:15.189427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc1a2ba3-b785-49a2-83cf-40ce9041cd0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:15.190101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc1a2ba3-b785-49a2-83cf-40ce9041cd0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:15.190544 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc1a2ba3-b785-49a2-83cf-40ce9041cd0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:15.190957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc1a2ba3-b785-49a2-83cf-40ce9041cd0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:15.255618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bc1a2ba3-b785-49a2-83cf-40ce9041cd0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:15.264143 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bc1a2ba3-b785-49a2-83cf-40ce9041cd0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:15.265578 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bc1a2ba3-b785-49a2-83cf-40ce9041cd0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:15.266718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bc1a2ba3-b785-49a2-83cf-40ce9041cd0e tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088777 Aug 30 15:04:15.267293 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1043/2090] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:15 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:15.659701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bbee244e-8689-4608-a1db-816962c2deab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:15.660347 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bbee244e-8689-4608-a1db-816962c2deab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:15.666420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bbee244e-8689-4608-a1db-816962c2deab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:15.666897 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bbee244e-8689-4608-a1db-816962c2deab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:15.667365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bbee244e-8689-4608-a1db-816962c2deab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:15.668050 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bbee244e-8689-4608-a1db-816962c2deab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:15.668504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bbee244e-8689-4608-a1db-816962c2deab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:15.668925 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bbee244e-8689-4608-a1db-816962c2deab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:15.794130 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bbee244e-8689-4608-a1db-816962c2deab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:15.802161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bbee244e-8689-4608-a1db-816962c2deab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.146277 Aug 30 15:04:15.803249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1048/2091] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:15 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:15.882110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b3b41da6-7688-4858-9371-3101752dd36c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:15.882748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b3b41da6-7688-4858-9371-3101752dd36c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:15.889200 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3b41da6-7688-4858-9371-3101752dd36c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:15.889813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3b41da6-7688-4858-9371-3101752dd36c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:15.890241 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3b41da6-7688-4858-9371-3101752dd36c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:15.890919 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3b41da6-7688-4858-9371-3101752dd36c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:15.891408 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3b41da6-7688-4858-9371-3101752dd36c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:15.891827 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b3b41da6-7688-4858-9371-3101752dd36c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:16.018362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b3b41da6-7688-4858-9371-3101752dd36c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:16.026687 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b3b41da6-7688-4858-9371-3101752dd36c tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.149330 Aug 30 15:04:16.027384 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1044/2092] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:15 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:16.290088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f02e1003-f57f-474f-8a01-c9659bf09153 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:16.290688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f02e1003-f57f-474f-8a01-c9659bf09153 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:16.296566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f02e1003-f57f-474f-8a01-c9659bf09153 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:16.297039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f02e1003-f57f-474f-8a01-c9659bf09153 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:16.297467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f02e1003-f57f-474f-8a01-c9659bf09153 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:16.298143 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f02e1003-f57f-474f-8a01-c9659bf09153 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:16.298617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f02e1003-f57f-474f-8a01-c9659bf09153 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:16.299037 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f02e1003-f57f-474f-8a01-c9659bf09153 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:16.360158 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f02e1003-f57f-474f-8a01-c9659bf09153 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:16.369161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f02e1003-f57f-474f-8a01-c9659bf09153 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:16.370590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f02e1003-f57f-474f-8a01-c9659bf09153 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:16.371755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f02e1003-f57f-474f-8a01-c9659bf09153 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086270 Aug 30 15:04:16.372315 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1049/2093] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:16 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:16.822866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f0c574f5-1fe3-41db-9c63-867b1209c036 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:16.823499 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f0c574f5-1fe3-41db-9c63-867b1209c036 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:16.829413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0c574f5-1fe3-41db-9c63-867b1209c036 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:16.829895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0c574f5-1fe3-41db-9c63-867b1209c036 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:16.830331 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0c574f5-1fe3-41db-9c63-867b1209c036 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:16.831011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0c574f5-1fe3-41db-9c63-867b1209c036 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:16.831486 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0c574f5-1fe3-41db-9c63-867b1209c036 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:16.831907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f0c574f5-1fe3-41db-9c63-867b1209c036 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:16.956246 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f0c574f5-1fe3-41db-9c63-867b1209c036 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:16.964976 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f0c574f5-1fe3-41db-9c63-867b1209c036 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.146240 Aug 30 15:04:16.965540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1045/2094] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:16 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:17.046789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0dab9f3c-64dc-44f1-aeeb-9121027477b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:17.047545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0dab9f3c-64dc-44f1-aeeb-9121027477b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:17.054030 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0dab9f3c-64dc-44f1-aeeb-9121027477b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:17.054514 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0dab9f3c-64dc-44f1-aeeb-9121027477b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:17.054951 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0dab9f3c-64dc-44f1-aeeb-9121027477b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:17.055695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0dab9f3c-64dc-44f1-aeeb-9121027477b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:17.056131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0dab9f3c-64dc-44f1-aeeb-9121027477b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:17.056559 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0dab9f3c-64dc-44f1-aeeb-9121027477b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:17.184859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0dab9f3c-64dc-44f1-aeeb-9121027477b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:17.193018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0dab9f3c-64dc-44f1-aeeb-9121027477b7 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150092 Aug 30 15:04:17.194179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1050/2095] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:17 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:17.394063 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b8487b6b-1c1e-4328-ba3a-d1718523e501 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:17.394650 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b8487b6b-1c1e-4328-ba3a-d1718523e501 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:17.400582 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8487b6b-1c1e-4328-ba3a-d1718523e501 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:17.401061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8487b6b-1c1e-4328-ba3a-d1718523e501 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:17.401497 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8487b6b-1c1e-4328-ba3a-d1718523e501 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:17.402173 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8487b6b-1c1e-4328-ba3a-d1718523e501 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:17.402621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8487b6b-1c1e-4328-ba3a-d1718523e501 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:17.403040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8487b6b-1c1e-4328-ba3a-d1718523e501 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:17.467906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b8487b6b-1c1e-4328-ba3a-d1718523e501 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:17.476470 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b8487b6b-1c1e-4328-ba3a-d1718523e501 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:17.477908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b8487b6b-1c1e-4328-ba3a-d1718523e501 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:17.479045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b8487b6b-1c1e-4328-ba3a-d1718523e501 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089007 Aug 30 15:04:17.479643 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1046/2096] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:17 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:17.985594 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2a3854f6-d073-4b53-96ca-a6aa8260a24e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:17.986241 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2a3854f6-d073-4b53-96ca-a6aa8260a24e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:17.992412 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a3854f6-d073-4b53-96ca-a6aa8260a24e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:17.992895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a3854f6-d073-4b53-96ca-a6aa8260a24e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:17.993330 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a3854f6-d073-4b53-96ca-a6aa8260a24e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:17.994018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a3854f6-d073-4b53-96ca-a6aa8260a24e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:17.994470 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a3854f6-d073-4b53-96ca-a6aa8260a24e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:17.994891 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a3854f6-d073-4b53-96ca-a6aa8260a24e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:18.120048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2a3854f6-d073-4b53-96ca-a6aa8260a24e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:18.128081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2a3854f6-d073-4b53-96ca-a6aa8260a24e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.146449 Aug 30 15:04:18.128685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1051/2097] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:17 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:18.215098 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ec604154-0f70-47fb-99a6-3d8c9c2b69b1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:18.215731 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ec604154-0f70-47fb-99a6-3d8c9c2b69b1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] [instance: 38cae1b8-5973-4846-b2f4-79ed7e98be62] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:18.222028 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec604154-0f70-47fb-99a6-3d8c9c2b69b1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:18.222503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec604154-0f70-47fb-99a6-3d8c9c2b69b1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:18.222930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec604154-0f70-47fb-99a6-3d8c9c2b69b1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:18.223637 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec604154-0f70-47fb-99a6-3d8c9c2b69b1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:18.224080 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec604154-0f70-47fb-99a6-3d8c9c2b69b1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:18.225981 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ec604154-0f70-47fb-99a6-3d8c9c2b69b1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:18.352968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ec604154-0f70-47fb-99a6-3d8c9c2b69b1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fac2f6b6c124ddf99a888aa0c30f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bfe11f6c0da4508b94a01afb80c8483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:18.361004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ec604154-0f70-47fb-99a6-3d8c9c2b69b1 tempest-VolumesSnapshotTestJSON-1401907944 tempest-VolumesSnapshotTestJSON-1401907944-project] 10.222.0.30 "GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62" status: 200 len: 1560 microversion: 2.1 time: 0.150198 Aug 30 15:04:18.361574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1047/2098] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:18 2022] GET /compute/v2.1/servers/38cae1b8-5973-4846-b2f4-79ed7e98be62 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:18.502146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8bc67d01-84ea-422e-a3db-865bf9543cab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:18.502686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8bc67d01-84ea-422e-a3db-865bf9543cab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:18.508741 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bc67d01-84ea-422e-a3db-865bf9543cab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:18.509228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bc67d01-84ea-422e-a3db-865bf9543cab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:18.509670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bc67d01-84ea-422e-a3db-865bf9543cab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:18.510361 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bc67d01-84ea-422e-a3db-865bf9543cab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:18.510816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bc67d01-84ea-422e-a3db-865bf9543cab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:18.511262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8bc67d01-84ea-422e-a3db-865bf9543cab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:18.572851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8bc67d01-84ea-422e-a3db-865bf9543cab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:18.582000 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8bc67d01-84ea-422e-a3db-865bf9543cab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:18.583499 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8bc67d01-84ea-422e-a3db-865bf9543cab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:18.584705 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8bc67d01-84ea-422e-a3db-865bf9543cab tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086685 Aug 30 15:04:18.585641 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1052/2099] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:18 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:19.149613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f72ad38d-afd4-4d3f-8a08-915fceb42d49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:19.150217 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f72ad38d-afd4-4d3f-8a08-915fceb42d49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:19.156139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f72ad38d-afd4-4d3f-8a08-915fceb42d49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:19.156614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f72ad38d-afd4-4d3f-8a08-915fceb42d49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:19.157045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f72ad38d-afd4-4d3f-8a08-915fceb42d49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:19.157717 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f72ad38d-afd4-4d3f-8a08-915fceb42d49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:19.158161 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f72ad38d-afd4-4d3f-8a08-915fceb42d49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:19.158587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f72ad38d-afd4-4d3f-8a08-915fceb42d49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:19.283848 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f72ad38d-afd4-4d3f-8a08-915fceb42d49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:19.291934 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f72ad38d-afd4-4d3f-8a08-915fceb42d49 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147236 Aug 30 15:04:19.292500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1048/2100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:19 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:19.608232 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ce960786-f6c4-4255-ae77-38ad9afb37f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:19.608847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ce960786-f6c4-4255-ae77-38ad9afb37f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:19.615591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce960786-f6c4-4255-ae77-38ad9afb37f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:19.616153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce960786-f6c4-4255-ae77-38ad9afb37f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:19.616624 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce960786-f6c4-4255-ae77-38ad9afb37f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:19.617313 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce960786-f6c4-4255-ae77-38ad9afb37f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:19.617765 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce960786-f6c4-4255-ae77-38ad9afb37f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:19.618187 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ce960786-f6c4-4255-ae77-38ad9afb37f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:19.682499 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ce960786-f6c4-4255-ae77-38ad9afb37f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:19.691279 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ce960786-f6c4-4255-ae77-38ad9afb37f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:19.692771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ce960786-f6c4-4255-ae77-38ad9afb37f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:19.694584 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ce960786-f6c4-4255-ae77-38ad9afb37f4 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.090286 Aug 30 15:04:19.695139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1053/2101] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:19 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:20.312302 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8f9ab327-cd0f-462c-bfa6-e488fd6446ab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:20.312904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8f9ab327-cd0f-462c-bfa6-e488fd6446ab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:20.319607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f9ab327-cd0f-462c-bfa6-e488fd6446ab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:20.320077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f9ab327-cd0f-462c-bfa6-e488fd6446ab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:20.320503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f9ab327-cd0f-462c-bfa6-e488fd6446ab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:20.321172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f9ab327-cd0f-462c-bfa6-e488fd6446ab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:20.321623 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f9ab327-cd0f-462c-bfa6-e488fd6446ab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:20.322038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f9ab327-cd0f-462c-bfa6-e488fd6446ab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:20.453137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8f9ab327-cd0f-462c-bfa6-e488fd6446ab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:20.461985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8f9ab327-cd0f-462c-bfa6-e488fd6446ab tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153490 Aug 30 15:04:20.462613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1049/2102] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:20 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:04:20.716323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-224593d1-6293-40fc-8124-de2b71c86c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:20.716864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-224593d1-6293-40fc-8124-de2b71c86c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:20.723203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-224593d1-6293-40fc-8124-de2b71c86c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:20.723709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-224593d1-6293-40fc-8124-de2b71c86c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:20.724144 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-224593d1-6293-40fc-8124-de2b71c86c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:20.724852 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-224593d1-6293-40fc-8124-de2b71c86c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:20.725304 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-224593d1-6293-40fc-8124-de2b71c86c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:20.725725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-224593d1-6293-40fc-8124-de2b71c86c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:20.786376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-224593d1-6293-40fc-8124-de2b71c86c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:20.794864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-224593d1-6293-40fc-8124-de2b71c86c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:20.796434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-224593d1-6293-40fc-8124-de2b71c86c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:20.797595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-224593d1-6293-40fc-8124-de2b71c86c85 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.085291 Aug 30 15:04:20.798150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1054/2103] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:20 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:21.483370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1d2ed33b-1822-480f-aac8-640d2ad5869a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:21.483916 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1d2ed33b-1822-480f-aac8-640d2ad5869a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:21.490519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d2ed33b-1822-480f-aac8-640d2ad5869a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:21.491033 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d2ed33b-1822-480f-aac8-640d2ad5869a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:21.491496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d2ed33b-1822-480f-aac8-640d2ad5869a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:21.492185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d2ed33b-1822-480f-aac8-640d2ad5869a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:21.492639 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d2ed33b-1822-480f-aac8-640d2ad5869a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:21.493089 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d2ed33b-1822-480f-aac8-640d2ad5869a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:21.620151 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1d2ed33b-1822-480f-aac8-640d2ad5869a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:21.628122 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1d2ed33b-1822-480f-aac8-640d2ad5869a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148959 Aug 30 15:04:21.628683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1050/2104] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:21 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:21.819965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b467e367-9721-4f16-8a0b-7f5c3aac393b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:21.820575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b467e367-9721-4f16-8a0b-7f5c3aac393b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:21.827133 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b467e367-9721-4f16-8a0b-7f5c3aac393b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:21.827640 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b467e367-9721-4f16-8a0b-7f5c3aac393b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:21.828072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b467e367-9721-4f16-8a0b-7f5c3aac393b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:21.828748 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b467e367-9721-4f16-8a0b-7f5c3aac393b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:21.829193 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b467e367-9721-4f16-8a0b-7f5c3aac393b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:21.829610 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b467e367-9721-4f16-8a0b-7f5c3aac393b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:21.890602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b467e367-9721-4f16-8a0b-7f5c3aac393b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:21.899605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b467e367-9721-4f16-8a0b-7f5c3aac393b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:21.901044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b467e367-9721-4f16-8a0b-7f5c3aac393b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:21.902202 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b467e367-9721-4f16-8a0b-7f5c3aac393b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086211 Aug 30 15:04:21.902760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1055/2105] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:21 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:22.649953 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6dce0e8e-4009-44f9-a3e1-fbe2dba492b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:22.650604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6dce0e8e-4009-44f9-a3e1-fbe2dba492b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:22.656979 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6dce0e8e-4009-44f9-a3e1-fbe2dba492b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:22.657456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6dce0e8e-4009-44f9-a3e1-fbe2dba492b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:22.657893 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6dce0e8e-4009-44f9-a3e1-fbe2dba492b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:22.658573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6dce0e8e-4009-44f9-a3e1-fbe2dba492b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:22.659023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6dce0e8e-4009-44f9-a3e1-fbe2dba492b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:22.659466 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6dce0e8e-4009-44f9-a3e1-fbe2dba492b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:22.788065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6dce0e8e-4009-44f9-a3e1-fbe2dba492b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:22.796095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6dce0e8e-4009-44f9-a3e1-fbe2dba492b0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150733 Aug 30 15:04:22.796665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1051/2106] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:22 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:22.925195 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e43d59ba-57b1-4e04-b819-5b3fc0777a95 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:22.925739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e43d59ba-57b1-4e04-b819-5b3fc0777a95 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:22.932832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e43d59ba-57b1-4e04-b819-5b3fc0777a95 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:22.933313 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e43d59ba-57b1-4e04-b819-5b3fc0777a95 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:22.933746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e43d59ba-57b1-4e04-b819-5b3fc0777a95 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:22.934429 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e43d59ba-57b1-4e04-b819-5b3fc0777a95 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:22.934877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e43d59ba-57b1-4e04-b819-5b3fc0777a95 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:22.935338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e43d59ba-57b1-4e04-b819-5b3fc0777a95 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:22.997801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e43d59ba-57b1-4e04-b819-5b3fc0777a95 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:23.006557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e43d59ba-57b1-4e04-b819-5b3fc0777a95 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:23.008049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e43d59ba-57b1-4e04-b819-5b3fc0777a95 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:23.009210 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e43d59ba-57b1-4e04-b819-5b3fc0777a95 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088010 Aug 30 15:04:23.009762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1056/2107] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:22 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:23.817719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2f1cdb40-79f8-4a8b-9cbd-bde65733d7a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:23.819415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2f1cdb40-79f8-4a8b-9cbd-bde65733d7a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:23.826164 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f1cdb40-79f8-4a8b-9cbd-bde65733d7a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:23.826634 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f1cdb40-79f8-4a8b-9cbd-bde65733d7a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:23.827065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f1cdb40-79f8-4a8b-9cbd-bde65733d7a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:23.827770 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f1cdb40-79f8-4a8b-9cbd-bde65733d7a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:23.828214 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f1cdb40-79f8-4a8b-9cbd-bde65733d7a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:23.828627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2f1cdb40-79f8-4a8b-9cbd-bde65733d7a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:23.957644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2f1cdb40-79f8-4a8b-9cbd-bde65733d7a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:23.968201 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2f1cdb40-79f8-4a8b-9cbd-bde65733d7a5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.154529 Aug 30 15:04:23.968797 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1052/2108] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:23 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:24.031941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1f381e95-aa05-49ef-973a-5d9a92905c72 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:24.032553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1f381e95-aa05-49ef-973a-5d9a92905c72 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:24.034849 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=72 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:24.040128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f381e95-aa05-49ef-973a-5d9a92905c72 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:24.040602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f381e95-aa05-49ef-973a-5d9a92905c72 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:24.041031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f381e95-aa05-49ef-973a-5d9a92905c72 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:24.041708 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f381e95-aa05-49ef-973a-5d9a92905c72 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:24.042149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f381e95-aa05-49ef-973a-5d9a92905c72 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:24.042564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1f381e95-aa05-49ef-973a-5d9a92905c72 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:24.105500 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1f381e95-aa05-49ef-973a-5d9a92905c72 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:24.113958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1f381e95-aa05-49ef-973a-5d9a92905c72 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:24.116271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1f381e95-aa05-49ef-973a-5d9a92905c72 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:24.117398 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1f381e95-aa05-49ef-973a-5d9a92905c72 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089401 Aug 30 15:04:24.117948 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1057/2109] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:24 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:24.990513 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-647d5f16-5eb6-473d-bf1e-708b6a10ca1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:24.991135 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-647d5f16-5eb6-473d-bf1e-708b6a10ca1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:24.993497 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=76 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:24.999109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-647d5f16-5eb6-473d-bf1e-708b6a10ca1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:24.999621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-647d5f16-5eb6-473d-bf1e-708b6a10ca1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:25.000061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-647d5f16-5eb6-473d-bf1e-708b6a10ca1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:25.000756 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-647d5f16-5eb6-473d-bf1e-708b6a10ca1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:25.001207 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-647d5f16-5eb6-473d-bf1e-708b6a10ca1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:25.001630 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-647d5f16-5eb6-473d-bf1e-708b6a10ca1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:25.129205 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-647d5f16-5eb6-473d-bf1e-708b6a10ca1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:25.138001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-647d5f16-5eb6-473d-bf1e-708b6a10ca1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151922 Aug 30 15:04:25.138573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1053/2110] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:24 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:25.140106 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-505bdc0d-170f-45f3-a157-d3c555a67963 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:25.140725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-505bdc0d-170f-45f3-a157-d3c555a67963 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:25.147793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-505bdc0d-170f-45f3-a157-d3c555a67963 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:25.148276 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-505bdc0d-170f-45f3-a157-d3c555a67963 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:25.148709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-505bdc0d-170f-45f3-a157-d3c555a67963 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:25.149399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-505bdc0d-170f-45f3-a157-d3c555a67963 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:25.149847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-505bdc0d-170f-45f3-a157-d3c555a67963 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:25.150270 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-505bdc0d-170f-45f3-a157-d3c555a67963 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:25.210976 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-505bdc0d-170f-45f3-a157-d3c555a67963 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:25.219667 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-505bdc0d-170f-45f3-a157-d3c555a67963 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:25.221129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-505bdc0d-170f-45f3-a157-d3c555a67963 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:25.222285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-505bdc0d-170f-45f3-a157-d3c555a67963 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086108 Aug 30 15:04:25.222844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1058/2111] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:25 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:04:26.159428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b0089c39-2f62-419d-baa6-64bd682ff391 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:26.160028 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b0089c39-2f62-419d-baa6-64bd682ff391 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:26.166894 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0089c39-2f62-419d-baa6-64bd682ff391 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:26.167410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0089c39-2f62-419d-baa6-64bd682ff391 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:26.167850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0089c39-2f62-419d-baa6-64bd682ff391 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:26.168558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0089c39-2f62-419d-baa6-64bd682ff391 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:26.169012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0089c39-2f62-419d-baa6-64bd682ff391 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:26.169438 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0089c39-2f62-419d-baa6-64bd682ff391 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:26.244527 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-517155bf-08c5-4fd0-85b3-3d460ee73f5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:26.245141 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-517155bf-08c5-4fd0-85b3-3d460ee73f5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:26.251643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-517155bf-08c5-4fd0-85b3-3d460ee73f5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:26.252127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-517155bf-08c5-4fd0-85b3-3d460ee73f5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:26.252559 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-517155bf-08c5-4fd0-85b3-3d460ee73f5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:26.253247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-517155bf-08c5-4fd0-85b3-3d460ee73f5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:26.253699 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-517155bf-08c5-4fd0-85b3-3d460ee73f5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:26.254120 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-517155bf-08c5-4fd0-85b3-3d460ee73f5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:26.302245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b0089c39-2f62-419d-baa6-64bd682ff391 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:26.305836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:26.311869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b0089c39-2f62-419d-baa6-64bd682ff391 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.156343 Aug 30 15:04:26.312451 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1054/2112] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:26 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:26.317643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-517155bf-08c5-4fd0-85b3-3d460ee73f5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:26.326615 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-517155bf-08c5-4fd0-85b3-3d460ee73f5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:26.328101 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-517155bf-08c5-4fd0-85b3-3d460ee73f5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:26.329230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-517155bf-08c5-4fd0-85b3-3d460ee73f5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.088669 Aug 30 15:04:26.329783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1059/2113] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:26 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:04:27.333134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d3f72fc8-acb3-418f-a082-198f873fde1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:27.333731 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d3f72fc8-acb3-418f-a082-198f873fde1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:27.340328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3f72fc8-acb3-418f-a082-198f873fde1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:27.340801 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3f72fc8-acb3-418f-a082-198f873fde1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:27.341228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3f72fc8-acb3-418f-a082-198f873fde1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:27.341900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3f72fc8-acb3-418f-a082-198f873fde1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:27.342343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3f72fc8-acb3-418f-a082-198f873fde1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:27.342761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3f72fc8-acb3-418f-a082-198f873fde1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:27.352489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c860643b-087a-4dfc-ae6a-1f4d60956a01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:27.353097 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c860643b-087a-4dfc-ae6a-1f4d60956a01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:27.359095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c860643b-087a-4dfc-ae6a-1f4d60956a01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:27.359596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c860643b-087a-4dfc-ae6a-1f4d60956a01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:27.360033 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c860643b-087a-4dfc-ae6a-1f4d60956a01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:27.360720 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c860643b-087a-4dfc-ae6a-1f4d60956a01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:27.361656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c860643b-087a-4dfc-ae6a-1f4d60956a01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:27.361656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c860643b-087a-4dfc-ae6a-1f4d60956a01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:27.423333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c860643b-087a-4dfc-ae6a-1f4d60956a01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:27.432859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c860643b-087a-4dfc-ae6a-1f4d60956a01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:27.434307 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c860643b-087a-4dfc-ae6a-1f4d60956a01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:27.435463 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c860643b-087a-4dfc-ae6a-1f4d60956a01 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087388 Aug 30 15:04:27.436019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1060/2114] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:27 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:04:27.472372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d3f72fc8-acb3-418f-a082-198f873fde1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:27.481070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d3f72fc8-acb3-418f-a082-198f873fde1a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152023 Aug 30 15:04:27.481627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1055/2115] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:27 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:28.457468 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-783fa041-1083-4617-9ee2-ef68bb2d1930 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:28.458081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-783fa041-1083-4617-9ee2-ef68bb2d1930 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:28.464502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-783fa041-1083-4617-9ee2-ef68bb2d1930 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:28.464924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-783fa041-1083-4617-9ee2-ef68bb2d1930 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:28.465351 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-783fa041-1083-4617-9ee2-ef68bb2d1930 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:28.466037 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-783fa041-1083-4617-9ee2-ef68bb2d1930 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:28.466487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-783fa041-1083-4617-9ee2-ef68bb2d1930 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:28.466907 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-783fa041-1083-4617-9ee2-ef68bb2d1930 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:28.470869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:28.501760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-392c20b0-e63a-4dd8-a966-89413b49dd83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:28.502371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-392c20b0-e63a-4dd8-a966-89413b49dd83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:28.509548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-392c20b0-e63a-4dd8-a966-89413b49dd83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:28.510154 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-392c20b0-e63a-4dd8-a966-89413b49dd83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:28.510636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-392c20b0-e63a-4dd8-a966-89413b49dd83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:28.511373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-392c20b0-e63a-4dd8-a966-89413b49dd83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:28.511829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-392c20b0-e63a-4dd8-a966-89413b49dd83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:28.512256 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-392c20b0-e63a-4dd8-a966-89413b49dd83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:28.533829 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-783fa041-1083-4617-9ee2-ef68bb2d1930 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:28.542525 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-783fa041-1083-4617-9ee2-ef68bb2d1930 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:28.544005 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-783fa041-1083-4617-9ee2-ef68bb2d1930 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:28.545179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-783fa041-1083-4617-9ee2-ef68bb2d1930 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.091613 Aug 30 15:04:28.545741 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1061/2116] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:28 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:28.643099 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-392c20b0-e63a-4dd8-a966-89413b49dd83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:28.651455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-392c20b0-e63a-4dd8-a966-89413b49dd83 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153456 Aug 30 15:04:28.652018 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1056/2117] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:28 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:04:29.567932 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b6558382-248b-4e5c-8012-c8c93896371f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:29.568536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b6558382-248b-4e5c-8012-c8c93896371f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:29.575869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6558382-248b-4e5c-8012-c8c93896371f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:29.576344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6558382-248b-4e5c-8012-c8c93896371f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:29.576766 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6558382-248b-4e5c-8012-c8c93896371f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:29.577440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6558382-248b-4e5c-8012-c8c93896371f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:29.577884 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6558382-248b-4e5c-8012-c8c93896371f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:29.578299 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b6558382-248b-4e5c-8012-c8c93896371f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:29.639549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b6558382-248b-4e5c-8012-c8c93896371f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:29.648726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b6558382-248b-4e5c-8012-c8c93896371f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:29.650176 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b6558382-248b-4e5c-8012-c8c93896371f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:29.651344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b6558382-248b-4e5c-8012-c8c93896371f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.087251 Aug 30 15:04:29.651912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1062/2118] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:29 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:29.672160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3dc12145-fb4b-4833-8a1a-07ad1da31071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:29.672808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3dc12145-fb4b-4833-8a1a-07ad1da31071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:29.679392 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3dc12145-fb4b-4833-8a1a-07ad1da31071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:29.679873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3dc12145-fb4b-4833-8a1a-07ad1da31071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:29.680309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3dc12145-fb4b-4833-8a1a-07ad1da31071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:29.680989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3dc12145-fb4b-4833-8a1a-07ad1da31071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:29.681441 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3dc12145-fb4b-4833-8a1a-07ad1da31071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:29.681864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3dc12145-fb4b-4833-8a1a-07ad1da31071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:29.809561 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3dc12145-fb4b-4833-8a1a-07ad1da31071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:29.818857 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3dc12145-fb4b-4833-8a1a-07ad1da31071 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150402 Aug 30 15:04:29.820162 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1057/2119] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:29 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:04:30.674983 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f6b425ed-b050-43bc-acd0-3e9051b9a068 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:30.675627 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f6b425ed-b050-43bc-acd0-3e9051b9a068 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:30.683822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f6b425ed-b050-43bc-acd0-3e9051b9a068 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:30.684300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f6b425ed-b050-43bc-acd0-3e9051b9a068 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:30.684731 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f6b425ed-b050-43bc-acd0-3e9051b9a068 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:30.685420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f6b425ed-b050-43bc-acd0-3e9051b9a068 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:30.685864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f6b425ed-b050-43bc-acd0-3e9051b9a068 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:30.686280 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f6b425ed-b050-43bc-acd0-3e9051b9a068 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:30.759606 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f6b425ed-b050-43bc-acd0-3e9051b9a068 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:30.768326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f6b425ed-b050-43bc-acd0-3e9051b9a068 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:30.769818 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f6b425ed-b050-43bc-acd0-3e9051b9a068 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:30.770965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f6b425ed-b050-43bc-acd0-3e9051b9a068 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.100894 Aug 30 15:04:30.771570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1063/2120] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:30 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:30.840226 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1d1455e1-13ba-4bcd-8fe0-0081a4b184e1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:30.840845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1d1455e1-13ba-4bcd-8fe0-0081a4b184e1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:30.847631 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d1455e1-13ba-4bcd-8fe0-0081a4b184e1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:30.848119 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d1455e1-13ba-4bcd-8fe0-0081a4b184e1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:30.848560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d1455e1-13ba-4bcd-8fe0-0081a4b184e1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:30.849262 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d1455e1-13ba-4bcd-8fe0-0081a4b184e1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:30.849751 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d1455e1-13ba-4bcd-8fe0-0081a4b184e1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:30.850179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d1455e1-13ba-4bcd-8fe0-0081a4b184e1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:30.999676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1d1455e1-13ba-4bcd-8fe0-0081a4b184e1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:31.008558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1d1455e1-13ba-4bcd-8fe0-0081a4b184e1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.172141 Aug 30 15:04:31.009145 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1058/2121] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:30 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:31.794165 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2b820df9-6ea2-4c32-b91a-b024fb781e05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:31.794772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2b820df9-6ea2-4c32-b91a-b024fb781e05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:31.801253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2b820df9-6ea2-4c32-b91a-b024fb781e05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:31.801725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2b820df9-6ea2-4c32-b91a-b024fb781e05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:31.802156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2b820df9-6ea2-4c32-b91a-b024fb781e05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:31.802835 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2b820df9-6ea2-4c32-b91a-b024fb781e05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:31.803407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2b820df9-6ea2-4c32-b91a-b024fb781e05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:31.804363 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2b820df9-6ea2-4c32-b91a-b024fb781e05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:31.864933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2b820df9-6ea2-4c32-b91a-b024fb781e05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:31.874077 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2b820df9-6ea2-4c32-b91a-b024fb781e05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:31.875536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2b820df9-6ea2-4c32-b91a-b024fb781e05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:31.876658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2b820df9-6ea2-4c32-b91a-b024fb781e05 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.086439 Aug 30 15:04:31.877212 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1064/2122] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:31 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:32.029656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3d1d1a49-9b3e-4937-a148-946b6263f745 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:32.030269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3d1d1a49-9b3e-4937-a148-946b6263f745 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:32.036990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d1d1a49-9b3e-4937-a148-946b6263f745 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:32.037491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d1d1a49-9b3e-4937-a148-946b6263f745 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:32.037967 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d1d1a49-9b3e-4937-a148-946b6263f745 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:32.038685 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d1d1a49-9b3e-4937-a148-946b6263f745 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:32.039146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d1d1a49-9b3e-4937-a148-946b6263f745 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:32.039625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d1d1a49-9b3e-4937-a148-946b6263f745 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:32.165541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3d1d1a49-9b3e-4937-a148-946b6263f745 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:32.173586 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3d1d1a49-9b3e-4937-a148-946b6263f745 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147973 Aug 30 15:04:32.174152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1059/2123] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:32 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:32.900078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d259cb54-8bec-4cb0-85d2-e647092db4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:32.900684 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d259cb54-8bec-4cb0-85d2-e647092db4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:32.906966 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d259cb54-8bec-4cb0-85d2-e647092db4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:32.907474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d259cb54-8bec-4cb0-85d2-e647092db4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:32.907909 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d259cb54-8bec-4cb0-85d2-e647092db4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:32.908583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d259cb54-8bec-4cb0-85d2-e647092db4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:32.909032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d259cb54-8bec-4cb0-85d2-e647092db4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:32.909448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d259cb54-8bec-4cb0-85d2-e647092db4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:32.973832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d259cb54-8bec-4cb0-85d2-e647092db4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:32.983004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d259cb54-8bec-4cb0-85d2-e647092db4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:32.984517 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d259cb54-8bec-4cb0-85d2-e647092db4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:32.985648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d259cb54-8bec-4cb0-85d2-e647092db4c5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 200 len: 1443 microversion: 2.20 time: 0.089926 Aug 30 15:04:32.986210 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1065/2124] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:32 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:33.014677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c09f042a-5162-4c61-a497-2d86c94adf00 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '.version_select at 0x7f5cba830670>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:33.036919 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c09f042a-5162-4c61-a497-2d86c94adf00 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-455122836" status: 204 len: 0 microversion: 2.20 time: 0.026122 Aug 30 15:04:33.037573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1060/2125] 10.222.0.30 () {60 vars in 1259 bytes} [Tue Aug 30 15:04:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-455122836 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 15:04:33.196333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-625159fd-26c9-487d-adf4-cb046a0e5338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:33.197019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-625159fd-26c9-487d-adf4-cb046a0e5338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:33.204127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-625159fd-26c9-487d-adf4-cb046a0e5338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:33.204714 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-625159fd-26c9-487d-adf4-cb046a0e5338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:33.205271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-625159fd-26c9-487d-adf4-cb046a0e5338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:33.211162 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-625159fd-26c9-487d-adf4-cb046a0e5338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:33.212069 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-625159fd-26c9-487d-adf4-cb046a0e5338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:33.212727 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-625159fd-26c9-487d-adf4-cb046a0e5338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:33.359590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-625159fd-26c9-487d-adf4-cb046a0e5338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:33.368121 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-625159fd-26c9-487d-adf4-cb046a0e5338 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.176368 Aug 30 15:04:33.368699 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1066/2126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:33 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:33.849774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d3b9492a-e98c-40e5-8d40-5bad1c691f30 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Action: 'create', calling method: .version_select at 0x7f5cbaaf8700>, body: {"keypair": {"name": "tempest-keypair-905989378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRnjURSgUvkQyEmHHfYApxhvhGrwWVfqlsw0qcjeG7YuASU5D2Falw61zYfq6U59Bizh/YkFct1lW+gHT/ZyMzhJ+Qekw7XjKT9TrJZFbdCQKc9pS8r9ZKKMxICQmdrYA=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:04:33.868711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-d3b9492a-e98c-40e5-8d40-5bad1c691f30 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Getting quotas for project a8914c5bc86f4ee6a9797b05a6a7b12b. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:04:33.872956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-d3b9492a-e98c-40e5-8d40-5bad1c691f30 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Getting quotas for user 6270e19d6245453ab79555a79532faba and project a8914c5bc86f4ee6a9797b05a6a7b12b. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:04:33.894749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d3b9492a-e98c-40e5-8d40-5bad1c691f30 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049067 Aug 30 15:04:33.895377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1061/2127] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Aug 30 15:04:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 15:04:34.388186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8c26dfc1-817e-41b4-a1f7-4333b6bdfc34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:34.388758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8c26dfc1-817e-41b4-a1f7-4333b6bdfc34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:34.395082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c26dfc1-817e-41b4-a1f7-4333b6bdfc34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:34.395618 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c26dfc1-817e-41b4-a1f7-4333b6bdfc34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:34.396073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c26dfc1-817e-41b4-a1f7-4333b6bdfc34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:34.396766 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c26dfc1-817e-41b4-a1f7-4333b6bdfc34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:34.397223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c26dfc1-817e-41b4-a1f7-4333b6bdfc34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:34.397727 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c26dfc1-817e-41b4-a1f7-4333b6bdfc34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:34.602958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8c26dfc1-817e-41b4-a1f7-4333b6bdfc34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:34.611223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8c26dfc1-817e-41b4-a1f7-4333b6bdfc34 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.226993 Aug 30 15:04:34.612003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1067/2128] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:34 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:35.250700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1151609465", "imageRef": "fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "45f9aacb-1fd2-4ead-ac22-db45aa0f691f"}], "security_groups": [{"name": "tempest-securitygroup--1640397875"}], "key_name": "tempest-keypair-905989378", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:04:35.356600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] validate_networks() for [('45f9aacb-1fd2-4ead-ac22-db45aa0f691f', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 15:04:35.632122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5923d8b3-6142-42b3-9ba0-785190e8a8c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:35.632990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5923d8b3-6142-42b3-9ba0-785190e8a8c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:35.639276 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5923d8b3-6142-42b3-9ba0-785190e8a8c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:35.639755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5923d8b3-6142-42b3-9ba0-785190e8a8c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:35.640186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5923d8b3-6142-42b3-9ba0-785190e8a8c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:35.640868 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5923d8b3-6142-42b3-9ba0-785190e8a8c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:35.641315 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5923d8b3-6142-42b3-9ba0-785190e8a8c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:35.641740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5923d8b3-6142-42b3-9ba0-785190e8a8c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:35.772679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5923d8b3-6142-42b3-9ba0-785190e8a8c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:35.780966 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5923d8b3-6142-42b3-9ba0-785190e8a8c0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152667 Aug 30 15:04:35.781793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1068/2129] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:35 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:04:36.008445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 15:04:36.008863 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 15:04:36.009334 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 15:04:36.009740 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 15:04:36.010144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 15:04:36.018571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:36.019039 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:36.019501 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:36.020214 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:36.020724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:36.021145 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:36.040200 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Getting quotas for project a8914c5bc86f4ee6a9797b05a6a7b12b. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:04:36.044097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Getting quotas for user 6270e19d6245453ab79555a79532faba and project a8914c5bc86f4ee6a9797b05a6a7b12b. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:04:36.055520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 15:04:36.057786 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 15:04:36.108180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f2082384-5a01-46a5-9958-4213d5978395 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.862323 Aug 30 15:04:36.108852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1062/2130] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 30 15:04:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 15:04:36.119576 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b4c39205-2f9d-43ad-becb-e8166f1b5b88 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:36.120186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b4c39205-2f9d-43ad-becb-e8166f1b5b88 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:36.176219 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b4c39205-2f9d-43ad-becb-e8166f1b5b88 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:36.184414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b4c39205-2f9d-43ad-becb-e8166f1b5b88 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:36.186068 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b4c39205-2f9d-43ad-becb-e8166f1b5b88 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:36.187153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b4c39205-2f9d-43ad-becb-e8166f1b5b88 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 200 len: 1281 microversion: 2.20 time: 0.071543 Aug 30 15:04:36.187803 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1069/2131] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:36 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:36.803083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a263ebf4-d714-4452-8e1b-6741d9dfa3d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:36.804261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a263ebf4-d714-4452-8e1b-6741d9dfa3d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:36.811853 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a263ebf4-d714-4452-8e1b-6741d9dfa3d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:36.812444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a263ebf4-d714-4452-8e1b-6741d9dfa3d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:36.812876 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a263ebf4-d714-4452-8e1b-6741d9dfa3d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:36.813569 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a263ebf4-d714-4452-8e1b-6741d9dfa3d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:36.814020 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a263ebf4-d714-4452-8e1b-6741d9dfa3d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:36.814440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a263ebf4-d714-4452-8e1b-6741d9dfa3d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:36.945827 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a263ebf4-d714-4452-8e1b-6741d9dfa3d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:36.954916 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a263ebf4-d714-4452-8e1b-6741d9dfa3d1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.155931 Aug 30 15:04:36.955737 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1063/2132] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:36 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:37.214323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-144af0e7-1be1-4244-8d1e-e01a9374b3c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:37.214933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-144af0e7-1be1-4244-8d1e-e01a9374b3c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:37.222697 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-144af0e7-1be1-4244-8d1e-e01a9374b3c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:37.223289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-144af0e7-1be1-4244-8d1e-e01a9374b3c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:37.223732 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-144af0e7-1be1-4244-8d1e-e01a9374b3c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:37.224436 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-144af0e7-1be1-4244-8d1e-e01a9374b3c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:37.224894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-144af0e7-1be1-4244-8d1e-e01a9374b3c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:37.225339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-144af0e7-1be1-4244-8d1e-e01a9374b3c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:37.287906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-144af0e7-1be1-4244-8d1e-e01a9374b3c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:37.296747 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-144af0e7-1be1-4244-8d1e-e01a9374b3c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:37.298213 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-144af0e7-1be1-4244-8d1e-e01a9374b3c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:37.299358 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-144af0e7-1be1-4244-8d1e-e01a9374b3c1 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 200 len: 1333 microversion: 2.20 time: 0.088898 Aug 30 15:04:37.299919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1070/2133] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:37 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:37.976784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7d0a17e3-ec91-4a3d-bdb9-9c301d8fc6ca tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:37.977352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7d0a17e3-ec91-4a3d-bdb9-9c301d8fc6ca tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:37.985088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d0a17e3-ec91-4a3d-bdb9-9c301d8fc6ca tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:37.985956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d0a17e3-ec91-4a3d-bdb9-9c301d8fc6ca tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:37.986820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d0a17e3-ec91-4a3d-bdb9-9c301d8fc6ca tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:37.988702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d0a17e3-ec91-4a3d-bdb9-9c301d8fc6ca tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:37.988956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d0a17e3-ec91-4a3d-bdb9-9c301d8fc6ca tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:37.989755 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d0a17e3-ec91-4a3d-bdb9-9c301d8fc6ca tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:38.227391 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7d0a17e3-ec91-4a3d-bdb9-9c301d8fc6ca tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:38.235580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7d0a17e3-ec91-4a3d-bdb9-9c301d8fc6ca tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.263290 Aug 30 15:04:38.236154 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1064/2134] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:37 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:38.322063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f34644dc-6c3a-4b89-86fe-0e67a4be9bd5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:38.323010 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f34644dc-6c3a-4b89-86fe-0e67a4be9bd5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:38.329419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f34644dc-6c3a-4b89-86fe-0e67a4be9bd5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:38.329900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f34644dc-6c3a-4b89-86fe-0e67a4be9bd5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:38.330332 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f34644dc-6c3a-4b89-86fe-0e67a4be9bd5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:38.331020 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f34644dc-6c3a-4b89-86fe-0e67a4be9bd5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:38.331513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f34644dc-6c3a-4b89-86fe-0e67a4be9bd5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:38.331918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f34644dc-6c3a-4b89-86fe-0e67a4be9bd5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:38.480604 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f34644dc-6c3a-4b89-86fe-0e67a4be9bd5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:38.488689 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f34644dc-6c3a-4b89-86fe-0e67a4be9bd5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:38.490134 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f34644dc-6c3a-4b89-86fe-0e67a4be9bd5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:38.491356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f34644dc-6c3a-4b89-86fe-0e67a4be9bd5 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 200 len: 1407 microversion: 2.20 time: 0.173266 Aug 30 15:04:38.491914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1071/2135] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:38 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:38.923371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-f27f18ed-b431-422d-80cd-a58100996905 req-c1d65417-c3ea-46ea-84bb-c096387431bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a88427e0-8903-470e-b463-fa8fe9b645b3", "tag": "363010d9-43ef-4930-8d87-4410b516872c"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:04:38.933651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f27f18ed-b431-422d-80cd-a58100996905 req-c1d65417-c3ea-46ea-84bb-c096387431bc service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:38.934126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f27f18ed-b431-422d-80cd-a58100996905 req-c1d65417-c3ea-46ea-84bb-c096387431bc service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:38.934553 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f27f18ed-b431-422d-80cd-a58100996905 req-c1d65417-c3ea-46ea-84bb-c096387431bc service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:38.946266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-f27f18ed-b431-422d-80cd-a58100996905 req-c1d65417-c3ea-46ea-84bb-c096387431bc service nova] Creating event network-changed:363010d9-43ef-4930-8d87-4410b516872c for instance a88427e0-8903-470e-b463-fa8fe9b645b3 on hv-cinder-82880 Aug 30 15:04:38.953321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-f27f18ed-b431-422d-80cd-a58100996905 req-c1d65417-c3ea-46ea-84bb-c096387431bc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098762 Aug 30 15:04:38.954185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1065/2136] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:04:39.257646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-32648310-afe8-4d5a-9295-2c459685eba1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:39.258545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-32648310-afe8-4d5a-9295-2c459685eba1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:39.264672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32648310-afe8-4d5a-9295-2c459685eba1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:39.265162 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32648310-afe8-4d5a-9295-2c459685eba1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:39.265602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32648310-afe8-4d5a-9295-2c459685eba1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:39.266296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32648310-afe8-4d5a-9295-2c459685eba1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:39.266749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32648310-afe8-4d5a-9295-2c459685eba1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:39.267171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32648310-afe8-4d5a-9295-2c459685eba1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:39.400040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-32648310-afe8-4d5a-9295-2c459685eba1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:39.408378 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-32648310-afe8-4d5a-9295-2c459685eba1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.155199 Aug 30 15:04:39.408947 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1072/2137] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:39 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:39.515237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-718b073f-9374-4eb8-af11-e597c5a2215b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:39.515922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-718b073f-9374-4eb8-af11-e597c5a2215b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:39.522755 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-718b073f-9374-4eb8-af11-e597c5a2215b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:39.523336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-718b073f-9374-4eb8-af11-e597c5a2215b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:39.523759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-718b073f-9374-4eb8-af11-e597c5a2215b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:39.524469 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-718b073f-9374-4eb8-af11-e597c5a2215b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:39.524921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-718b073f-9374-4eb8-af11-e597c5a2215b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:39.525343 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-718b073f-9374-4eb8-af11-e597c5a2215b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:39.652972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-718b073f-9374-4eb8-af11-e597c5a2215b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:39.660939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-718b073f-9374-4eb8-af11-e597c5a2215b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:39.662374 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-718b073f-9374-4eb8-af11-e597c5a2215b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:39.664220 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-718b073f-9374-4eb8-af11-e597c5a2215b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 200 len: 1407 microversion: 2.20 time: 0.153710 Aug 30 15:04:39.664787 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1066/2138] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:39 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:40.430411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-eb37cb18-9d43-42a0-9d74-5031cce67cac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:40.431025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-eb37cb18-9d43-42a0-9d74-5031cce67cac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:40.437413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eb37cb18-9d43-42a0-9d74-5031cce67cac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:40.438076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eb37cb18-9d43-42a0-9d74-5031cce67cac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:40.438511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eb37cb18-9d43-42a0-9d74-5031cce67cac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:40.439196 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eb37cb18-9d43-42a0-9d74-5031cce67cac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:40.439675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eb37cb18-9d43-42a0-9d74-5031cce67cac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:40.440095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eb37cb18-9d43-42a0-9d74-5031cce67cac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:40.570536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-eb37cb18-9d43-42a0-9d74-5031cce67cac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:40.579131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-eb37cb18-9d43-42a0-9d74-5031cce67cac tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.154098 Aug 30 15:04:40.579725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1073/2139] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:40 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:40.686429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d01cae3a-929f-4d5f-a283-ac632bd92256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:40.687044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d01cae3a-929f-4d5f-a283-ac632bd92256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:40.693398 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d01cae3a-929f-4d5f-a283-ac632bd92256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:40.693880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d01cae3a-929f-4d5f-a283-ac632bd92256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:40.694350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d01cae3a-929f-4d5f-a283-ac632bd92256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:40.695140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d01cae3a-929f-4d5f-a283-ac632bd92256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:40.695631 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d01cae3a-929f-4d5f-a283-ac632bd92256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:40.696052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d01cae3a-929f-4d5f-a283-ac632bd92256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:40.825886 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d01cae3a-929f-4d5f-a283-ac632bd92256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:40.833873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d01cae3a-929f-4d5f-a283-ac632bd92256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:40.836092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d01cae3a-929f-4d5f-a283-ac632bd92256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:40.837196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d01cae3a-929f-4d5f-a283-ac632bd92256 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 200 len: 1407 microversion: 2.20 time: 0.154644 Aug 30 15:04:40.837761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1067/2140] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:40 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:41.601131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-27ce214e-d3ea-473d-b690-df18835ed52f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:41.601768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-27ce214e-d3ea-473d-b690-df18835ed52f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:41.608166 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-27ce214e-d3ea-473d-b690-df18835ed52f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:41.608659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-27ce214e-d3ea-473d-b690-df18835ed52f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:41.609098 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-27ce214e-d3ea-473d-b690-df18835ed52f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:41.609794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-27ce214e-d3ea-473d-b690-df18835ed52f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:41.610253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-27ce214e-d3ea-473d-b690-df18835ed52f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:41.610678 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-27ce214e-d3ea-473d-b690-df18835ed52f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:41.740776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-27ce214e-d3ea-473d-b690-df18835ed52f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:41.749669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-27ce214e-d3ea-473d-b690-df18835ed52f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153070 Aug 30 15:04:41.750236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1074/2141] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:41 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:41.859119 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9cad9fc4-3c27-4042-b5f1-db1d4bc77367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:41.859767 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9cad9fc4-3c27-4042-b5f1-db1d4bc77367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:41.866043 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9cad9fc4-3c27-4042-b5f1-db1d4bc77367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:41.867249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9cad9fc4-3c27-4042-b5f1-db1d4bc77367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:41.867689 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9cad9fc4-3c27-4042-b5f1-db1d4bc77367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:41.868369 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9cad9fc4-3c27-4042-b5f1-db1d4bc77367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:41.868820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9cad9fc4-3c27-4042-b5f1-db1d4bc77367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:41.869241 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9cad9fc4-3c27-4042-b5f1-db1d4bc77367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:41.999008 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9cad9fc4-3c27-4042-b5f1-db1d4bc77367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:42.007565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9cad9fc4-3c27-4042-b5f1-db1d4bc77367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:42.009011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9cad9fc4-3c27-4042-b5f1-db1d4bc77367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:42.010128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9cad9fc4-3c27-4042-b5f1-db1d4bc77367 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 200 len: 1407 microversion: 2.20 time: 0.154942 Aug 30 15:04:42.010693 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1068/2142] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:41 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:42.770370 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ff40c30a-9f9e-44b9-97b2-e9f4f451d771 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:42.770922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ff40c30a-9f9e-44b9-97b2-e9f4f451d771 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:42.777437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ff40c30a-9f9e-44b9-97b2-e9f4f451d771 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:42.777922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ff40c30a-9f9e-44b9-97b2-e9f4f451d771 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:42.778358 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ff40c30a-9f9e-44b9-97b2-e9f4f451d771 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:42.779046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ff40c30a-9f9e-44b9-97b2-e9f4f451d771 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:42.779530 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ff40c30a-9f9e-44b9-97b2-e9f4f451d771 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:42.779956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ff40c30a-9f9e-44b9-97b2-e9f4f451d771 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:42.908968 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ff40c30a-9f9e-44b9-97b2-e9f4f451d771 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:42.917225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ff40c30a-9f9e-44b9-97b2-e9f4f451d771 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150799 Aug 30 15:04:42.917784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1075/2143] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:42 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:43.033404 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e6a15cce-ac39-47e5-a55d-e8f4416cd897 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:43.033922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e6a15cce-ac39-47e5-a55d-e8f4416cd897 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:43.041032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6a15cce-ac39-47e5-a55d-e8f4416cd897 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:43.041497 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6a15cce-ac39-47e5-a55d-e8f4416cd897 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:43.041920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6a15cce-ac39-47e5-a55d-e8f4416cd897 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:43.042593 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6a15cce-ac39-47e5-a55d-e8f4416cd897 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:43.043032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6a15cce-ac39-47e5-a55d-e8f4416cd897 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:43.043481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6a15cce-ac39-47e5-a55d-e8f4416cd897 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:43.170900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e6a15cce-ac39-47e5-a55d-e8f4416cd897 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:43.179673 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e6a15cce-ac39-47e5-a55d-e8f4416cd897 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:43.181273 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e6a15cce-ac39-47e5-a55d-e8f4416cd897 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:43.182376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e6a15cce-ac39-47e5-a55d-e8f4416cd897 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 200 len: 1407 microversion: 2.20 time: 0.153029 Aug 30 15:04:43.182925 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1069/2144] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:43 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:43.938570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5319a0fc-946f-4df3-a380-95e7ee0b0636 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:43.939234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5319a0fc-946f-4df3-a380-95e7ee0b0636 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:43.946421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5319a0fc-946f-4df3-a380-95e7ee0b0636 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:43.946912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5319a0fc-946f-4df3-a380-95e7ee0b0636 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:43.947636 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5319a0fc-946f-4df3-a380-95e7ee0b0636 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:43.948331 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5319a0fc-946f-4df3-a380-95e7ee0b0636 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:43.948784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5319a0fc-946f-4df3-a380-95e7ee0b0636 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:43.949206 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5319a0fc-946f-4df3-a380-95e7ee0b0636 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:44.084466 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5319a0fc-946f-4df3-a380-95e7ee0b0636 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:44.093482 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5319a0fc-946f-4df3-a380-95e7ee0b0636 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.158698 Aug 30 15:04:44.094063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1076/2145] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:43 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:44.168362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-a1938d61-bb84-426d-a979-e30daaab8102 req-d1fd86cb-e922-45b5-b871-d74fe5396b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88427e0-8903-470e-b463-fa8fe9b645b3", "name": "network-vif-plugged", "status": "completed", "tag": "363010d9-43ef-4930-8d87-4410b516872c"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:04:44.177900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a1938d61-bb84-426d-a979-e30daaab8102 req-d1fd86cb-e922-45b5-b871-d74fe5396b65 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:44.178362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a1938d61-bb84-426d-a979-e30daaab8102 req-d1fd86cb-e922-45b5-b871-d74fe5396b65 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:44.179485 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a1938d61-bb84-426d-a979-e30daaab8102 req-d1fd86cb-e922-45b5-b871-d74fe5396b65 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:44.190676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-a1938d61-bb84-426d-a979-e30daaab8102 req-d1fd86cb-e922-45b5-b871-d74fe5396b65 service nova] Creating event network-vif-plugged:363010d9-43ef-4930-8d87-4410b516872c for instance a88427e0-8903-470e-b463-fa8fe9b645b3 on hv-cinder-82880 Aug 30 15:04:44.196323 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-a1938d61-bb84-426d-a979-e30daaab8102 req-d1fd86cb-e922-45b5-b871-d74fe5396b65 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087926 Aug 30 15:04:44.196905 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1070/2146] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:04:44.204054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-989a8ae4-426c-42bb-b6ce-eb785b54fa8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:44.204661 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-989a8ae4-426c-42bb-b6ce-eb785b54fa8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:44.211457 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-989a8ae4-426c-42bb-b6ce-eb785b54fa8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:44.212353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-989a8ae4-426c-42bb-b6ce-eb785b54fa8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:44.212353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-989a8ae4-426c-42bb-b6ce-eb785b54fa8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:44.213088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-989a8ae4-426c-42bb-b6ce-eb785b54fa8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:44.213533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-989a8ae4-426c-42bb-b6ce-eb785b54fa8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:44.213974 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-989a8ae4-426c-42bb-b6ce-eb785b54fa8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:44.349148 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-989a8ae4-426c-42bb-b6ce-eb785b54fa8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:44.358112 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-989a8ae4-426c-42bb-b6ce-eb785b54fa8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:44.359675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-989a8ae4-426c-42bb-b6ce-eb785b54fa8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:44.360856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-989a8ae4-426c-42bb-b6ce-eb785b54fa8d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 200 len: 1407 microversion: 2.20 time: 0.160609 Aug 30 15:04:44.361497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1077/2147] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:44 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:45.114197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3d1cceba-4f0c-4e17-af17-35317dc392ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:45.114889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3d1cceba-4f0c-4e17-af17-35317dc392ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:45.122176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d1cceba-4f0c-4e17-af17-35317dc392ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:45.122651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d1cceba-4f0c-4e17-af17-35317dc392ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:45.123111 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d1cceba-4f0c-4e17-af17-35317dc392ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:45.123809 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d1cceba-4f0c-4e17-af17-35317dc392ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:45.124253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d1cceba-4f0c-4e17-af17-35317dc392ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:45.124666 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d1cceba-4f0c-4e17-af17-35317dc392ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:45.252354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3d1cceba-4f0c-4e17-af17-35317dc392ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:45.261078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3d1cceba-4f0c-4e17-af17-35317dc392ce tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151017 Aug 30 15:04:45.261644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1071/2148] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:45 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:04:45.383718 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-24ab7a3f-e15a-428e-af65-2e744d97ea5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:45.384332 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-24ab7a3f-e15a-428e-af65-2e744d97ea5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:45.390717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24ab7a3f-e15a-428e-af65-2e744d97ea5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:45.391197 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24ab7a3f-e15a-428e-af65-2e744d97ea5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:45.391669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24ab7a3f-e15a-428e-af65-2e744d97ea5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:45.392353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24ab7a3f-e15a-428e-af65-2e744d97ea5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:45.392800 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24ab7a3f-e15a-428e-af65-2e744d97ea5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:45.393223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24ab7a3f-e15a-428e-af65-2e744d97ea5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:45.525822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-24ab7a3f-e15a-428e-af65-2e744d97ea5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:45.529262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=100 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:45.534250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-24ab7a3f-e15a-428e-af65-2e744d97ea5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:45.535780 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-24ab7a3f-e15a-428e-af65-2e744d97ea5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:45.536840 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-24ab7a3f-e15a-428e-af65-2e744d97ea5a tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 200 len: 1407 microversion: 2.20 time: 0.157045 Aug 30 15:04:45.537392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1078/2149] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:45 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:46.281853 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ded855b9-7e4b-41df-b035-ebc60a4b7e75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:46.282466 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ded855b9-7e4b-41df-b035-ebc60a4b7e75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:46.284486 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:46.285245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=10 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:46.291866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ded855b9-7e4b-41df-b035-ebc60a4b7e75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:46.292353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ded855b9-7e4b-41df-b035-ebc60a4b7e75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:46.292795 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ded855b9-7e4b-41df-b035-ebc60a4b7e75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:46.293491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ded855b9-7e4b-41df-b035-ebc60a4b7e75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:46.293940 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ded855b9-7e4b-41df-b035-ebc60a4b7e75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:46.294365 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ded855b9-7e4b-41df-b035-ebc60a4b7e75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:46.427515 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ded855b9-7e4b-41df-b035-ebc60a4b7e75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:46.436436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ded855b9-7e4b-41df-b035-ebc60a4b7e75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.158431 Aug 30 15:04:46.437006 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1072/2150] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:46 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:46.560336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bd90a755-9346-4103-832a-17aa0a23b8ea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:46.560982 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bd90a755-9346-4103-832a-17aa0a23b8ea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:46.563123 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:46.569001 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd90a755-9346-4103-832a-17aa0a23b8ea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:46.570081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd90a755-9346-4103-832a-17aa0a23b8ea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:46.570511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd90a755-9346-4103-832a-17aa0a23b8ea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:46.571199 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd90a755-9346-4103-832a-17aa0a23b8ea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:46.571702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd90a755-9346-4103-832a-17aa0a23b8ea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:46.572126 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bd90a755-9346-4103-832a-17aa0a23b8ea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:46.699971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bd90a755-9346-4103-832a-17aa0a23b8ea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:46.707865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bd90a755-9346-4103-832a-17aa0a23b8ea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:46.709308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bd90a755-9346-4103-832a-17aa0a23b8ea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:46.710463 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bd90a755-9346-4103-832a-17aa0a23b8ea tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 200 len: 1598 microversion: 2.20 time: 0.154085 Aug 30 15:04:46.711011 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1079/2151] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:04:46 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 1598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:04:46.732322 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-28c72098-dbd2-44fc-bac1-6060f12ac12d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:46.732772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-28c72098-dbd2-44fc-bac1-6060f12ac12d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:46.738487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28c72098-dbd2-44fc-bac1-6060f12ac12d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:46.738955 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28c72098-dbd2-44fc-bac1-6060f12ac12d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:46.739430 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28c72098-dbd2-44fc-bac1-6060f12ac12d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:46.740106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28c72098-dbd2-44fc-bac1-6060f12ac12d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:46.740552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28c72098-dbd2-44fc-bac1-6060f12ac12d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:46.741894 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28c72098-dbd2-44fc-bac1-6060f12ac12d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:46.816960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-28c72098-dbd2-44fc-bac1-6060f12ac12d tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088686 Aug 30 15:04:46.817546 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1073/2152] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Aug 30 15:04:46 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:04:47.457866 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6f79f0f7-6084-4a96-b98b-79ce1818ffba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:47.458397 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6f79f0f7-6084-4a96-b98b-79ce1818ffba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:47.465058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f79f0f7-6084-4a96-b98b-79ce1818ffba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:47.465459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f79f0f7-6084-4a96-b98b-79ce1818ffba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:47.465895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f79f0f7-6084-4a96-b98b-79ce1818ffba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:47.466595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f79f0f7-6084-4a96-b98b-79ce1818ffba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:47.467045 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f79f0f7-6084-4a96-b98b-79ce1818ffba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:47.467495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6f79f0f7-6084-4a96-b98b-79ce1818ffba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:47.595555 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6f79f0f7-6084-4a96-b98b-79ce1818ffba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:47.603796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6f79f0f7-6084-4a96-b98b-79ce1818ffba tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149834 Aug 30 15:04:47.604364 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1080/2153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:47 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:47.730554 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-a8330df5-fa5c-4689-99f5-23e520853b5e req-fe27b673-7398-4ec9-a038-ea22452e4290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a88427e0-8903-470e-b463-fa8fe9b645b3", "tag": "363010d9-43ef-4930-8d87-4410b516872c"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:04:47.740554 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a8330df5-fa5c-4689-99f5-23e520853b5e req-fe27b673-7398-4ec9-a038-ea22452e4290 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:47.741132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a8330df5-fa5c-4689-99f5-23e520853b5e req-fe27b673-7398-4ec9-a038-ea22452e4290 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:47.741823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a8330df5-fa5c-4689-99f5-23e520853b5e req-fe27b673-7398-4ec9-a038-ea22452e4290 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:47.752834 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-a8330df5-fa5c-4689-99f5-23e520853b5e req-fe27b673-7398-4ec9-a038-ea22452e4290 service nova] Creating event network-changed:363010d9-43ef-4930-8d87-4410b516872c for instance a88427e0-8903-470e-b463-fa8fe9b645b3 on hv-cinder-82880 Aug 30 15:04:47.758718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-a8330df5-fa5c-4689-99f5-23e520853b5e req-fe27b673-7398-4ec9-a038-ea22452e4290 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032296 Aug 30 15:04:47.759590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1074/2154] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:04:48.624705 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-516999e1-add4-443d-baad-fd38e0fb804b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:48.625574 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-516999e1-add4-443d-baad-fd38e0fb804b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:48.632299 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-516999e1-add4-443d-baad-fd38e0fb804b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:48.632792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-516999e1-add4-443d-baad-fd38e0fb804b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:48.633225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-516999e1-add4-443d-baad-fd38e0fb804b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:48.633924 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-516999e1-add4-443d-baad-fd38e0fb804b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:48.634377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-516999e1-add4-443d-baad-fd38e0fb804b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:48.634789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-516999e1-add4-443d-baad-fd38e0fb804b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:48.770294 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-516999e1-add4-443d-baad-fd38e0fb804b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:48.781827 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-516999e1-add4-443d-baad-fd38e0fb804b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.160984 Aug 30 15:04:48.782408 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1081/2155] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:48 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:49.803437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-99d155fa-edde-4a87-9822-7bfd2839d073 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:49.804394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-99d155fa-edde-4a87-9822-7bfd2839d073 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:49.811309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99d155fa-edde-4a87-9822-7bfd2839d073 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:49.811798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99d155fa-edde-4a87-9822-7bfd2839d073 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:49.812293 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99d155fa-edde-4a87-9822-7bfd2839d073 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:49.813281 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99d155fa-edde-4a87-9822-7bfd2839d073 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:49.813566 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99d155fa-edde-4a87-9822-7bfd2839d073 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:49.813997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99d155fa-edde-4a87-9822-7bfd2839d073 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:49.941362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-99d155fa-edde-4a87-9822-7bfd2839d073 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:49.950297 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-99d155fa-edde-4a87-9822-7bfd2839d073 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151740 Aug 30 15:04:49.950868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1075/2156] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:49 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:50.971726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e29d7bc7-8452-46d7-a24f-b014e6692082 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:50.972376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e29d7bc7-8452-46d7-a24f-b014e6692082 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:50.979327 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e29d7bc7-8452-46d7-a24f-b014e6692082 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:50.979816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e29d7bc7-8452-46d7-a24f-b014e6692082 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:50.980255 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e29d7bc7-8452-46d7-a24f-b014e6692082 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:50.980946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e29d7bc7-8452-46d7-a24f-b014e6692082 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:50.981403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e29d7bc7-8452-46d7-a24f-b014e6692082 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:50.981830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e29d7bc7-8452-46d7-a24f-b014e6692082 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:51.111668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e29d7bc7-8452-46d7-a24f-b014e6692082 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:51.120050 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e29d7bc7-8452-46d7-a24f-b014e6692082 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152241 Aug 30 15:04:51.120620 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1082/2157] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:50 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:52.140775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1345b822-589e-4e92-a8f6-a147a3a461d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:52.141386 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1345b822-589e-4e92-a8f6-a147a3a461d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:52.147503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1345b822-589e-4e92-a8f6-a147a3a461d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:52.147990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1345b822-589e-4e92-a8f6-a147a3a461d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:52.148426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1345b822-589e-4e92-a8f6-a147a3a461d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:52.149110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1345b822-589e-4e92-a8f6-a147a3a461d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:52.149563 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1345b822-589e-4e92-a8f6-a147a3a461d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:52.149987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1345b822-589e-4e92-a8f6-a147a3a461d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:52.168276 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:52.279970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1345b822-589e-4e92-a8f6-a147a3a461d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:52.288701 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1345b822-589e-4e92-a8f6-a147a3a461d6 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151852 Aug 30 15:04:52.289268 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1076/2158] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:52 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:53.309561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-aa8df1eb-cd30-4e19-811c-5ba98a228099 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:53.310181 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-aa8df1eb-cd30-4e19-811c-5ba98a228099 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:53.316604 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aa8df1eb-cd30-4e19-811c-5ba98a228099 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:53.317088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aa8df1eb-cd30-4e19-811c-5ba98a228099 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:53.317521 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aa8df1eb-cd30-4e19-811c-5ba98a228099 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:53.318202 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aa8df1eb-cd30-4e19-811c-5ba98a228099 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:53.318657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aa8df1eb-cd30-4e19-811c-5ba98a228099 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:53.319124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-aa8df1eb-cd30-4e19-811c-5ba98a228099 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:53.444315 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-aa8df1eb-cd30-4e19-811c-5ba98a228099 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:53.452776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-aa8df1eb-cd30-4e19-811c-5ba98a228099 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147058 Aug 30 15:04:53.453342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1083/2159] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:53 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:54.473822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-72f1afc2-6fdb-4aa1-85a6-5684a88a7837 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:54.474351 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-72f1afc2-6fdb-4aa1-85a6-5684a88a7837 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:54.481316 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72f1afc2-6fdb-4aa1-85a6-5684a88a7837 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:54.481797 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72f1afc2-6fdb-4aa1-85a6-5684a88a7837 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:54.482228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72f1afc2-6fdb-4aa1-85a6-5684a88a7837 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:54.482904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72f1afc2-6fdb-4aa1-85a6-5684a88a7837 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:54.483384 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72f1afc2-6fdb-4aa1-85a6-5684a88a7837 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:54.483807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72f1afc2-6fdb-4aa1-85a6-5684a88a7837 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:54.612087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-72f1afc2-6fdb-4aa1-85a6-5684a88a7837 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:54.620910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-72f1afc2-6fdb-4aa1-85a6-5684a88a7837 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150996 Aug 30 15:04:54.621479 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1077/2160] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:54 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:55.641059 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7fc1904a-b41d-4789-8fa6-d3c47be0b339 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:55.641673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7fc1904a-b41d-4789-8fa6-d3c47be0b339 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:55.644048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=56 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:55.650066 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7fc1904a-b41d-4789-8fa6-d3c47be0b339 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:55.650544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7fc1904a-b41d-4789-8fa6-d3c47be0b339 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:55.651014 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7fc1904a-b41d-4789-8fa6-d3c47be0b339 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:55.651731 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7fc1904a-b41d-4789-8fa6-d3c47be0b339 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:55.652182 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7fc1904a-b41d-4789-8fa6-d3c47be0b339 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:55.652595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7fc1904a-b41d-4789-8fa6-d3c47be0b339 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:55.785639 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7fc1904a-b41d-4789-8fa6-d3c47be0b339 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:55.794580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7fc1904a-b41d-4789-8fa6-d3c47be0b339 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.157439 Aug 30 15:04:55.795135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1084/2161] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:55 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:56.816466 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f39ab617-abe4-44be-a482-a2126fd3d175 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:56.817076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f39ab617-abe4-44be-a482-a2126fd3d175 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:56.820232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:04:56.826442 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f39ab617-abe4-44be-a482-a2126fd3d175 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:56.826927 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f39ab617-abe4-44be-a482-a2126fd3d175 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:56.827404 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f39ab617-abe4-44be-a482-a2126fd3d175 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:56.828093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f39ab617-abe4-44be-a482-a2126fd3d175 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:56.828540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f39ab617-abe4-44be-a482-a2126fd3d175 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:56.828960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f39ab617-abe4-44be-a482-a2126fd3d175 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:56.960242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f39ab617-abe4-44be-a482-a2126fd3d175 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:56.968429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f39ab617-abe4-44be-a482-a2126fd3d175 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.155904 Aug 30 15:04:56.968994 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1078/2162] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:56 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:57.988872 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b50a0987-261c-4638-9334-ea265b835016 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:57.989487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b50a0987-261c-4638-9334-ea265b835016 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:57.996724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b50a0987-261c-4638-9334-ea265b835016 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:57.997209 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b50a0987-261c-4638-9334-ea265b835016 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:57.997647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b50a0987-261c-4638-9334-ea265b835016 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:57.998337 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b50a0987-261c-4638-9334-ea265b835016 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:57.998790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b50a0987-261c-4638-9334-ea265b835016 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:57.999225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b50a0987-261c-4638-9334-ea265b835016 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:58.127863 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b50a0987-261c-4638-9334-ea265b835016 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:58.136036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b50a0987-261c-4638-9334-ea265b835016 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151085 Aug 30 15:04:58.136606 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1085/2163] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:57 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:04:59.157187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-04eae0f8-c550-4a7a-b930-94d222938586 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:04:59.157712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-04eae0f8-c550-4a7a-b930-94d222938586 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:04:59.164275 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04eae0f8-c550-4a7a-b930-94d222938586 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:59.164743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04eae0f8-c550-4a7a-b930-94d222938586 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:59.165168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04eae0f8-c550-4a7a-b930-94d222938586 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:59.165839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04eae0f8-c550-4a7a-b930-94d222938586 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:04:59.166277 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04eae0f8-c550-4a7a-b930-94d222938586 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:04:59.166688 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04eae0f8-c550-4a7a-b930-94d222938586 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:04:59.294844 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-04eae0f8-c550-4a7a-b930-94d222938586 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:04:59.302995 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-04eae0f8-c550-4a7a-b930-94d222938586 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149729 Aug 30 15:04:59.304254 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1079/2164] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:04:59 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:00.325231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-69ce58ed-6deb-4818-a3b5-2c3b7f0d6d02 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:00.325872 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-69ce58ed-6deb-4818-a3b5-2c3b7f0d6d02 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:00.328359 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:05:00.328508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:05:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 (ip 10.222.0.30) !!! Aug 30 15:05:00.329466 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:05:00.329615 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:05:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 (ip 10.222.0.30) !!! Aug 30 15:05:00.330432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:05:00.330555 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:05:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 (ip 10.222.0.30) !!! Aug 30 15:05:00.338287 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69ce58ed-6deb-4818-a3b5-2c3b7f0d6d02 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:00.338767 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69ce58ed-6deb-4818-a3b5-2c3b7f0d6d02 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:00.339201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69ce58ed-6deb-4818-a3b5-2c3b7f0d6d02 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:00.339917 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69ce58ed-6deb-4818-a3b5-2c3b7f0d6d02 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:00.340366 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69ce58ed-6deb-4818-a3b5-2c3b7f0d6d02 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:00.340786 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-69ce58ed-6deb-4818-a3b5-2c3b7f0d6d02 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:00.466905 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-69ce58ed-6deb-4818-a3b5-2c3b7f0d6d02 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:00.474990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-69ce58ed-6deb-4818-a3b5-2c3b7f0d6d02 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153884 Aug 30 15:05:00.475582 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1086/2165] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:00 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:01.496225 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a55ebd36-f58d-431c-83b5-c8d2e171bf6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:01.496761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a55ebd36-f58d-431c-83b5-c8d2e171bf6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:01.503601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a55ebd36-f58d-431c-83b5-c8d2e171bf6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:01.504082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a55ebd36-f58d-431c-83b5-c8d2e171bf6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:01.504615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a55ebd36-f58d-431c-83b5-c8d2e171bf6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:01.505405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a55ebd36-f58d-431c-83b5-c8d2e171bf6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:01.505960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a55ebd36-f58d-431c-83b5-c8d2e171bf6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:01.506453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a55ebd36-f58d-431c-83b5-c8d2e171bf6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:01.632519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a55ebd36-f58d-431c-83b5-c8d2e171bf6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:01.640647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a55ebd36-f58d-431c-83b5-c8d2e171bf6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148881 Aug 30 15:05:01.641213 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1080/2166] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:01 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:02.661242 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f78ef165-3f14-4d0c-9412-b3bcbf988b7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:02.661862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f78ef165-3f14-4d0c-9412-b3bcbf988b7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:02.668912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f78ef165-3f14-4d0c-9412-b3bcbf988b7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:02.669400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f78ef165-3f14-4d0c-9412-b3bcbf988b7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:02.669841 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f78ef165-3f14-4d0c-9412-b3bcbf988b7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:02.670537 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f78ef165-3f14-4d0c-9412-b3bcbf988b7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:02.670995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f78ef165-3f14-4d0c-9412-b3bcbf988b7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:02.671443 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f78ef165-3f14-4d0c-9412-b3bcbf988b7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:02.801172 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f78ef165-3f14-4d0c-9412-b3bcbf988b7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:02.809497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f78ef165-3f14-4d0c-9412-b3bcbf988b7b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152185 Aug 30 15:05:02.810057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1087/2167] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:02 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:03.829834 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-59147dea-3666-44c2-a453-65c074985eb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:03.830443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-59147dea-3666-44c2-a453-65c074985eb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:03.837240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59147dea-3666-44c2-a453-65c074985eb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:03.837995 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59147dea-3666-44c2-a453-65c074985eb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:03.838426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59147dea-3666-44c2-a453-65c074985eb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:03.839093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59147dea-3666-44c2-a453-65c074985eb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:03.839644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59147dea-3666-44c2-a453-65c074985eb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:03.840059 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59147dea-3666-44c2-a453-65c074985eb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:03.970782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-59147dea-3666-44c2-a453-65c074985eb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:03.979782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-59147dea-3666-44c2-a453-65c074985eb2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153818 Aug 30 15:05:03.980346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1081/2168] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:03 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:05.009119 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-dd4dadea-518b-43d7-a543-055d9a76b032 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:05.009734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-dd4dadea-518b-43d7-a543-055d9a76b032 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:05.016083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dd4dadea-518b-43d7-a543-055d9a76b032 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:05.016569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dd4dadea-518b-43d7-a543-055d9a76b032 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:05.017003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dd4dadea-518b-43d7-a543-055d9a76b032 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:05.017691 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dd4dadea-518b-43d7-a543-055d9a76b032 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:05.018148 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dd4dadea-518b-43d7-a543-055d9a76b032 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:05.018571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dd4dadea-518b-43d7-a543-055d9a76b032 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:05.144018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-dd4dadea-518b-43d7-a543-055d9a76b032 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:05.152107 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-dd4dadea-518b-43d7-a543-055d9a76b032 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148015 Aug 30 15:05:05.152714 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1088/2169] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:05 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:06.173071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-514c03a4-8bd7-4563-a260-fb969154551c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:06.173704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-514c03a4-8bd7-4563-a260-fb969154551c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:06.180676 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-514c03a4-8bd7-4563-a260-fb969154551c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:06.181143 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-514c03a4-8bd7-4563-a260-fb969154551c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:06.181569 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-514c03a4-8bd7-4563-a260-fb969154551c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:06.182244 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-514c03a4-8bd7-4563-a260-fb969154551c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:06.182689 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-514c03a4-8bd7-4563-a260-fb969154551c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:06.183111 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-514c03a4-8bd7-4563-a260-fb969154551c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:06.309355 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-514c03a4-8bd7-4563-a260-fb969154551c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:06.317445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-514c03a4-8bd7-4563-a260-fb969154551c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148209 Aug 30 15:05:06.318014 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1082/2170] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:06 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:07.338714 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b46d15eb-f3a4-4211-a7d4-0584c7265e41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:07.339358 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b46d15eb-f3a4-4211-a7d4-0584c7265e41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:07.345804 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b46d15eb-f3a4-4211-a7d4-0584c7265e41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:07.346292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b46d15eb-f3a4-4211-a7d4-0584c7265e41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:07.346735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b46d15eb-f3a4-4211-a7d4-0584c7265e41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:07.347463 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b46d15eb-f3a4-4211-a7d4-0584c7265e41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:07.347923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b46d15eb-f3a4-4211-a7d4-0584c7265e41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:07.348349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b46d15eb-f3a4-4211-a7d4-0584c7265e41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:07.480980 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-b46d15eb-f3a4-4211-a7d4-0584c7265e41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:07.489146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b46d15eb-f3a4-4211-a7d4-0584c7265e41 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.154364 Aug 30 15:05:07.489712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1089/2171] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:07 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:08.511326 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e9b9ebdf-c3cf-4847-8b62-a1c8eeeb42c1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:08.511880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e9b9ebdf-c3cf-4847-8b62-a1c8eeeb42c1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:08.518325 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9b9ebdf-c3cf-4847-8b62-a1c8eeeb42c1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:08.518806 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9b9ebdf-c3cf-4847-8b62-a1c8eeeb42c1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:08.519279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9b9ebdf-c3cf-4847-8b62-a1c8eeeb42c1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:08.519963 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9b9ebdf-c3cf-4847-8b62-a1c8eeeb42c1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:08.520415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9b9ebdf-c3cf-4847-8b62-a1c8eeeb42c1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:08.520836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9b9ebdf-c3cf-4847-8b62-a1c8eeeb42c1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:08.653917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e9b9ebdf-c3cf-4847-8b62-a1c8eeeb42c1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:08.661991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e9b9ebdf-c3cf-4847-8b62-a1c8eeeb42c1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.155293 Aug 30 15:05:08.662560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1083/2172] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:08 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:05:09.683139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-dc8cdba0-b8e8-449b-94c6-90d687774a35 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:09.683779 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-dc8cdba0-b8e8-449b-94c6-90d687774a35 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:09.690454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc8cdba0-b8e8-449b-94c6-90d687774a35 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:09.690971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc8cdba0-b8e8-449b-94c6-90d687774a35 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:09.691512 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc8cdba0-b8e8-449b-94c6-90d687774a35 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:09.692205 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc8cdba0-b8e8-449b-94c6-90d687774a35 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:09.692658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc8cdba0-b8e8-449b-94c6-90d687774a35 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:09.693085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-dc8cdba0-b8e8-449b-94c6-90d687774a35 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:09.826318 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-dc8cdba0-b8e8-449b-94c6-90d687774a35 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:09.834457 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-dc8cdba0-b8e8-449b-94c6-90d687774a35 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.155266 Aug 30 15:05:09.835040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1090/2173] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:09 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:10.857749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-29feda23-75d3-442e-a394-1e089b88d6d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:10.858368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-29feda23-75d3-442e-a394-1e089b88d6d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:10.864789 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29feda23-75d3-442e-a394-1e089b88d6d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:10.865264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29feda23-75d3-442e-a394-1e089b88d6d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:10.865691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29feda23-75d3-442e-a394-1e089b88d6d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:10.866363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29feda23-75d3-442e-a394-1e089b88d6d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:10.866817 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29feda23-75d3-442e-a394-1e089b88d6d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:10.867236 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-29feda23-75d3-442e-a394-1e089b88d6d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:10.995148 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-29feda23-75d3-442e-a394-1e089b88d6d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:11.003272 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-29feda23-75d3-442e-a394-1e089b88d6d5 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149557 Aug 30 15:05:11.003847 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1084/2174] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:10 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:12.023991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-32cc08de-fc41-425b-a21b-df9c20fe9f2a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:12.024834 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-32cc08de-fc41-425b-a21b-df9c20fe9f2a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:12.031317 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32cc08de-fc41-425b-a21b-df9c20fe9f2a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:12.031794 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32cc08de-fc41-425b-a21b-df9c20fe9f2a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:12.032228 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32cc08de-fc41-425b-a21b-df9c20fe9f2a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:12.032908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32cc08de-fc41-425b-a21b-df9c20fe9f2a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:12.033360 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32cc08de-fc41-425b-a21b-df9c20fe9f2a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:12.033779 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-32cc08de-fc41-425b-a21b-df9c20fe9f2a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:12.161787 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-32cc08de-fc41-425b-a21b-df9c20fe9f2a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:12.170476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-32cc08de-fc41-425b-a21b-df9c20fe9f2a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150299 Aug 30 15:05:12.171049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1091/2175] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:12 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:13.191694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-883cf900-2e12-48ab-b2c4-fa04f1d7e171 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:13.192300 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-883cf900-2e12-48ab-b2c4-fa04f1d7e171 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:13.199524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-883cf900-2e12-48ab-b2c4-fa04f1d7e171 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:13.199997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-883cf900-2e12-48ab-b2c4-fa04f1d7e171 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:13.200422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-883cf900-2e12-48ab-b2c4-fa04f1d7e171 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:13.201096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-883cf900-2e12-48ab-b2c4-fa04f1d7e171 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:13.201538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-883cf900-2e12-48ab-b2c4-fa04f1d7e171 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:13.201951 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-883cf900-2e12-48ab-b2c4-fa04f1d7e171 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:13.327743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-883cf900-2e12-48ab-b2c4-fa04f1d7e171 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:13.335839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-883cf900-2e12-48ab-b2c4-fa04f1d7e171 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148118 Aug 30 15:05:13.336395 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1085/2176] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:13 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:14.356434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6ee9d189-99bd-46e6-a5fc-b8819c503e72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:14.357042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6ee9d189-99bd-46e6-a5fc-b8819c503e72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:14.363596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6ee9d189-99bd-46e6-a5fc-b8819c503e72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:14.364110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6ee9d189-99bd-46e6-a5fc-b8819c503e72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:14.364545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6ee9d189-99bd-46e6-a5fc-b8819c503e72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:14.365235 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6ee9d189-99bd-46e6-a5fc-b8819c503e72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:14.365686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6ee9d189-99bd-46e6-a5fc-b8819c503e72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:14.366133 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6ee9d189-99bd-46e6-a5fc-b8819c503e72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:14.492711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6ee9d189-99bd-46e6-a5fc-b8819c503e72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:14.501795 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6ee9d189-99bd-46e6-a5fc-b8819c503e72 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149215 Aug 30 15:05:14.502361 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1092/2177] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:14 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:15.524473 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f9f662b4-4161-4616-bca4-d251298f8231 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:15.525074 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f9f662b4-4161-4616-bca4-d251298f8231 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:15.531644 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9f662b4-4161-4616-bca4-d251298f8231 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:15.532007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9f662b4-4161-4616-bca4-d251298f8231 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:15.532441 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9f662b4-4161-4616-bca4-d251298f8231 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:15.533180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9f662b4-4161-4616-bca4-d251298f8231 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:15.533725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9f662b4-4161-4616-bca4-d251298f8231 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:15.534235 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9f662b4-4161-4616-bca4-d251298f8231 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:15.667228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f9f662b4-4161-4616-bca4-d251298f8231 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:15.675429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f9f662b4-4161-4616-bca4-d251298f8231 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.154809 Aug 30 15:05:15.675995 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1086/2178] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:15 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:16.697919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5338a9fa-5a52-429c-b4e0-d442011b9fa8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:16.698538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5338a9fa-5a52-429c-b4e0-d442011b9fa8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:16.704937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5338a9fa-5a52-429c-b4e0-d442011b9fa8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:16.705415 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5338a9fa-5a52-429c-b4e0-d442011b9fa8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:16.705845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5338a9fa-5a52-429c-b4e0-d442011b9fa8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:16.706523 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5338a9fa-5a52-429c-b4e0-d442011b9fa8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:16.706967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5338a9fa-5a52-429c-b4e0-d442011b9fa8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:16.707420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5338a9fa-5a52-429c-b4e0-d442011b9fa8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:16.709889 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=85 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:16.833908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5338a9fa-5a52-429c-b4e0-d442011b9fa8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:16.842016 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5338a9fa-5a52-429c-b4e0-d442011b9fa8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148871 Aug 30 15:05:16.842577 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1093/2179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:16 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:17.862598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cc7c900d-cf91-4a4f-a87a-86e2adf0a1a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:17.863231 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cc7c900d-cf91-4a4f-a87a-86e2adf0a1a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:17.870049 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc7c900d-cf91-4a4f-a87a-86e2adf0a1a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:17.870524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc7c900d-cf91-4a4f-a87a-86e2adf0a1a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:17.870956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc7c900d-cf91-4a4f-a87a-86e2adf0a1a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:17.871673 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc7c900d-cf91-4a4f-a87a-86e2adf0a1a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:17.872124 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc7c900d-cf91-4a4f-a87a-86e2adf0a1a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:17.872542 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cc7c900d-cf91-4a4f-a87a-86e2adf0a1a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:17.998943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cc7c900d-cf91-4a4f-a87a-86e2adf0a1a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:18.007030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cc7c900d-cf91-4a4f-a87a-86e2adf0a1a7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148291 Aug 30 15:05:18.007656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1087/2180] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:17 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:19.028707 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c0eaa2e0-2191-4439-a031-13326d9c9843 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:19.029297 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c0eaa2e0-2191-4439-a031-13326d9c9843 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:19.035609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0eaa2e0-2191-4439-a031-13326d9c9843 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:19.036085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0eaa2e0-2191-4439-a031-13326d9c9843 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:19.036513 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0eaa2e0-2191-4439-a031-13326d9c9843 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:19.037195 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0eaa2e0-2191-4439-a031-13326d9c9843 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:19.037642 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0eaa2e0-2191-4439-a031-13326d9c9843 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:19.038061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c0eaa2e0-2191-4439-a031-13326d9c9843 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:19.167898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c0eaa2e0-2191-4439-a031-13326d9c9843 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:19.175898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c0eaa2e0-2191-4439-a031-13326d9c9843 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151581 Aug 30 15:05:19.176458 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1094/2181] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:19 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:20.251522 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-543a437c-7aa4-4c67-9cfc-3d715808c092 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:20.252159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-543a437c-7aa4-4c67-9cfc-3d715808c092 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:20.258489 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-543a437c-7aa4-4c67-9cfc-3d715808c092 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:20.258971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-543a437c-7aa4-4c67-9cfc-3d715808c092 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:20.259445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-543a437c-7aa4-4c67-9cfc-3d715808c092 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:20.260120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-543a437c-7aa4-4c67-9cfc-3d715808c092 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:20.260565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-543a437c-7aa4-4c67-9cfc-3d715808c092 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:20.260988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-543a437c-7aa4-4c67-9cfc-3d715808c092 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:20.390341 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-543a437c-7aa4-4c67-9cfc-3d715808c092 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:20.398440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-543a437c-7aa4-4c67-9cfc-3d715808c092 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150808 Aug 30 15:05:20.399006 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1088/2182] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:20 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:21.419012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8a2d5e23-6fa3-4869-b1b8-52fd49d47ee9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:21.419661 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8a2d5e23-6fa3-4869-b1b8-52fd49d47ee9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:21.425858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a2d5e23-6fa3-4869-b1b8-52fd49d47ee9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:21.426342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a2d5e23-6fa3-4869-b1b8-52fd49d47ee9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:21.426782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a2d5e23-6fa3-4869-b1b8-52fd49d47ee9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:21.427528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a2d5e23-6fa3-4869-b1b8-52fd49d47ee9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:21.427972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a2d5e23-6fa3-4869-b1b8-52fd49d47ee9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:21.428398 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8a2d5e23-6fa3-4869-b1b8-52fd49d47ee9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:21.554157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8a2d5e23-6fa3-4869-b1b8-52fd49d47ee9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:21.563071 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8a2d5e23-6fa3-4869-b1b8-52fd49d47ee9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147908 Aug 30 15:05:21.563669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1095/2183] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:21 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:22.584524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c969dea4-2b5f-4dc6-86ad-64ff3dda8011 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:22.585135 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c969dea4-2b5f-4dc6-86ad-64ff3dda8011 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:22.591843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c969dea4-2b5f-4dc6-86ad-64ff3dda8011 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:22.592315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c969dea4-2b5f-4dc6-86ad-64ff3dda8011 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:22.592744 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c969dea4-2b5f-4dc6-86ad-64ff3dda8011 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:22.593422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c969dea4-2b5f-4dc6-86ad-64ff3dda8011 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:22.593869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c969dea4-2b5f-4dc6-86ad-64ff3dda8011 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:22.594286 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c969dea4-2b5f-4dc6-86ad-64ff3dda8011 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:22.598107 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=75 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:22.719004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c969dea4-2b5f-4dc6-86ad-64ff3dda8011 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:22.727092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c969dea4-2b5f-4dc6-86ad-64ff3dda8011 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.146608 Aug 30 15:05:22.727939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1089/2184] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:22 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:23.583081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7cf33729-4fa3-497e-a64f-efaa3930cb07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:23.583699 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7cf33729-4fa3-497e-a64f-efaa3930cb07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:23.590504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cf33729-4fa3-497e-a64f-efaa3930cb07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:23.590986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cf33729-4fa3-497e-a64f-efaa3930cb07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:23.591452 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cf33729-4fa3-497e-a64f-efaa3930cb07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:23.592142 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cf33729-4fa3-497e-a64f-efaa3930cb07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:23.592590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cf33729-4fa3-497e-a64f-efaa3930cb07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:23.593012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7cf33729-4fa3-497e-a64f-efaa3930cb07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:23.616407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7cf33729-4fa3-497e-a64f-efaa3930cb07 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3/ips" status: 200 len: 150 microversion: 2.20 time: 0.037215 Aug 30 15:05:23.616968 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1096/2185] 10.222.0.30 () {60 vars in 1289 bytes} [Tue Aug 30 15:05:23 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:05:23.747283 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a1207482-f8a8-4e40-8e6d-d22df0cab9fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:23.747902 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a1207482-f8a8-4e40-8e6d-d22df0cab9fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:23.754285 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1207482-f8a8-4e40-8e6d-d22df0cab9fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:23.754767 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1207482-f8a8-4e40-8e6d-d22df0cab9fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:23.755234 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1207482-f8a8-4e40-8e6d-d22df0cab9fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:23.755912 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1207482-f8a8-4e40-8e6d-d22df0cab9fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:23.756368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1207482-f8a8-4e40-8e6d-d22df0cab9fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:23.756792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1207482-f8a8-4e40-8e6d-d22df0cab9fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:23.889400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a1207482-f8a8-4e40-8e6d-d22df0cab9fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:23.897525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a1207482-f8a8-4e40-8e6d-d22df0cab9fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.154634 Aug 30 15:05:23.898100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1090/2186] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:23 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:24.918935 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bab47d61-7cad-4382-9094-454aab0695c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:24.919571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bab47d61-7cad-4382-9094-454aab0695c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:24.926132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bab47d61-7cad-4382-9094-454aab0695c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:24.926610 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bab47d61-7cad-4382-9094-454aab0695c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:24.927042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bab47d61-7cad-4382-9094-454aab0695c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:24.927761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bab47d61-7cad-4382-9094-454aab0695c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:24.928209 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bab47d61-7cad-4382-9094-454aab0695c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:24.928659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bab47d61-7cad-4382-9094-454aab0695c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:25.061517 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bab47d61-7cad-4382-9094-454aab0695c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:25.069635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bab47d61-7cad-4382-9094-454aab0695c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.155182 Aug 30 15:05:25.070206 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1097/2187] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:24 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:26.091041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e6f5bf69-0d0d-42dd-95ee-a616adecdc80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:26.091703 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e6f5bf69-0d0d-42dd-95ee-a616adecdc80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:26.097983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6f5bf69-0d0d-42dd-95ee-a616adecdc80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:26.098462 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6f5bf69-0d0d-42dd-95ee-a616adecdc80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:26.098898 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6f5bf69-0d0d-42dd-95ee-a616adecdc80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:26.099623 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6f5bf69-0d0d-42dd-95ee-a616adecdc80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:26.100058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6f5bf69-0d0d-42dd-95ee-a616adecdc80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:26.100479 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6f5bf69-0d0d-42dd-95ee-a616adecdc80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:26.226244 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e6f5bf69-0d0d-42dd-95ee-a616adecdc80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:26.235799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e6f5bf69-0d0d-42dd-95ee-a616adecdc80 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148485 Aug 30 15:05:26.236381 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1091/2188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:26 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:27.257157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fcf14fe0-fccc-4132-b80c-77eb6e2b1782 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:27.257769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fcf14fe0-fccc-4132-b80c-77eb6e2b1782 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:27.260813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=28 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:27.266263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fcf14fe0-fccc-4132-b80c-77eb6e2b1782 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:27.266740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fcf14fe0-fccc-4132-b80c-77eb6e2b1782 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:27.267169 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fcf14fe0-fccc-4132-b80c-77eb6e2b1782 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:27.267876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fcf14fe0-fccc-4132-b80c-77eb6e2b1782 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:27.268331 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fcf14fe0-fccc-4132-b80c-77eb6e2b1782 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:27.268738 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fcf14fe0-fccc-4132-b80c-77eb6e2b1782 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:27.396039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fcf14fe0-fccc-4132-b80c-77eb6e2b1782 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:27.404456 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fcf14fe0-fccc-4132-b80c-77eb6e2b1782 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151186 Aug 30 15:05:27.405018 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1098/2189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:27 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:28.425142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-090739e3-752f-4978-bcc7-b93f9bbd4aa0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:28.425772 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-090739e3-752f-4978-bcc7-b93f9bbd4aa0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:28.428076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=28 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:28.433362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-090739e3-752f-4978-bcc7-b93f9bbd4aa0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:28.433836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-090739e3-752f-4978-bcc7-b93f9bbd4aa0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:28.434271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-090739e3-752f-4978-bcc7-b93f9bbd4aa0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:28.434942 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-090739e3-752f-4978-bcc7-b93f9bbd4aa0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:28.435422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-090739e3-752f-4978-bcc7-b93f9bbd4aa0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:28.435840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-090739e3-752f-4978-bcc7-b93f9bbd4aa0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:28.562271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-090739e3-752f-4978-bcc7-b93f9bbd4aa0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:28.570279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-090739e3-752f-4978-bcc7-b93f9bbd4aa0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148978 Aug 30 15:05:28.570842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1092/2190] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:28 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:29.592260 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-efd312d2-0428-46ce-a49b-89722db9abfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:29.592913 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-efd312d2-0428-46ce-a49b-89722db9abfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:29.599313 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efd312d2-0428-46ce-a49b-89722db9abfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:29.599798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efd312d2-0428-46ce-a49b-89722db9abfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:29.600234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efd312d2-0428-46ce-a49b-89722db9abfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:29.600922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efd312d2-0428-46ce-a49b-89722db9abfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:29.601380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efd312d2-0428-46ce-a49b-89722db9abfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:29.601805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-efd312d2-0428-46ce-a49b-89722db9abfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:29.728754 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-efd312d2-0428-46ce-a49b-89722db9abfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:29.736900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-efd312d2-0428-46ce-a49b-89722db9abfe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148604 Aug 30 15:05:29.737473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1099/2191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:29 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:30.758242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-193cf9f6-2408-4302-9ebf-3d54829484d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:30.759050 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-193cf9f6-2408-4302-9ebf-3d54829484d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:30.766239 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-193cf9f6-2408-4302-9ebf-3d54829484d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:30.766712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-193cf9f6-2408-4302-9ebf-3d54829484d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:30.767140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-193cf9f6-2408-4302-9ebf-3d54829484d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:30.767846 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-193cf9f6-2408-4302-9ebf-3d54829484d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:30.768608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-193cf9f6-2408-4302-9ebf-3d54829484d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:30.769025 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-193cf9f6-2408-4302-9ebf-3d54829484d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:30.911972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-193cf9f6-2408-4302-9ebf-3d54829484d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:30.922804 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-193cf9f6-2408-4302-9ebf-3d54829484d8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.168837 Aug 30 15:05:30.923409 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1093/2192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:30 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:31.945789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2a7daafe-b16a-4bed-bee1-f60d68870d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:31.947062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2a7daafe-b16a-4bed-bee1-f60d68870d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:31.953825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a7daafe-b16a-4bed-bee1-f60d68870d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:31.954299 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a7daafe-b16a-4bed-bee1-f60d68870d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:31.954730 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a7daafe-b16a-4bed-bee1-f60d68870d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:31.955445 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a7daafe-b16a-4bed-bee1-f60d68870d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:31.955895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a7daafe-b16a-4bed-bee1-f60d68870d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:31.956311 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2a7daafe-b16a-4bed-bee1-f60d68870d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:32.084817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2a7daafe-b16a-4bed-bee1-f60d68870d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:32.092942 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2a7daafe-b16a-4bed-bee1-f60d68870d65 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151022 Aug 30 15:05:32.093505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1100/2193] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:31 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:33.113971 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-311c04e8-d840-4193-8aa0-f4a328990d5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:33.114581 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-311c04e8-d840-4193-8aa0-f4a328990d5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:33.121440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-311c04e8-d840-4193-8aa0-f4a328990d5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:33.121918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-311c04e8-d840-4193-8aa0-f4a328990d5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:33.122350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-311c04e8-d840-4193-8aa0-f4a328990d5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:33.123026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-311c04e8-d840-4193-8aa0-f4a328990d5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:33.123553 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-311c04e8-d840-4193-8aa0-f4a328990d5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:33.123973 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-311c04e8-d840-4193-8aa0-f4a328990d5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:33.251087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-311c04e8-d840-4193-8aa0-f4a328990d5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:33.259820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-311c04e8-d840-4193-8aa0-f4a328990d5d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149061 Aug 30 15:05:33.260383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1094/2194] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:33 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:34.281421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3bfd2371-c6a4-4954-8a72-3761ce7f965e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:34.282060 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3bfd2371-c6a4-4954-8a72-3761ce7f965e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:34.288592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3bfd2371-c6a4-4954-8a72-3761ce7f965e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:34.289109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3bfd2371-c6a4-4954-8a72-3761ce7f965e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:34.289546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3bfd2371-c6a4-4954-8a72-3761ce7f965e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:34.290981 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3bfd2371-c6a4-4954-8a72-3761ce7f965e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:34.291499 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3bfd2371-c6a4-4954-8a72-3761ce7f965e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:34.291929 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3bfd2371-c6a4-4954-8a72-3761ce7f965e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:34.419094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3bfd2371-c6a4-4954-8a72-3761ce7f965e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:34.427221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3bfd2371-c6a4-4954-8a72-3761ce7f965e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149752 Aug 30 15:05:34.427791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1101/2195] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:34 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:35.448069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-aef967e4-6eec-478d-a8e5-4973f94571be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:35.448677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-aef967e4-6eec-478d-a8e5-4973f94571be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:35.455041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aef967e4-6eec-478d-a8e5-4973f94571be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:35.455558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aef967e4-6eec-478d-a8e5-4973f94571be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:35.455994 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aef967e4-6eec-478d-a8e5-4973f94571be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:35.456677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aef967e4-6eec-478d-a8e5-4973f94571be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:35.457128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aef967e4-6eec-478d-a8e5-4973f94571be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:35.457550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aef967e4-6eec-478d-a8e5-4973f94571be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:35.592816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-aef967e4-6eec-478d-a8e5-4973f94571be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:35.600924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-aef967e4-6eec-478d-a8e5-4973f94571be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.156993 Aug 30 15:05:35.601490 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1095/2196] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:35 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:36.621908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-36192ac7-9078-4d1f-9f6a-cea2c7843c75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:36.622517 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-36192ac7-9078-4d1f-9f6a-cea2c7843c75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:36.629161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36192ac7-9078-4d1f-9f6a-cea2c7843c75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:36.629651 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36192ac7-9078-4d1f-9f6a-cea2c7843c75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:36.630093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36192ac7-9078-4d1f-9f6a-cea2c7843c75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:36.630781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36192ac7-9078-4d1f-9f6a-cea2c7843c75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:36.631264 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36192ac7-9078-4d1f-9f6a-cea2c7843c75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:36.631696 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36192ac7-9078-4d1f-9f6a-cea2c7843c75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:36.761204 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-36192ac7-9078-4d1f-9f6a-cea2c7843c75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:36.769308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-36192ac7-9078-4d1f-9f6a-cea2c7843c75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151285 Aug 30 15:05:36.769874 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1102/2197] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:36 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:37.789877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-214090a7-272f-42f8-a581-38ca226ddc75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:37.790486 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-214090a7-272f-42f8-a581-38ca226ddc75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:37.797778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-214090a7-272f-42f8-a581-38ca226ddc75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:37.798257 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-214090a7-272f-42f8-a581-38ca226ddc75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:37.798690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-214090a7-272f-42f8-a581-38ca226ddc75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:37.799412 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-214090a7-272f-42f8-a581-38ca226ddc75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:37.799865 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-214090a7-272f-42f8-a581-38ca226ddc75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:37.800289 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-214090a7-272f-42f8-a581-38ca226ddc75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:37.926840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-214090a7-272f-42f8-a581-38ca226ddc75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:37.935071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-214090a7-272f-42f8-a581-38ca226ddc75 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149122 Aug 30 15:05:37.935657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1096/2198] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:37 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:38.956066 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-93efc84f-302f-4b37-8ccb-8e156407a37a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:38.956683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-93efc84f-302f-4b37-8ccb-8e156407a37a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:38.963085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-93efc84f-302f-4b37-8ccb-8e156407a37a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:38.963698 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-93efc84f-302f-4b37-8ccb-8e156407a37a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:38.964139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-93efc84f-302f-4b37-8ccb-8e156407a37a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:38.964836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-93efc84f-302f-4b37-8ccb-8e156407a37a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:38.965293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-93efc84f-302f-4b37-8ccb-8e156407a37a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:38.965724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-93efc84f-302f-4b37-8ccb-8e156407a37a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:39.090939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-93efc84f-302f-4b37-8ccb-8e156407a37a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:39.099133 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-93efc84f-302f-4b37-8ccb-8e156407a37a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.146941 Aug 30 15:05:39.099726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1103/2199] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:38 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:40.121186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-631b384f-6a0c-49ae-af94-92d42a14f755 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:40.121793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-631b384f-6a0c-49ae-af94-92d42a14f755 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:40.128194 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-631b384f-6a0c-49ae-af94-92d42a14f755 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:40.128667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-631b384f-6a0c-49ae-af94-92d42a14f755 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:40.129095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-631b384f-6a0c-49ae-af94-92d42a14f755 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:40.129767 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-631b384f-6a0c-49ae-af94-92d42a14f755 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:40.130210 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-631b384f-6a0c-49ae-af94-92d42a14f755 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:40.130669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-631b384f-6a0c-49ae-af94-92d42a14f755 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:40.258879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-631b384f-6a0c-49ae-af94-92d42a14f755 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:40.267704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-631b384f-6a0c-49ae-af94-92d42a14f755 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151188 Aug 30 15:05:40.268271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1097/2200] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:40 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:41.288346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3978e209-ec3a-42b0-a3eb-29e635b4a621 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:41.288954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3978e209-ec3a-42b0-a3eb-29e635b4a621 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:41.296499 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3978e209-ec3a-42b0-a3eb-29e635b4a621 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:41.296979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3978e209-ec3a-42b0-a3eb-29e635b4a621 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:41.297411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3978e209-ec3a-42b0-a3eb-29e635b4a621 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:41.298093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3978e209-ec3a-42b0-a3eb-29e635b4a621 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:41.298534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3978e209-ec3a-42b0-a3eb-29e635b4a621 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:41.298949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3978e209-ec3a-42b0-a3eb-29e635b4a621 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:41.432022 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3978e209-ec3a-42b0-a3eb-29e635b4a621 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:41.440411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3978e209-ec3a-42b0-a3eb-29e635b4a621 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.156081 Aug 30 15:05:41.440979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1104/2201] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:41 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:42.460678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-31baf25c-0114-4772-a28b-04341c4ff88b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:42.461314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-31baf25c-0114-4772-a28b-04341c4ff88b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:42.467901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31baf25c-0114-4772-a28b-04341c4ff88b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:42.468323 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31baf25c-0114-4772-a28b-04341c4ff88b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:42.468754 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31baf25c-0114-4772-a28b-04341c4ff88b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:42.469428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31baf25c-0114-4772-a28b-04341c4ff88b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:42.469878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31baf25c-0114-4772-a28b-04341c4ff88b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:42.470293 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-31baf25c-0114-4772-a28b-04341c4ff88b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:42.604079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-31baf25c-0114-4772-a28b-04341c4ff88b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:42.612778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-31baf25c-0114-4772-a28b-04341c4ff88b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.155993 Aug 30 15:05:42.613589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1098/2202] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:42 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:43.634296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-00d50ee9-ac06-405b-bdf8-36db08ec492a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:43.634909 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-00d50ee9-ac06-405b-bdf8-36db08ec492a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:43.641387 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00d50ee9-ac06-405b-bdf8-36db08ec492a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:43.641866 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00d50ee9-ac06-405b-bdf8-36db08ec492a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:43.643231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00d50ee9-ac06-405b-bdf8-36db08ec492a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:43.643989 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00d50ee9-ac06-405b-bdf8-36db08ec492a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:43.644450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00d50ee9-ac06-405b-bdf8-36db08ec492a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:43.644878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00d50ee9-ac06-405b-bdf8-36db08ec492a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:43.770146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-00d50ee9-ac06-405b-bdf8-36db08ec492a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:43.778709 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-00d50ee9-ac06-405b-bdf8-36db08ec492a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148281 Aug 30 15:05:43.779275 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1105/2203] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:43 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:44.799753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c295b8db-2ada-46cb-bbb6-ebae9661c823 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:44.800407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c295b8db-2ada-46cb-bbb6-ebae9661c823 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:44.806681 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c295b8db-2ada-46cb-bbb6-ebae9661c823 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:44.807155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c295b8db-2ada-46cb-bbb6-ebae9661c823 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:44.807618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c295b8db-2ada-46cb-bbb6-ebae9661c823 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:44.808338 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c295b8db-2ada-46cb-bbb6-ebae9661c823 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:44.808944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c295b8db-2ada-46cb-bbb6-ebae9661c823 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:44.809367 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c295b8db-2ada-46cb-bbb6-ebae9661c823 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:44.937651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c295b8db-2ada-46cb-bbb6-ebae9661c823 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:44.946032 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c295b8db-2ada-46cb-bbb6-ebae9661c823 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150131 Aug 30 15:05:44.946608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1099/2204] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:44 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:45.967537 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f62633ad-a642-4b30-a3f8-2dc94a40b69e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:45.968195 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f62633ad-a642-4b30-a3f8-2dc94a40b69e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:45.974474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f62633ad-a642-4b30-a3f8-2dc94a40b69e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:45.974950 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f62633ad-a642-4b30-a3f8-2dc94a40b69e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:45.975421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f62633ad-a642-4b30-a3f8-2dc94a40b69e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:45.976098 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f62633ad-a642-4b30-a3f8-2dc94a40b69e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:45.976542 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f62633ad-a642-4b30-a3f8-2dc94a40b69e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:45.976960 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f62633ad-a642-4b30-a3f8-2dc94a40b69e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:46.101347 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f62633ad-a642-4b30-a3f8-2dc94a40b69e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:46.109963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f62633ad-a642-4b30-a3f8-2dc94a40b69e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.146413 Aug 30 15:05:46.110524 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1106/2205] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:45 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:47.131667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-68910b32-8eaf-4905-8ace-7b889279b2dc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:47.132298 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-68910b32-8eaf-4905-8ace-7b889279b2dc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:47.139214 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68910b32-8eaf-4905-8ace-7b889279b2dc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:47.139706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68910b32-8eaf-4905-8ace-7b889279b2dc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:47.140141 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68910b32-8eaf-4905-8ace-7b889279b2dc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:47.140819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68910b32-8eaf-4905-8ace-7b889279b2dc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:47.141268 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68910b32-8eaf-4905-8ace-7b889279b2dc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:47.141689 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68910b32-8eaf-4905-8ace-7b889279b2dc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:47.276274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-68910b32-8eaf-4905-8ace-7b889279b2dc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:47.285048 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-68910b32-8eaf-4905-8ace-7b889279b2dc tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.157776 Aug 30 15:05:47.285651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1100/2206] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:47 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:48.305898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a2d50a32-a706-469b-b7ed-83d80a64f024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:48.306506 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a2d50a32-a706-469b-b7ed-83d80a64f024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:48.313008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2d50a32-a706-469b-b7ed-83d80a64f024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:48.313486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2d50a32-a706-469b-b7ed-83d80a64f024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:48.313919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2d50a32-a706-469b-b7ed-83d80a64f024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:48.314596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2d50a32-a706-469b-b7ed-83d80a64f024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:48.315040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2d50a32-a706-469b-b7ed-83d80a64f024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:48.315508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a2d50a32-a706-469b-b7ed-83d80a64f024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:48.319345 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=82 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:48.445497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a2d50a32-a706-469b-b7ed-83d80a64f024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:48.453793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a2d50a32-a706-469b-b7ed-83d80a64f024 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151805 Aug 30 15:05:48.454352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1107/2207] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:48 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:49.475449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4672e254-d4be-4ce5-ad24-93af1f08409b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:49.475985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4672e254-d4be-4ce5-ad24-93af1f08409b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:49.483256 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4672e254-d4be-4ce5-ad24-93af1f08409b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:49.483730 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4672e254-d4be-4ce5-ad24-93af1f08409b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:49.484155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4672e254-d4be-4ce5-ad24-93af1f08409b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:49.484823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4672e254-d4be-4ce5-ad24-93af1f08409b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:49.485266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4672e254-d4be-4ce5-ad24-93af1f08409b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:49.485680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4672e254-d4be-4ce5-ad24-93af1f08409b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:49.612521 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4672e254-d4be-4ce5-ad24-93af1f08409b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:49.620604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4672e254-d4be-4ce5-ad24-93af1f08409b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149097 Aug 30 15:05:49.621990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1101/2208] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:49 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:50.642828 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-29fc33df-40c7-43f3-aafb-aec277a59915 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:50.643494 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-29fc33df-40c7-43f3-aafb-aec277a59915 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:50.649569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-29fc33df-40c7-43f3-aafb-aec277a59915 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:50.650053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-29fc33df-40c7-43f3-aafb-aec277a59915 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:50.650488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-29fc33df-40c7-43f3-aafb-aec277a59915 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:50.651172 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-29fc33df-40c7-43f3-aafb-aec277a59915 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:50.651696 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-29fc33df-40c7-43f3-aafb-aec277a59915 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:50.652629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-29fc33df-40c7-43f3-aafb-aec277a59915 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:50.778608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-29fc33df-40c7-43f3-aafb-aec277a59915 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:50.786836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-29fc33df-40c7-43f3-aafb-aec277a59915 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147855 Aug 30 15:05:50.787447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1108/2209] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:50 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:51.809667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c04501e9-2fa9-4419-900a-b81bbbdf5bf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:51.810258 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c04501e9-2fa9-4419-900a-b81bbbdf5bf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:51.816628 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c04501e9-2fa9-4419-900a-b81bbbdf5bf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:51.817114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c04501e9-2fa9-4419-900a-b81bbbdf5bf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:51.817540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c04501e9-2fa9-4419-900a-b81bbbdf5bf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:51.818210 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c04501e9-2fa9-4419-900a-b81bbbdf5bf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:51.818652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c04501e9-2fa9-4419-900a-b81bbbdf5bf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:51.819095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c04501e9-2fa9-4419-900a-b81bbbdf5bf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:51.947019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c04501e9-2fa9-4419-900a-b81bbbdf5bf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:51.956271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c04501e9-2fa9-4419-900a-b81bbbdf5bf3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151732 Aug 30 15:05:51.956836 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1102/2210] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:51 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:52.978002 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8ab71bfb-13b5-4e02-81c3-d0675362478d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:52.978642 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8ab71bfb-13b5-4e02-81c3-d0675362478d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:52.985290 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ab71bfb-13b5-4e02-81c3-d0675362478d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:52.985775 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ab71bfb-13b5-4e02-81c3-d0675362478d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:52.986203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ab71bfb-13b5-4e02-81c3-d0675362478d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:52.986878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ab71bfb-13b5-4e02-81c3-d0675362478d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:52.987349 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ab71bfb-13b5-4e02-81c3-d0675362478d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:52.987772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8ab71bfb-13b5-4e02-81c3-d0675362478d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:53.118076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8ab71bfb-13b5-4e02-81c3-d0675362478d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:53.127336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8ab71bfb-13b5-4e02-81c3-d0675362478d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153130 Aug 30 15:05:53.127903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1109/2211] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:52 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:54.147044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6c7b8497-a2cc-4453-9636-06c8ac4b5d81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:54.147680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6c7b8497-a2cc-4453-9636-06c8ac4b5d81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:54.154065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c7b8497-a2cc-4453-9636-06c8ac4b5d81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:54.154536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c7b8497-a2cc-4453-9636-06c8ac4b5d81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:54.154960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c7b8497-a2cc-4453-9636-06c8ac4b5d81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:54.155663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c7b8497-a2cc-4453-9636-06c8ac4b5d81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:54.156107 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c7b8497-a2cc-4453-9636-06c8ac4b5d81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:54.156520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c7b8497-a2cc-4453-9636-06c8ac4b5d81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:54.158970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=84 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:54.283421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6c7b8497-a2cc-4453-9636-06c8ac4b5d81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:54.291461 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6c7b8497-a2cc-4453-9636-06c8ac4b5d81 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148182 Aug 30 15:05:54.292030 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1103/2212] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:54 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:55.312476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-00321d15-db34-4941-ae40-763b876338be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:55.313095 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-00321d15-db34-4941-ae40-763b876338be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:55.319577 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00321d15-db34-4941-ae40-763b876338be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:55.320057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00321d15-db34-4941-ae40-763b876338be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:55.320504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00321d15-db34-4941-ae40-763b876338be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:55.321174 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00321d15-db34-4941-ae40-763b876338be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:55.321625 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00321d15-db34-4941-ae40-763b876338be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:55.322046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00321d15-db34-4941-ae40-763b876338be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:55.452988 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-00321d15-db34-4941-ae40-763b876338be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:55.461293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-00321d15-db34-4941-ae40-763b876338be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152934 Aug 30 15:05:55.461862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1110/2213] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:55 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:56.483775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6a905740-57a7-4738-8eea-4c3ed1dfb99c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:56.484378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6a905740-57a7-4738-8eea-4c3ed1dfb99c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:56.490701 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a905740-57a7-4738-8eea-4c3ed1dfb99c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:56.491169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a905740-57a7-4738-8eea-4c3ed1dfb99c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:56.491625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a905740-57a7-4738-8eea-4c3ed1dfb99c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:56.492344 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a905740-57a7-4738-8eea-4c3ed1dfb99c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:56.492735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a905740-57a7-4738-8eea-4c3ed1dfb99c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:56.493150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a905740-57a7-4738-8eea-4c3ed1dfb99c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:56.620636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6a905740-57a7-4738-8eea-4c3ed1dfb99c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:56.628735 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6a905740-57a7-4738-8eea-4c3ed1dfb99c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149510 Aug 30 15:05:56.629295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1104/2214] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:56 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:57.648954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8704d5ec-f35a-408b-aab1-a34d52b43950 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:57.649572 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8704d5ec-f35a-408b-aab1-a34d52b43950 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:57.651885 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=26 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:57.657493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8704d5ec-f35a-408b-aab1-a34d52b43950 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:57.658004 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8704d5ec-f35a-408b-aab1-a34d52b43950 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:57.658436 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8704d5ec-f35a-408b-aab1-a34d52b43950 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:57.659118 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8704d5ec-f35a-408b-aab1-a34d52b43950 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:57.659602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8704d5ec-f35a-408b-aab1-a34d52b43950 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:57.660023 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8704d5ec-f35a-408b-aab1-a34d52b43950 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:57.790221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8704d5ec-f35a-408b-aab1-a34d52b43950 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:57.799012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8704d5ec-f35a-408b-aab1-a34d52b43950 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153903 Aug 30 15:05:57.799609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1111/2215] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:57 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:58.820370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-36106f52-8988-4ecb-af6e-f4bf710d8bc3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:58.820972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-36106f52-8988-4ecb-af6e-f4bf710d8bc3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:58.823605 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=26 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:05:58.829438 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36106f52-8988-4ecb-af6e-f4bf710d8bc3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:58.829914 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36106f52-8988-4ecb-af6e-f4bf710d8bc3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:58.830345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36106f52-8988-4ecb-af6e-f4bf710d8bc3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:58.831023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36106f52-8988-4ecb-af6e-f4bf710d8bc3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:58.831498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36106f52-8988-4ecb-af6e-f4bf710d8bc3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:58.831924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-36106f52-8988-4ecb-af6e-f4bf710d8bc3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:05:58.961641 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-36106f52-8988-4ecb-af6e-f4bf710d8bc3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:05:58.970048 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-36106f52-8988-4ecb-af6e-f4bf710d8bc3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153503 Aug 30 15:05:58.970618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1105/2216] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:58 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:05:59.990441 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c66e1d91-bb77-43f6-8618-ad478bb11a1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:05:59.991047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c66e1d91-bb77-43f6-8618-ad478bb11a1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:05:59.998789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c66e1d91-bb77-43f6-8618-ad478bb11a1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:05:59.999286 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c66e1d91-bb77-43f6-8618-ad478bb11a1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:05:59.999717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c66e1d91-bb77-43f6-8618-ad478bb11a1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:00.000395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c66e1d91-bb77-43f6-8618-ad478bb11a1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:00.000839 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c66e1d91-bb77-43f6-8618-ad478bb11a1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:00.001261 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c66e1d91-bb77-43f6-8618-ad478bb11a1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:00.129531 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c66e1d91-bb77-43f6-8618-ad478bb11a1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:00.138059 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c66e1d91-bb77-43f6-8618-ad478bb11a1c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150901 Aug 30 15:06:00.138652 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1112/2217] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:05:59 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:01.158072 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5ce6fd6b-4157-49e1-a370-5b52bc0407ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:01.158677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5ce6fd6b-4157-49e1-a370-5b52bc0407ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:01.164982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ce6fd6b-4157-49e1-a370-5b52bc0407ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:01.165451 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ce6fd6b-4157-49e1-a370-5b52bc0407ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:01.165879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ce6fd6b-4157-49e1-a370-5b52bc0407ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:01.166549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ce6fd6b-4157-49e1-a370-5b52bc0407ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:01.166993 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ce6fd6b-4157-49e1-a370-5b52bc0407ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:01.167428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ce6fd6b-4157-49e1-a370-5b52bc0407ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:01.294474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5ce6fd6b-4157-49e1-a370-5b52bc0407ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:01.302350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5ce6fd6b-4157-49e1-a370-5b52bc0407ec tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148150 Aug 30 15:06:01.302919 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1106/2218] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:01 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:02.324546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0e745b30-b8be-4219-ad6d-73c3f4208657 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:02.325693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0e745b30-b8be-4219-ad6d-73c3f4208657 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:02.332245 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e745b30-b8be-4219-ad6d-73c3f4208657 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:02.332726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e745b30-b8be-4219-ad6d-73c3f4208657 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:02.333167 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e745b30-b8be-4219-ad6d-73c3f4208657 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:02.333857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e745b30-b8be-4219-ad6d-73c3f4208657 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:02.334310 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e745b30-b8be-4219-ad6d-73c3f4208657 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:02.334734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0e745b30-b8be-4219-ad6d-73c3f4208657 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:02.462799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0e745b30-b8be-4219-ad6d-73c3f4208657 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:02.471241 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0e745b30-b8be-4219-ad6d-73c3f4208657 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150804 Aug 30 15:06:02.471810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1113/2219] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:02 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:03.491361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9aba0e80-4a8e-48bb-b1af-66cf8aa70cb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:03.491881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9aba0e80-4a8e-48bb-b1af-66cf8aa70cb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:03.498257 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9aba0e80-4a8e-48bb-b1af-66cf8aa70cb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:03.498727 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9aba0e80-4a8e-48bb-b1af-66cf8aa70cb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:03.499154 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9aba0e80-4a8e-48bb-b1af-66cf8aa70cb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:03.499862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9aba0e80-4a8e-48bb-b1af-66cf8aa70cb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:03.500305 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9aba0e80-4a8e-48bb-b1af-66cf8aa70cb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:03.500718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9aba0e80-4a8e-48bb-b1af-66cf8aa70cb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:03.628306 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9aba0e80-4a8e-48bb-b1af-66cf8aa70cb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:03.636438 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9aba0e80-4a8e-48bb-b1af-66cf8aa70cb7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148977 Aug 30 15:06:03.637527 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1107/2220] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:03 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:04.658201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a7ab5297-f417-45aa-9a05-a3867db6c56e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:04.658792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a7ab5297-f417-45aa-9a05-a3867db6c56e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:04.665361 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7ab5297-f417-45aa-9a05-a3867db6c56e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:04.665844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7ab5297-f417-45aa-9a05-a3867db6c56e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:04.666274 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7ab5297-f417-45aa-9a05-a3867db6c56e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:04.666967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7ab5297-f417-45aa-9a05-a3867db6c56e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:04.667450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7ab5297-f417-45aa-9a05-a3867db6c56e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:04.667873 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7ab5297-f417-45aa-9a05-a3867db6c56e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:04.799410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a7ab5297-f417-45aa-9a05-a3867db6c56e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:04.807483 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a7ab5297-f417-45aa-9a05-a3867db6c56e tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153112 Aug 30 15:06:04.808043 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1114/2221] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:04 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:05.828378 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8359ff41-5a50-4c6f-ba3d-36472bb31e15 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:05.828988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8359ff41-5a50-4c6f-ba3d-36472bb31e15 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:05.835479 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8359ff41-5a50-4c6f-ba3d-36472bb31e15 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:05.835956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8359ff41-5a50-4c6f-ba3d-36472bb31e15 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:05.836412 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8359ff41-5a50-4c6f-ba3d-36472bb31e15 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:05.837090 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8359ff41-5a50-4c6f-ba3d-36472bb31e15 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:05.837537 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8359ff41-5a50-4c6f-ba3d-36472bb31e15 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:05.837960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8359ff41-5a50-4c6f-ba3d-36472bb31e15 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:05.963793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8359ff41-5a50-4c6f-ba3d-36472bb31e15 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:05.971845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8359ff41-5a50-4c6f-ba3d-36472bb31e15 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147434 Aug 30 15:06:05.972422 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1108/2222] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:05 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:06.992509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1cd33c84-c1b0-44f7-9bb8-bb51a2cf1e5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:06.993124 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1cd33c84-c1b0-44f7-9bb8-bb51a2cf1e5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:07.000668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cd33c84-c1b0-44f7-9bb8-bb51a2cf1e5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:07.001151 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cd33c84-c1b0-44f7-9bb8-bb51a2cf1e5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:07.001596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cd33c84-c1b0-44f7-9bb8-bb51a2cf1e5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:07.002284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cd33c84-c1b0-44f7-9bb8-bb51a2cf1e5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:07.002777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cd33c84-c1b0-44f7-9bb8-bb51a2cf1e5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:07.003211 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1cd33c84-c1b0-44f7-9bb8-bb51a2cf1e5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:07.134682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1cd33c84-c1b0-44f7-9bb8-bb51a2cf1e5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:07.143567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1cd33c84-c1b0-44f7-9bb8-bb51a2cf1e5b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.154873 Aug 30 15:06:07.144137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1115/2223] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:06 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:08.164215 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9eec4d8b-7707-45ab-ad7d-048023bf2e1f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:08.164800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9eec4d8b-7707-45ab-ad7d-048023bf2e1f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:08.171230 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9eec4d8b-7707-45ab-ad7d-048023bf2e1f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:08.171707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9eec4d8b-7707-45ab-ad7d-048023bf2e1f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:08.172133 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9eec4d8b-7707-45ab-ad7d-048023bf2e1f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:08.172799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9eec4d8b-7707-45ab-ad7d-048023bf2e1f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:08.173240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9eec4d8b-7707-45ab-ad7d-048023bf2e1f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:08.173652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9eec4d8b-7707-45ab-ad7d-048023bf2e1f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:08.301878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9eec4d8b-7707-45ab-ad7d-048023bf2e1f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:08.310223 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9eec4d8b-7707-45ab-ad7d-048023bf2e1f tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149822 Aug 30 15:06:08.310781 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1109/2224] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:08 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:09.331108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a7973a95-f5bc-4b2e-b212-9f2fea6a39f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:09.331755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a7973a95-f5bc-4b2e-b212-9f2fea6a39f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:09.338108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7973a95-f5bc-4b2e-b212-9f2fea6a39f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:09.338587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7973a95-f5bc-4b2e-b212-9f2fea6a39f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:09.339025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7973a95-f5bc-4b2e-b212-9f2fea6a39f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:09.339758 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7973a95-f5bc-4b2e-b212-9f2fea6a39f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:09.340772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7973a95-f5bc-4b2e-b212-9f2fea6a39f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:09.341225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a7973a95-f5bc-4b2e-b212-9f2fea6a39f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:09.469934 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a7973a95-f5bc-4b2e-b212-9f2fea6a39f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:09.478017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a7973a95-f5bc-4b2e-b212-9f2fea6a39f9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150834 Aug 30 15:06:09.478575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1116/2225] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:09 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:10.500023 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6866d2dd-a9ae-496c-a3d9-b1f6b5a039a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:10.500597 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6866d2dd-a9ae-496c-a3d9-b1f6b5a039a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:10.506791 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6866d2dd-a9ae-496c-a3d9-b1f6b5a039a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:10.507285 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6866d2dd-a9ae-496c-a3d9-b1f6b5a039a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:10.507715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6866d2dd-a9ae-496c-a3d9-b1f6b5a039a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:10.508387 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6866d2dd-a9ae-496c-a3d9-b1f6b5a039a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:10.508858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6866d2dd-a9ae-496c-a3d9-b1f6b5a039a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:10.509274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6866d2dd-a9ae-496c-a3d9-b1f6b5a039a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:10.637828 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6866d2dd-a9ae-496c-a3d9-b1f6b5a039a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:10.645917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6866d2dd-a9ae-496c-a3d9-b1f6b5a039a0 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150649 Aug 30 15:06:10.646491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1110/2226] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:10 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:11.667689 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7b235738-0b4a-43ba-b5cf-18438375c97d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:11.668898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7b235738-0b4a-43ba-b5cf-18438375c97d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:11.675242 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b235738-0b4a-43ba-b5cf-18438375c97d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:11.675719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b235738-0b4a-43ba-b5cf-18438375c97d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:11.676148 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b235738-0b4a-43ba-b5cf-18438375c97d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:11.676851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b235738-0b4a-43ba-b5cf-18438375c97d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:11.677320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b235738-0b4a-43ba-b5cf-18438375c97d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:11.677740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7b235738-0b4a-43ba-b5cf-18438375c97d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:11.801791 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7b235738-0b4a-43ba-b5cf-18438375c97d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:11.810002 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7b235738-0b4a-43ba-b5cf-18438375c97d tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.146215 Aug 30 15:06:11.810566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1117/2227] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:11 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:12.831094 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-58cfb636-4afe-4951-81ab-a4ecea78c3b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:12.831723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-58cfb636-4afe-4951-81ab-a4ecea78c3b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:12.838054 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58cfb636-4afe-4951-81ab-a4ecea78c3b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:12.838540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58cfb636-4afe-4951-81ab-a4ecea78c3b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:12.838972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58cfb636-4afe-4951-81ab-a4ecea78c3b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:12.839690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58cfb636-4afe-4951-81ab-a4ecea78c3b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:12.840142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58cfb636-4afe-4951-81ab-a4ecea78c3b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:12.840572 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58cfb636-4afe-4951-81ab-a4ecea78c3b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:12.966004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-58cfb636-4afe-4951-81ab-a4ecea78c3b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:12.974049 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-58cfb636-4afe-4951-81ab-a4ecea78c3b2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.146918 Aug 30 15:06:12.974625 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1111/2228] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:12 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:13.995325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6a43db8f-6e9b-4426-afe6-584961cb2c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:13.995928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6a43db8f-6e9b-4426-afe6-584961cb2c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:14.002969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a43db8f-6e9b-4426-afe6-584961cb2c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:14.003476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a43db8f-6e9b-4426-afe6-584961cb2c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:14.003907 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a43db8f-6e9b-4426-afe6-584961cb2c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:14.004583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a43db8f-6e9b-4426-afe6-584961cb2c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:14.005030 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a43db8f-6e9b-4426-afe6-584961cb2c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:14.005444 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6a43db8f-6e9b-4426-afe6-584961cb2c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:14.132992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6a43db8f-6e9b-4426-afe6-584961cb2c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:14.141120 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6a43db8f-6e9b-4426-afe6-584961cb2c6b tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149705 Aug 30 15:06:14.141683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1118/2229] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:13 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:15.160993 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0f0cf7b3-71f8-4ea4-ac2c-ec80f4142218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:15.161584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0f0cf7b3-71f8-4ea4-ac2c-ec80f4142218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:15.168079 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f0cf7b3-71f8-4ea4-ac2c-ec80f4142218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:15.168556 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f0cf7b3-71f8-4ea4-ac2c-ec80f4142218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:15.168990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f0cf7b3-71f8-4ea4-ac2c-ec80f4142218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:15.169670 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f0cf7b3-71f8-4ea4-ac2c-ec80f4142218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:15.170122 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f0cf7b3-71f8-4ea4-ac2c-ec80f4142218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:15.170542 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f0cf7b3-71f8-4ea4-ac2c-ec80f4142218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:15.302701 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0f0cf7b3-71f8-4ea4-ac2c-ec80f4142218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:15.311514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0f0cf7b3-71f8-4ea4-ac2c-ec80f4142218 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.154361 Aug 30 15:06:15.312082 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1112/2230] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:15 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:16.332838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-da9cf76c-2162-496b-a472-f404ff39a955 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:16.333451 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-da9cf76c-2162-496b-a472-f404ff39a955 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:16.340925 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da9cf76c-2162-496b-a472-f404ff39a955 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:16.341450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da9cf76c-2162-496b-a472-f404ff39a955 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:16.341888 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da9cf76c-2162-496b-a472-f404ff39a955 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:16.342576 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da9cf76c-2162-496b-a472-f404ff39a955 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:16.343029 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da9cf76c-2162-496b-a472-f404ff39a955 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:16.343482 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da9cf76c-2162-496b-a472-f404ff39a955 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:16.474063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-da9cf76c-2162-496b-a472-f404ff39a955 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:16.482277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-da9cf76c-2162-496b-a472-f404ff39a955 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.153364 Aug 30 15:06:16.482839 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1119/2231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:16 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:17.502303 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7f735361-08cb-4f8e-8ab1-05193e63a119 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:17.502850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7f735361-08cb-4f8e-8ab1-05193e63a119 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:17.509377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f735361-08cb-4f8e-8ab1-05193e63a119 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:17.509854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f735361-08cb-4f8e-8ab1-05193e63a119 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:17.510286 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f735361-08cb-4f8e-8ab1-05193e63a119 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:17.510965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f735361-08cb-4f8e-8ab1-05193e63a119 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:17.511437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f735361-08cb-4f8e-8ab1-05193e63a119 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:17.512015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f735361-08cb-4f8e-8ab1-05193e63a119 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:17.638866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7f735361-08cb-4f8e-8ab1-05193e63a119 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:17.646985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7f735361-08cb-4f8e-8ab1-05193e63a119 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148646 Aug 30 15:06:17.647575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1113/2232] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:17 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:18.668686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fd57eaa8-6a29-4ee3-84a5-e977d271c0b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:18.669430 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fd57eaa8-6a29-4ee3-84a5-e977d271c0b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:18.675937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd57eaa8-6a29-4ee3-84a5-e977d271c0b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:18.676414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd57eaa8-6a29-4ee3-84a5-e977d271c0b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:18.676844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd57eaa8-6a29-4ee3-84a5-e977d271c0b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:18.677516 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd57eaa8-6a29-4ee3-84a5-e977d271c0b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:18.677967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd57eaa8-6a29-4ee3-84a5-e977d271c0b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:18.678383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fd57eaa8-6a29-4ee3-84a5-e977d271c0b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:18.682179 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=78 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:06:18.805207 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fd57eaa8-6a29-4ee3-84a5-e977d271c0b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:18.813964 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fd57eaa8-6a29-4ee3-84a5-e977d271c0b7 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149712 Aug 30 15:06:18.814538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1120/2233] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:18 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:19.834697 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ea3ed633-7383-4ebd-8e23-58d920d66240 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:19.835368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ea3ed633-7383-4ebd-8e23-58d920d66240 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:19.841968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea3ed633-7383-4ebd-8e23-58d920d66240 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:19.842453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea3ed633-7383-4ebd-8e23-58d920d66240 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:19.842890 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea3ed633-7383-4ebd-8e23-58d920d66240 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:19.843618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea3ed633-7383-4ebd-8e23-58d920d66240 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:19.844072 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea3ed633-7383-4ebd-8e23-58d920d66240 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:19.844498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ea3ed633-7383-4ebd-8e23-58d920d66240 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:19.973714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ea3ed633-7383-4ebd-8e23-58d920d66240 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:19.981920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ea3ed633-7383-4ebd-8e23-58d920d66240 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.151154 Aug 30 15:06:19.982491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1114/2234] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:19 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:21.003041 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0b4a86bd-7437-419e-a0c0-98d7214aac40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:21.003695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0b4a86bd-7437-419e-a0c0-98d7214aac40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:21.009710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b4a86bd-7437-419e-a0c0-98d7214aac40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:21.010189 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b4a86bd-7437-419e-a0c0-98d7214aac40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:21.010625 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b4a86bd-7437-419e-a0c0-98d7214aac40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:21.011356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b4a86bd-7437-419e-a0c0-98d7214aac40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:21.011814 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b4a86bd-7437-419e-a0c0-98d7214aac40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:21.012244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0b4a86bd-7437-419e-a0c0-98d7214aac40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:21.146839 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0b4a86bd-7437-419e-a0c0-98d7214aac40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:21.155724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0b4a86bd-7437-419e-a0c0-98d7214aac40 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.156653 Aug 30 15:06:21.156285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1121/2235] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:20 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:22.176443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3a786a65-fa73-47af-a780-92b3454bdfb8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:22.177085 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3a786a65-fa73-47af-a780-92b3454bdfb8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:22.182972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a786a65-fa73-47af-a780-92b3454bdfb8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:22.183484 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a786a65-fa73-47af-a780-92b3454bdfb8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:22.183926 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a786a65-fa73-47af-a780-92b3454bdfb8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:22.184651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a786a65-fa73-47af-a780-92b3454bdfb8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:22.185104 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a786a65-fa73-47af-a780-92b3454bdfb8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:22.185526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a786a65-fa73-47af-a780-92b3454bdfb8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:22.311442 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3a786a65-fa73-47af-a780-92b3454bdfb8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:22.319545 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3a786a65-fa73-47af-a780-92b3454bdfb8 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.147057 Aug 30 15:06:22.320118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1115/2236] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:22 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:23.341841 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5b1e665c-d105-4db5-b654-b1a6e80c43fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:23.342445 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5b1e665c-d105-4db5-b654-b1a6e80c43fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:23.348817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b1e665c-d105-4db5-b654-b1a6e80c43fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:23.349292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b1e665c-d105-4db5-b654-b1a6e80c43fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:23.349719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b1e665c-d105-4db5-b654-b1a6e80c43fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:23.350395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b1e665c-d105-4db5-b654-b1a6e80c43fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:23.350839 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b1e665c-d105-4db5-b654-b1a6e80c43fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:23.351278 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5b1e665c-d105-4db5-b654-b1a6e80c43fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:23.478538 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5b1e665c-d105-4db5-b654-b1a6e80c43fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:23.487503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5b1e665c-d105-4db5-b654-b1a6e80c43fe tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150026 Aug 30 15:06:23.492604 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1122/2237] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:23 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:23.701567 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5c6411b0-aab2-43da-bde0-6ae28020f550 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:23.702119 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5c6411b0-aab2-43da-bde0-6ae28020f550 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:23.708446 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c6411b0-aab2-43da-bde0-6ae28020f550 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:23.708921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c6411b0-aab2-43da-bde0-6ae28020f550 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:23.709354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c6411b0-aab2-43da-bde0-6ae28020f550 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:23.710034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c6411b0-aab2-43da-bde0-6ae28020f550 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:23.710481 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c6411b0-aab2-43da-bde0-6ae28020f550 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:23.710902 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5c6411b0-aab2-43da-bde0-6ae28020f550 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:23.736996 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5c6411b0-aab2-43da-bde0-6ae28020f550 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 15:06:23.815144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5c6411b0-aab2-43da-bde0-6ae28020f550 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 204 len: 0 microversion: 2.20 time: 0.117710 Aug 30 15:06:23.815754 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1116/2238] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 15:06:23 2022] DELETE /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 15:06:23.824609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2297c71e-cd20-4b34-8304-8efb9e88fc2f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:23.826368 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2297c71e-cd20-4b34-8304-8efb9e88fc2f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:23.832202 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2297c71e-cd20-4b34-8304-8efb9e88fc2f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:23.832676 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2297c71e-cd20-4b34-8304-8efb9e88fc2f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:23.833131 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2297c71e-cd20-4b34-8304-8efb9e88fc2f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:23.833805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2297c71e-cd20-4b34-8304-8efb9e88fc2f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:23.834249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2297c71e-cd20-4b34-8304-8efb9e88fc2f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:23.834773 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2297c71e-cd20-4b34-8304-8efb9e88fc2f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:23.961456 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2297c71e-cd20-4b34-8304-8efb9e88fc2f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:23.971025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2297c71e-cd20-4b34-8304-8efb9e88fc2f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:23.972694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2297c71e-cd20-4b34-8304-8efb9e88fc2f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:23.973863 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2297c71e-cd20-4b34-8304-8efb9e88fc2f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 200 len: 1722 microversion: 2.20 time: 0.153453 Aug 30 15:06:23.974423 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1123/2239] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:06:23 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:06:24.508872 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cf322282-0385-4a6c-8f69-fc60c80f558c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:24.509574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cf322282-0385-4a6c-8f69-fc60c80f558c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:24.515587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf322282-0385-4a6c-8f69-fc60c80f558c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:24.516070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf322282-0385-4a6c-8f69-fc60c80f558c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:24.516505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf322282-0385-4a6c-8f69-fc60c80f558c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:24.517208 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf322282-0385-4a6c-8f69-fc60c80f558c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:24.517659 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf322282-0385-4a6c-8f69-fc60c80f558c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:24.518080 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cf322282-0385-4a6c-8f69-fc60c80f558c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:24.522015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:06:24.647285 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cf322282-0385-4a6c-8f69-fc60c80f558c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:24.655585 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cf322282-0385-4a6c-8f69-fc60c80f558c tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150956 Aug 30 15:06:24.656193 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1117/2240] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:24 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:24.998867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5e4563a4-5e41-438f-87bf-9c94159a7103 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:25.000013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5e4563a4-5e41-438f-87bf-9c94159a7103 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:25.007282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e4563a4-5e41-438f-87bf-9c94159a7103 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:25.007761 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e4563a4-5e41-438f-87bf-9c94159a7103 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:25.008193 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e4563a4-5e41-438f-87bf-9c94159a7103 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:25.008877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e4563a4-5e41-438f-87bf-9c94159a7103 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:25.009326 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e4563a4-5e41-438f-87bf-9c94159a7103 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:25.009746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5e4563a4-5e41-438f-87bf-9c94159a7103 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:25.139629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5e4563a4-5e41-438f-87bf-9c94159a7103 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:25.147612 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5e4563a4-5e41-438f-87bf-9c94159a7103 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:25.149046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5e4563a4-5e41-438f-87bf-9c94159a7103 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:25.150210 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5e4563a4-5e41-438f-87bf-9c94159a7103 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 200 len: 1722 microversion: 2.20 time: 0.156427 Aug 30 15:06:25.150764 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1124/2241] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:06:24 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:06:25.675634 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-73209663-0fa0-422a-9ffb-7ab18e9e3317 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:25.676244 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-73209663-0fa0-422a-9ffb-7ab18e9e3317 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:25.682588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73209663-0fa0-422a-9ffb-7ab18e9e3317 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:25.683065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73209663-0fa0-422a-9ffb-7ab18e9e3317 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:25.683524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73209663-0fa0-422a-9ffb-7ab18e9e3317 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:25.684207 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73209663-0fa0-422a-9ffb-7ab18e9e3317 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:25.685319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73209663-0fa0-422a-9ffb-7ab18e9e3317 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:25.685748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73209663-0fa0-422a-9ffb-7ab18e9e3317 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:25.923127 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-73209663-0fa0-422a-9ffb-7ab18e9e3317 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:25.931230 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-73209663-0fa0-422a-9ffb-7ab18e9e3317 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.259574 Aug 30 15:06:25.931811 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1118/2242] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:25 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:26.174083 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cc161b39-7523-4059-8485-983e32c17db9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:26.174690 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cc161b39-7523-4059-8485-983e32c17db9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:26.181062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc161b39-7523-4059-8485-983e32c17db9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:26.181544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc161b39-7523-4059-8485-983e32c17db9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:26.181978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc161b39-7523-4059-8485-983e32c17db9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:26.182665 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc161b39-7523-4059-8485-983e32c17db9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:26.183129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc161b39-7523-4059-8485-983e32c17db9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:26.183561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cc161b39-7523-4059-8485-983e32c17db9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:26.247734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cc161b39-7523-4059-8485-983e32c17db9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:26.255938 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cc161b39-7523-4059-8485-983e32c17db9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:26.257411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cc161b39-7523-4059-8485-983e32c17db9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6270e19d6245453ab79555a79532faba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8914c5bc86f4ee6a9797b05a6a7b12b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:26.258566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cc161b39-7523-4059-8485-983e32c17db9 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 200 len: 1654 microversion: 2.20 time: 0.088554 Aug 30 15:06:26.259127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1125/2243] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:06:26 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 1654 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:06:26.320866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-6dd04aa2-167d-47f6-b2bc-bb32121ced00 req-ebd4b53a-25cd-4859-a837-7ec2be2b878f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88427e0-8903-470e-b463-fa8fe9b645b3", "name": "network-vif-deleted", "tag": "363010d9-43ef-4930-8d87-4410b516872c"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:06:26.330822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-6dd04aa2-167d-47f6-b2bc-bb32121ced00 req-ebd4b53a-25cd-4859-a837-7ec2be2b878f service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:26.331388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-6dd04aa2-167d-47f6-b2bc-bb32121ced00 req-ebd4b53a-25cd-4859-a837-7ec2be2b878f service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:26.331818 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-6dd04aa2-167d-47f6-b2bc-bb32121ced00 req-ebd4b53a-25cd-4859-a837-7ec2be2b878f service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:26.343694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-6dd04aa2-167d-47f6-b2bc-bb32121ced00 req-ebd4b53a-25cd-4859-a837-7ec2be2b878f service nova] Creating event network-vif-deleted:363010d9-43ef-4930-8d87-4410b516872c for instance a88427e0-8903-470e-b463-fa8fe9b645b3 on hv-cinder-82880 Aug 30 15:06:26.348879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-6dd04aa2-167d-47f6-b2bc-bb32121ced00 req-ebd4b53a-25cd-4859-a837-7ec2be2b878f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031763 Aug 30 15:06:26.352431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1119/2244] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:06:26.954933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a054b797-593a-43a3-b4f8-6cc91f747b84 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:26.955759 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a054b797-593a-43a3-b4f8-6cc91f747b84 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:26.962264 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a054b797-593a-43a3-b4f8-6cc91f747b84 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:26.963536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a054b797-593a-43a3-b4f8-6cc91f747b84 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:26.964203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a054b797-593a-43a3-b4f8-6cc91f747b84 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:26.965514 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a054b797-593a-43a3-b4f8-6cc91f747b84 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:26.966968 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a054b797-593a-43a3-b4f8-6cc91f747b84 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:26.967738 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a054b797-593a-43a3-b4f8-6cc91f747b84 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:27.108596 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-a054b797-593a-43a3-b4f8-6cc91f747b84 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:27.116970 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a054b797-593a-43a3-b4f8-6cc91f747b84 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.167768 Aug 30 15:06:27.117554 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1126/2245] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:26 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:27.283129 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1a9d2704-73bc-4b8e-b4a6-6534f0eabcf2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:27.283774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1a9d2704-73bc-4b8e-b4a6-6534f0eabcf2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:27.290125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a9d2704-73bc-4b8e-b4a6-6534f0eabcf2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:27.290607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a9d2704-73bc-4b8e-b4a6-6534f0eabcf2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:27.291127 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a9d2704-73bc-4b8e-b4a6-6534f0eabcf2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:27.291907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a9d2704-73bc-4b8e-b4a6-6534f0eabcf2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:27.292362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a9d2704-73bc-4b8e-b4a6-6534f0eabcf2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:27.292783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a9d2704-73bc-4b8e-b4a6-6534f0eabcf2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:27.306637 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-1a9d2704-73bc-4b8e-b4a6-6534f0eabcf2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] HTTP exception thrown: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1a9d2704-73bc-4b8e-b4a6-6534f0eabcf2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Request method failure captured: Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 HTTP/1.1 Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDiHaoM1uIcluQbqcL6qYMUwX1Og20GdmJEA_Rf5hNnXiDzNmruyvQOLrlUko3TVPiaxjXgQQJEbLvJNWj0jnZKDWkkIH1mEK3qXAvzc7S_7TNBZPHR9OVRRV2zc3x9O4HsK4Txa3frmU8uNLtmduZwAqGOFUnXqhQDlCKYhK5Elg1IU Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: a8914c5bc86f4ee6a9797b05a6a7b12b Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-308679917 Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:06:27.308328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:06:27.310783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8914c5bc86f4ee6a9797b05a6a7b12b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a8914c5bc86f4ee6a9797b05a6a7b12b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8914c5bc86f4ee6a9797b05a6a7b12b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a8914c5bc86f4ee6a9797b05a6a7b12b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:06:27.310783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeShelveTestJSON-308679917 Aug 30 15:06:27.310783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: a8914c5bc86f4ee6a9797b05a6a7b12b Aug 30 15:06:27.310783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-308679917 Aug 30 15:06:27.310783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeShelveTestJSON-308679917-project Aug 30 15:06:27.310783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:06:27.310783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:06:27.310783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: 6270e19d6245453ab79555a79532faba Aug 30 15:06:27.310783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeShelveTestJSON-308679917-project Aug 30 15:06:27.310783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:06:27.310783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. Aug 30 15:06:27.310783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': 'a88427e0-8903-470e-b463-fa8fe9b645b3'} Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:06:27.311773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. Aug 30 15:06:27.313255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:06:27.315261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1a9d2704-73bc-4b8e-b4a6-6534f0eabcf2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Returning 404 to user: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:06:27.315261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1a9d2704-73bc-4b8e-b4a6-6534f0eabcf2 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 404 len: 111 microversion: 2.20 time: 0.031493 Aug 30 15:06:27.315261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1120/2246] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:06:27 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 15:06:27.319257 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cdffc2c2-22a7-41c2-a981-545e91581e6f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '.version_select at 0x7f5cbaa1f040>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:27.343321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cdffc2c2-22a7-41c2-a981-545e91581e6f tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-905989378" status: 204 len: 0 microversion: 2.20 time: 0.027791 Aug 30 15:06:27.343902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1127/2247] 10.222.0.30 () {60 vars in 1259 bytes} [Tue Aug 30 15:06:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-905989378 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 15:06:27.941781 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-580d5506-3501-4edb-812b-60ee1c6711a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:27.942268 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-580d5506-3501-4edb-812b-60ee1c6711a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:27.948534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-580d5506-3501-4edb-812b-60ee1c6711a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:27.949005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-580d5506-3501-4edb-812b-60ee1c6711a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:27.949432 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-580d5506-3501-4edb-812b-60ee1c6711a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:27.950771 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-580d5506-3501-4edb-812b-60ee1c6711a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:27.951223 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-580d5506-3501-4edb-812b-60ee1c6711a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:27.951647 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-580d5506-3501-4edb-812b-60ee1c6711a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:27.964716 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-580d5506-3501-4edb-812b-60ee1c6711a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] HTTP exception thrown: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-580d5506-3501-4edb-812b-60ee1c6711a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Request method failure captured: Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 HTTP/1.1 Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDiHaoM1uIcluQbqcL6qYMUwX1Og20GdmJEA_Rf5hNnXiDzNmruyvQOLrlUko3TVPiaxjXgQQJEbLvJNWj0jnZKDWkkIH1mEK3qXAvzc7S_7TNBZPHR9OVRRV2zc3x9O4HsK4Txa3frmU8uNLtmduZwAqGOFUnXqhQDlCKYhK5Elg1IU Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: a8914c5bc86f4ee6a9797b05a6a7b12b Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-308679917 Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:06:27.966263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:06:27.968250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8914c5bc86f4ee6a9797b05a6a7b12b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a8914c5bc86f4ee6a9797b05a6a7b12b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8914c5bc86f4ee6a9797b05a6a7b12b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a8914c5bc86f4ee6a9797b05a6a7b12b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:06:27.968250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeShelveTestJSON-308679917 Aug 30 15:06:27.968250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: a8914c5bc86f4ee6a9797b05a6a7b12b Aug 30 15:06:27.968250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-308679917 Aug 30 15:06:27.968250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeShelveTestJSON-308679917-project Aug 30 15:06:27.968250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:06:27.968250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:06:27.968250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: 6270e19d6245453ab79555a79532faba Aug 30 15:06:27.968250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeShelveTestJSON-308679917-project Aug 30 15:06:27.968250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:06:27.968250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. Aug 30 15:06:27.968250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': 'a88427e0-8903-470e-b463-fa8fe9b645b3'} Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:06:27.969125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. Aug 30 15:06:27.970584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:06:27.972058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-580d5506-3501-4edb-812b-60ee1c6711a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Returning 404 to user: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:06:27.972058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-580d5506-3501-4edb-812b-60ee1c6711a3 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 404 len: 111 microversion: 2.20 time: 0.029743 Aug 30 15:06:27.972058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1121/2248] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 15:06:27 2022] DELETE /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 15:06:27.976022 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e3acd991-190a-4d85-870c-47f0030f0517 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:27.976640 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e3acd991-190a-4d85-870c-47f0030f0517 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: a88427e0-8903-470e-b463-fa8fe9b645b3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:27.978487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:06:27.984858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3acd991-190a-4d85-870c-47f0030f0517 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:27.985337 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3acd991-190a-4d85-870c-47f0030f0517 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:27.985772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3acd991-190a-4d85-870c-47f0030f0517 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:27.986488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3acd991-190a-4d85-870c-47f0030f0517 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:27.986939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3acd991-190a-4d85-870c-47f0030f0517 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:27.987402 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e3acd991-190a-4d85-870c-47f0030f0517 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:28.001850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-e3acd991-190a-4d85-870c-47f0030f0517 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] HTTP exception thrown: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e3acd991-190a-4d85-870c-47f0030f0517 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Request method failure captured: Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 HTTP/1.1 Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHaoM1uIcluQbqcL6qYMUwX1Og20GdmJEA_Rf5hNnXiDzNmruyvQOLrlUko3TVPiaxjXgQQJEbLvJNWj0jnZKDWkkIH1mEK3qXAvzc7S_7TNBZPHR9OVRRV2zc3x9O4HsK4Txa3frmU8uNLtmduZwAqGOFUnXqhQDlCKYhK5Elg1IU Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: a8914c5bc86f4ee6a9797b05a6a7b12b Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-308679917 Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 15:06:28.003548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 15:06:28.005384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8914c5bc86f4ee6a9797b05a6a7b12b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a8914c5bc86f4ee6a9797b05a6a7b12b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8914c5bc86f4ee6a9797b05a6a7b12b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a8914c5bc86f4ee6a9797b05a6a7b12b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:06:28.005384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-AttachVolumeShelveTestJSON-308679917 Aug 30 15:06:28.005384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: a8914c5bc86f4ee6a9797b05a6a7b12b Aug 30 15:06:28.005384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-308679917 Aug 30 15:06:28.005384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-AttachVolumeShelveTestJSON-308679917-project Aug 30 15:06:28.005384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 15:06:28.005384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 15:06:28.005384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: 6270e19d6245453ab79555a79532faba Aug 30 15:06:28.005384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-AttachVolumeShelveTestJSON-308679917-project Aug 30 15:06:28.005384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 15:06:28.005384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. Aug 30 15:06:28.005384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': 'a88427e0-8903-470e-b463-fa8fe9b645b3'} Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:06:28.006460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. Aug 30 15:06:28.008382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:06:28.009844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e3acd991-190a-4d85-870c-47f0030f0517 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Returning 404 to user: Instance a88427e0-8903-470e-b463-fa8fe9b645b3 could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:06:28.009844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e3acd991-190a-4d85-870c-47f0030f0517 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3" status: 404 len: 111 microversion: 2.20 time: 0.032787 Aug 30 15:06:28.009844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1128/2249] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:06:27 2022] GET /compute/v2.1/servers/a88427e0-8903-470e-b463-fa8fe9b645b3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 15:06:28.138749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-540bd48b-4e31-4ed2-a15d-f4d5ddd02d20 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:28.139441 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-540bd48b-4e31-4ed2-a15d-f4d5ddd02d20 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:28.145379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-540bd48b-4e31-4ed2-a15d-f4d5ddd02d20 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:28.145855 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-540bd48b-4e31-4ed2-a15d-f4d5ddd02d20 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:28.146286 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-540bd48b-4e31-4ed2-a15d-f4d5ddd02d20 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:28.146960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-540bd48b-4e31-4ed2-a15d-f4d5ddd02d20 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:28.147436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-540bd48b-4e31-4ed2-a15d-f4d5ddd02d20 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:28.147857 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-540bd48b-4e31-4ed2-a15d-f4d5ddd02d20 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:28.276828 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-540bd48b-4e31-4ed2-a15d-f4d5ddd02d20 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:28.286348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-540bd48b-4e31-4ed2-a15d-f4d5ddd02d20 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.152139 Aug 30 15:06:28.286947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1122/2250] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:28 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:29.306806 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2795e71c-549a-4098-b224-8a62ea27d557 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:29.307482 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2795e71c-549a-4098-b224-8a62ea27d557 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:29.314613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2795e71c-549a-4098-b224-8a62ea27d557 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:29.315093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2795e71c-549a-4098-b224-8a62ea27d557 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:29.315566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2795e71c-549a-4098-b224-8a62ea27d557 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:29.316251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2795e71c-549a-4098-b224-8a62ea27d557 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:29.316704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2795e71c-549a-4098-b224-8a62ea27d557 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:29.317126 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2795e71c-549a-4098-b224-8a62ea27d557 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:29.444621 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2795e71c-549a-4098-b224-8a62ea27d557 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:29.452972 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2795e71c-549a-4098-b224-8a62ea27d557 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.150100 Aug 30 15:06:29.453518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1129/2251] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:29 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:30.473837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-db8d68c0-bc40-463b-964b-078c7f8190c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:30.474358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-db8d68c0-bc40-463b-964b-078c7f8190c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:30.476852 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:06:30.482725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-db8d68c0-bc40-463b-964b-078c7f8190c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:30.483170 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-db8d68c0-bc40-463b-964b-078c7f8190c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:30.483638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-db8d68c0-bc40-463b-964b-078c7f8190c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:30.484322 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-db8d68c0-bc40-463b-964b-078c7f8190c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:30.484775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-db8d68c0-bc40-463b-964b-078c7f8190c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:30.485201 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-db8d68c0-bc40-463b-964b-078c7f8190c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:30.623273 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-db8d68c0-bc40-463b-964b-078c7f8190c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:30.631292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-db8d68c0-bc40-463b-964b-078c7f8190c4 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.161354 Aug 30 15:06:30.631856 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1123/2252] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:30 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:31.652211 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-059dcdcd-7216-4bc0-b3eb-c7c17c8f1fd2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:31.652839 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-059dcdcd-7216-4bc0-b3eb-c7c17c8f1fd2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:31.659906 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-059dcdcd-7216-4bc0-b3eb-c7c17c8f1fd2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:31.660377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-059dcdcd-7216-4bc0-b3eb-c7c17c8f1fd2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:31.660804 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-059dcdcd-7216-4bc0-b3eb-c7c17c8f1fd2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:31.661488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-059dcdcd-7216-4bc0-b3eb-c7c17c8f1fd2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:31.661933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-059dcdcd-7216-4bc0-b3eb-c7c17c8f1fd2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:31.662347 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-059dcdcd-7216-4bc0-b3eb-c7c17c8f1fd2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:31.798446 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-059dcdcd-7216-4bc0-b3eb-c7c17c8f1fd2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:31.806728 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-059dcdcd-7216-4bc0-b3eb-c7c17c8f1fd2 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.158490 Aug 30 15:06:31.807321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1130/2253] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:31 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:32.828496 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a225f235-7989-4d34-bf7b-33060405e7ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:32.829105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a225f235-7989-4d34-bf7b-33060405e7ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:32.835487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a225f235-7989-4d34-bf7b-33060405e7ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:32.835957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a225f235-7989-4d34-bf7b-33060405e7ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:32.836411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a225f235-7989-4d34-bf7b-33060405e7ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:32.837081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a225f235-7989-4d34-bf7b-33060405e7ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:32.837524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a225f235-7989-4d34-bf7b-33060405e7ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:32.837938 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a225f235-7989-4d34-bf7b-33060405e7ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:32.965353 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a225f235-7989-4d34-bf7b-33060405e7ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:32.973838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a225f235-7989-4d34-bf7b-33060405e7ef tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.149186 Aug 30 15:06:32.974401 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1124/2254] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:32 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:33.994059 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8c05195e-89ab-49fe-b44d-0a3b6a6343fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:33.994660 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8c05195e-89ab-49fe-b44d-0a3b6a6343fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: e42a99ef-987b-4b7f-a6ef-5458fccc5c52] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:06:34.001781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c05195e-89ab-49fe-b44d-0a3b6a6343fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:34.002263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c05195e-89ab-49fe-b44d-0a3b6a6343fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:34.002700 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c05195e-89ab-49fe-b44d-0a3b6a6343fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:34.003414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c05195e-89ab-49fe-b44d-0a3b6a6343fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:34.003873 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c05195e-89ab-49fe-b44d-0a3b6a6343fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:34.004296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c05195e-89ab-49fe-b44d-0a3b6a6343fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:34.131069 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8c05195e-89ab-49fe-b44d-0a3b6a6343fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:06:34.139125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8c05195e-89ab-49fe-b44d-0a3b6a6343fa tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52" status: 200 len: 1736 microversion: 2.1 time: 0.148883 Aug 30 15:06:34.139727 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1131/2255] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:06:33 2022] GET /compute/v2.1/servers/e42a99ef-987b-4b7f-a6ef-5458fccc5c52 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:06:34.158663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0d27bcc1-ab3e-43b8-83f4-194201419965 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '.version_select at 0x7f5cba8d0160>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:06:34.176688 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0d27bcc1-ab3e-43b8-83f4-194201419965 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-780605970" status: 202 len: 0 microversion: 2.1 time: 0.021812 Aug 30 15:06:34.177242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1125/2256] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 15:06:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-780605970 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 15:06:35.297432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-51206494-e1f5-45ea-90dc-f897ab28eee2 req-880ec104-09e4-4776-8881-9259f93f0cde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42a99ef-987b-4b7f-a6ef-5458fccc5c52", "tag": "de9192f0-7fd0-49c1-8393-b52baf316782"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:06:35.308390 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-51206494-e1f5-45ea-90dc-f897ab28eee2 req-880ec104-09e4-4776-8881-9259f93f0cde service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:06:35.309247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-51206494-e1f5-45ea-90dc-f897ab28eee2 req-880ec104-09e4-4776-8881-9259f93f0cde service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:06:35.309678 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-51206494-e1f5-45ea-90dc-f897ab28eee2 req-880ec104-09e4-4776-8881-9259f93f0cde service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:06:35.321562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-51206494-e1f5-45ea-90dc-f897ab28eee2 req-880ec104-09e4-4776-8881-9259f93f0cde service nova] Creating event network-changed:de9192f0-7fd0-49c1-8393-b52baf316782 for instance e42a99ef-987b-4b7f-a6ef-5458fccc5c52 on hv-cinder-82880 Aug 30 15:06:35.329507 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-51206494-e1f5-45ea-90dc-f897ab28eee2 req-880ec104-09e4-4776-8881-9259f93f0cde service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035683 Aug 30 15:06:35.330354 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1132/2257] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:07:17.803977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:07:17.804551 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 15:07:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 (ip 10.222.0.30) !!! Aug 30 15:07:17.805224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=35 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:07:17.805941 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:07:17.810044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8404205f-4d32-49e5-aaad-348180c25cb5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:07:17.810526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8404205f-4d32-49e5-aaad-348180c25cb5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:07:17.820123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8404205f-4d32-49e5-aaad-348180c25cb5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:17.820600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8404205f-4d32-49e5-aaad-348180c25cb5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:17.821012 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8404205f-4d32-49e5-aaad-348180c25cb5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:17.821702 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8404205f-4d32-49e5-aaad-348180c25cb5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:17.822144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8404205f-4d32-49e5-aaad-348180c25cb5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:17.822559 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8404205f-4d32-49e5-aaad-348180c25cb5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:17.837274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-8404205f-4d32-49e5-aaad-348180c25cb5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] HTTP exception thrown: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8404205f-4d32-49e5-aaad-348180c25cb5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Request method failure captured: Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 HTTP/1.1 Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDiHXgeukw0ZNoeficrJEf5lm6v5wj-1PFcFAuJEVMG7EHf6PXGtj7rdqQW2W_0AJCo9VQHgduruYwxwCrpZ10VB9ejqPXjJYMY10nBr1H3zK66KAO8Jy47XLqCblx9Q6gEvo1HZaGbtdLUD5lU6Pc3W6-xhQLr_9vp1ZGNC261GauT4 Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: 04efb141e084405992bfc0418a74da2a Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeTestJSON-105252644 Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:07:17.838819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:07:17.840608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/04efb141e084405992bfc0418a74da2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_04efb141e084405992bfc0418a74da2a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/04efb141e084405992bfc0418a74da2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/04efb141e084405992bfc0418a74da2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:07:17.840608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeTestJSON-105252644 Aug 30 15:07:17.840608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 04efb141e084405992bfc0418a74da2a Aug 30 15:07:17.840608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeTestJSON-105252644 Aug 30 15:07:17.840608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeTestJSON-105252644-project Aug 30 15:07:17.840608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:07:17.840608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:07:17.840608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: ca9bafc5ff4e43719f37e62cad946cf7 Aug 30 15:07:17.840608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeTestJSON-105252644-project Aug 30 15:07:17.840608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:07:17.840608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. Aug 30 15:07:17.840608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': 'c9dfd407-56eb-4670-8ee7-5e0cabe294e3'} Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:07:17.841498 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. Aug 30 15:07:17.842980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:07:17.845711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8404205f-4d32-49e5-aaad-348180c25cb5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Returning 404 to user: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:07:17.845711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8404205f-4d32-49e5-aaad-348180c25cb5 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 404 len: 111 microversion: 2.1 time: 0.038036 Aug 30 15:07:17.845711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1126/2258] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:07:17 2022] DELETE /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:07:17.849536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e1b534b8-3d9d-482b-a90b-5f25bad44cb6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:07:17.850234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e1b534b8-3d9d-482b-a90b-5f25bad44cb6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] [instance: c9dfd407-56eb-4670-8ee7-5e0cabe294e3] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:07:17.853574 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=9 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:07:17.854205 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=63 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:07:17.861098 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e1b534b8-3d9d-482b-a90b-5f25bad44cb6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:17.861571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e1b534b8-3d9d-482b-a90b-5f25bad44cb6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:17.861997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e1b534b8-3d9d-482b-a90b-5f25bad44cb6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:17.862686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e1b534b8-3d9d-482b-a90b-5f25bad44cb6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:17.863132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e1b534b8-3d9d-482b-a90b-5f25bad44cb6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:17.863578 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e1b534b8-3d9d-482b-a90b-5f25bad44cb6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:17.876669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-e1b534b8-3d9d-482b-a90b-5f25bad44cb6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] HTTP exception thrown: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e1b534b8-3d9d-482b-a90b-5f25bad44cb6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Request method failure captured: Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 HTTP/1.1 Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHXgeukw0ZNoeficrJEf5lm6v5wj-1PFcFAuJEVMG7EHf6PXGtj7rdqQW2W_0AJCo9VQHgduruYwxwCrpZ10VB9ejqPXjJYMY10nBr1H3zK66KAO8Jy47XLqCblx9Q6gEvo1HZaGbtdLUD5lU6Pc3W6-xhQLr_9vp1ZGNC261GauT4 Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: 04efb141e084405992bfc0418a74da2a Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-AttachVolumeTestJSON-105252644 Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 15:07:17.878254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 15:07:17.880035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/04efb141e084405992bfc0418a74da2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_04efb141e084405992bfc0418a74da2a", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/04efb141e084405992bfc0418a74da2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/04efb141e084405992bfc0418a74da2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:07:17.880035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-AttachVolumeTestJSON-105252644 Aug 30 15:07:17.880035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: 04efb141e084405992bfc0418a74da2a Aug 30 15:07:17.880035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-AttachVolumeTestJSON-105252644 Aug 30 15:07:17.880035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-AttachVolumeTestJSON-105252644-project Aug 30 15:07:17.880035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 15:07:17.880035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 15:07:17.880035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: ca9bafc5ff4e43719f37e62cad946cf7 Aug 30 15:07:17.880035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-AttachVolumeTestJSON-105252644-project Aug 30 15:07:17.880035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 15:07:17.880035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. Aug 30 15:07:17.880035 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': 'c9dfd407-56eb-4670-8ee7-5e0cabe294e3'} Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:07:17.880979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. Aug 30 15:07:17.882379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:07:17.883673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e1b534b8-3d9d-482b-a90b-5f25bad44cb6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] Returning 404 to user: Instance c9dfd407-56eb-4670-8ee7-5e0cabe294e3 could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:07:17.883673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e1b534b8-3d9d-482b-a90b-5f25bad44cb6 tempest-AttachVolumeTestJSON-105252644 tempest-AttachVolumeTestJSON-105252644-project] 10.222.0.30 "GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3" status: 404 len: 111 microversion: 2.1 time: 0.034117 Aug 30 15:07:17.883673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1133/2259] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:07:17 2022] GET /compute/v2.1/servers/c9dfd407-56eb-4670-8ee7-5e0cabe294e3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:07:20.023259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-4e73a692-e161-4abf-ab77-d16631945966 req-8fd9f72e-88d0-4b72-ad32-122d8532a374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42a99ef-987b-4b7f-a6ef-5458fccc5c52", "name": "network-vif-deleted", "tag": "de9192f0-7fd0-49c1-8393-b52baf316782"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:07:20.036272 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-4e73a692-e161-4abf-ab77-d16631945966 req-8fd9f72e-88d0-4b72-ad32-122d8532a374 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:20.036272 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-4e73a692-e161-4abf-ab77-d16631945966 req-8fd9f72e-88d0-4b72-ad32-122d8532a374 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:20.036839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-4e73a692-e161-4abf-ab77-d16631945966 req-8fd9f72e-88d0-4b72-ad32-122d8532a374 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:20.049619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-4e73a692-e161-4abf-ab77-d16631945966 req-8fd9f72e-88d0-4b72-ad32-122d8532a374 service nova] Creating event network-vif-deleted:de9192f0-7fd0-49c1-8393-b52baf316782 for instance e42a99ef-987b-4b7f-a6ef-5458fccc5c52 on hv-cinder-82880 Aug 30 15:07:20.058658 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-4e73a692-e161-4abf-ab77-d16631945966 req-8fd9f72e-88d0-4b72-ad32-122d8532a374 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038845 Aug 30 15:07:20.060071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1127/2260] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:07:27.154855 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9390c505-2f7d-4526-b24e-38c8cd680de0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Action: 'create', calling method: .version_select at 0x7f5cbab45160>, body: {"keypair": {"name": "tempest-keypair-185646360", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpRu5NY5TqQveGM4arcBTD6Kx3QoIzUC5YB235uyONBy43dqYNvAAoVHIU6Br83o0UqYUhiXAvzeSkO8IRZ2+N3BnHYroFJW9nPkXNbbwl06X862XVyFYP+WmCjvH9hvw=="}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:07:27.170600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-9390c505-2f7d-4526-b24e-38c8cd680de0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Getting quotas for project 1827feb276a945bb86a2f853126dfb20. Resources: {'key_pairs'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:07:27.175423 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-9390c505-2f7d-4526-b24e-38c8cd680de0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Getting quotas for user ecec9a5a18b24ae7ab055c37ea85ca18 and project 1827feb276a945bb86a2f853126dfb20. Resources: {'key_pairs'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:07:27.199807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9390c505-2f7d-4526-b24e-38c8cd680de0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.163375 Aug 30 15:07:27.200518 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1134/2261] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 15:07:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:07:28.536769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-23325761", "imageRef": "fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b10504a6-92ca-453e-86ca-1ca20bff4db6"}], "security_groups": [{"name": "tempest-securitygroup--1556374859"}], "key_name": "tempest-keypair-185646360", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:07:28.646362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] validate_networks() for [('b10504a6-92ca-453e-86ca-1ca20bff4db6', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 15:07:29.022828 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 15:07:29.023300 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 15:07:29.023781 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 15:07:29.024191 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 15:07:29.024603 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 15:07:29.033920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:29.034400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:29.034833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:29.035593 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:29.036051 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:29.036474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:29.054017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Getting quotas for project 1827feb276a945bb86a2f853126dfb20. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:07:29.057995 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Getting quotas for user ecec9a5a18b24ae7ab055c37ea85ca18 and project 1827feb276a945bb86a2f853126dfb20. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:07:29.068957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 15:07:29.071371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 15:07:29.120561 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c455fc98-bd2e-4cfd-bf9a-f4f719a5c75d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.590575 Aug 30 15:07:29.123356 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1128/2262] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 15:07:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 15:07:29.128843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:07:29.133258 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-71410318-a1f1-4d89-9ff7-4c64ceca0282 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:07:29.133867 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-71410318-a1f1-4d89-9ff7-4c64ceca0282 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:07:29.195544 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-71410318-a1f1-4d89-9ff7-4c64ceca0282 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:07:29.203182 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-71410318-a1f1-4d89-9ff7-4c64ceca0282 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 200 len: 1239 microversion: 2.1 time: 0.074958 Aug 30 15:07:29.203793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1135/2263] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:07:29 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:07:30.226566 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-397cb6d4-d66f-4c4e-a8c4-9c2e19013ad5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:07:30.227197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-397cb6d4-d66f-4c4e-a8c4-9c2e19013ad5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:07:30.235058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-397cb6d4-d66f-4c4e-a8c4-9c2e19013ad5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:30.235705 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-397cb6d4-d66f-4c4e-a8c4-9c2e19013ad5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:30.236150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-397cb6d4-d66f-4c4e-a8c4-9c2e19013ad5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:30.236850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-397cb6d4-d66f-4c4e-a8c4-9c2e19013ad5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:30.237307 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-397cb6d4-d66f-4c4e-a8c4-9c2e19013ad5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:30.237727 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-397cb6d4-d66f-4c4e-a8c4-9c2e19013ad5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:30.301004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-397cb6d4-d66f-4c4e-a8c4-9c2e19013ad5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:07:30.309175 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-397cb6d4-d66f-4c4e-a8c4-9c2e19013ad5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 200 len: 1291 microversion: 2.1 time: 0.089151 Aug 30 15:07:30.309764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1129/2264] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:07:30 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 1291 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:07:31.331995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7560d6a5-58db-490b-a15e-0e700c213958 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:07:31.332614 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7560d6a5-58db-490b-a15e-0e700c213958 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:07:31.339484 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7560d6a5-58db-490b-a15e-0e700c213958 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:31.340354 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7560d6a5-58db-490b-a15e-0e700c213958 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:31.341071 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7560d6a5-58db-490b-a15e-0e700c213958 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:31.341665 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7560d6a5-58db-490b-a15e-0e700c213958 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:31.342120 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7560d6a5-58db-490b-a15e-0e700c213958 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:31.342541 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7560d6a5-58db-490b-a15e-0e700c213958 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:31.483287 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7560d6a5-58db-490b-a15e-0e700c213958 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:07:31.490678 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7560d6a5-58db-490b-a15e-0e700c213958 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 200 len: 1365 microversion: 2.1 time: 0.163281 Aug 30 15:07:31.504279 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1136/2265] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:07:31 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:07:31.861117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-dd3b8871-eaf1-45f2-88d2-e11b0c814a78 req-7c6fa5f3-7274-4d30-9662-104e81ca3fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39aba1ac-3d8a-4a6d-b897-2447e6e5137e", "tag": "bc9863a9-c7d0-4d50-8ea8-c950cd775844"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:07:31.884762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-dd3b8871-eaf1-45f2-88d2-e11b0c814a78 req-7c6fa5f3-7274-4d30-9662-104e81ca3fc5 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:31.885233 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-dd3b8871-eaf1-45f2-88d2-e11b0c814a78 req-7c6fa5f3-7274-4d30-9662-104e81ca3fc5 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:31.885911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-dd3b8871-eaf1-45f2-88d2-e11b0c814a78 req-7c6fa5f3-7274-4d30-9662-104e81ca3fc5 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:31.898176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-dd3b8871-eaf1-45f2-88d2-e11b0c814a78 req-7c6fa5f3-7274-4d30-9662-104e81ca3fc5 service nova] Creating event network-changed:bc9863a9-c7d0-4d50-8ea8-c950cd775844 for instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e on hv-cinder-82880 Aug 30 15:07:31.904578 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-dd3b8871-eaf1-45f2-88d2-e11b0c814a78 req-7c6fa5f3-7274-4d30-9662-104e81ca3fc5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048285 Aug 30 15:07:31.905180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1130/2266] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:07:32.511931 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-297ccad2-a509-4051-8ea0-b50e3daed115 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:07:32.512541 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-297ccad2-a509-4051-8ea0-b50e3daed115 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:07:32.519910 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-297ccad2-a509-4051-8ea0-b50e3daed115 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:32.520411 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-297ccad2-a509-4051-8ea0-b50e3daed115 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:32.520842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-297ccad2-a509-4051-8ea0-b50e3daed115 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:32.521541 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-297ccad2-a509-4051-8ea0-b50e3daed115 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:32.522001 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-297ccad2-a509-4051-8ea0-b50e3daed115 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:32.522495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-297ccad2-a509-4051-8ea0-b50e3daed115 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:32.663854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-297ccad2-a509-4051-8ea0-b50e3daed115 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:07:32.672531 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-297ccad2-a509-4051-8ea0-b50e3daed115 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 200 len: 1365 microversion: 2.1 time: 0.164394 Aug 30 15:07:32.673200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1137/2267] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:07:32 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:07:33.697146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fa63c385-77c9-46d2-a875-08d7dff60dfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:07:33.697957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fa63c385-77c9-46d2-a875-08d7dff60dfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:07:33.705015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa63c385-77c9-46d2-a875-08d7dff60dfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:33.705488 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa63c385-77c9-46d2-a875-08d7dff60dfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:33.705913 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa63c385-77c9-46d2-a875-08d7dff60dfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:33.706582 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa63c385-77c9-46d2-a875-08d7dff60dfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:33.707026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa63c385-77c9-46d2-a875-08d7dff60dfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:33.707469 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa63c385-77c9-46d2-a875-08d7dff60dfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:33.836502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fa63c385-77c9-46d2-a875-08d7dff60dfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:07:33.844196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fa63c385-77c9-46d2-a875-08d7dff60dfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 200 len: 1365 microversion: 2.1 time: 0.151716 Aug 30 15:07:33.844758 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1131/2268] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:07:33 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:07:34.864901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-12b2ed06-3630-4faa-a532-2b5fff153d4a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:07:34.865515 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-12b2ed06-3630-4faa-a532-2b5fff153d4a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:07:34.871868 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12b2ed06-3630-4faa-a532-2b5fff153d4a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:34.872354 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12b2ed06-3630-4faa-a532-2b5fff153d4a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:34.872783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12b2ed06-3630-4faa-a532-2b5fff153d4a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:34.873477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12b2ed06-3630-4faa-a532-2b5fff153d4a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:34.873929 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12b2ed06-3630-4faa-a532-2b5fff153d4a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:34.874399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-12b2ed06-3630-4faa-a532-2b5fff153d4a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:35.005371 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-12b2ed06-3630-4faa-a532-2b5fff153d4a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:07:35.012857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-12b2ed06-3630-4faa-a532-2b5fff153d4a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 200 len: 1365 microversion: 2.1 time: 0.151943 Aug 30 15:07:35.013419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1138/2269] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:07:34 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:07:36.034584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-89fdcc69-ae00-404d-855f-66db3c7c0cef tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:07:36.035134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-89fdcc69-ae00-404d-855f-66db3c7c0cef tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:07:36.041609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89fdcc69-ae00-404d-855f-66db3c7c0cef tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:36.042088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89fdcc69-ae00-404d-855f-66db3c7c0cef tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:36.042524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89fdcc69-ae00-404d-855f-66db3c7c0cef tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:36.043222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89fdcc69-ae00-404d-855f-66db3c7c0cef tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:36.043695 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89fdcc69-ae00-404d-855f-66db3c7c0cef tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:36.044121 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89fdcc69-ae00-404d-855f-66db3c7c0cef tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:36.186019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-89fdcc69-ae00-404d-855f-66db3c7c0cef tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:07:36.194176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-89fdcc69-ae00-404d-855f-66db3c7c0cef tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 200 len: 1365 microversion: 2.1 time: 0.164145 Aug 30 15:07:36.194749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1132/2270] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:07:36 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:07:36.913476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-639b5200-cb0b-436e-8162-80ef157d93c7 req-3bb72f0a-bbb0-4722-9570-cd1fc8c32c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39aba1ac-3d8a-4a6d-b897-2447e6e5137e", "name": "network-vif-plugged", "status": "completed", "tag": "bc9863a9-c7d0-4d50-8ea8-c950cd775844"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:07:36.923845 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-639b5200-cb0b-436e-8162-80ef157d93c7 req-3bb72f0a-bbb0-4722-9570-cd1fc8c32c5f service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:36.924325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-639b5200-cb0b-436e-8162-80ef157d93c7 req-3bb72f0a-bbb0-4722-9570-cd1fc8c32c5f service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:36.924770 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-639b5200-cb0b-436e-8162-80ef157d93c7 req-3bb72f0a-bbb0-4722-9570-cd1fc8c32c5f service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:36.935764 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-639b5200-cb0b-436e-8162-80ef157d93c7 req-3bb72f0a-bbb0-4722-9570-cd1fc8c32c5f service nova] Creating event network-vif-plugged:bc9863a9-c7d0-4d50-8ea8-c950cd775844 for instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e on hv-cinder-82880 Aug 30 15:07:36.941065 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-639b5200-cb0b-436e-8162-80ef157d93c7 req-3bb72f0a-bbb0-4722-9570-cd1fc8c32c5f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031336 Aug 30 15:07:36.941643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1139/2271] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:07:37.215091 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a8854bb5-5319-4987-9589-231670b14e3f tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:07:37.215741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a8854bb5-5319-4987-9589-231670b14e3f tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:07:37.223047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8854bb5-5319-4987-9589-231670b14e3f tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:37.223777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8854bb5-5319-4987-9589-231670b14e3f tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:37.224159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8854bb5-5319-4987-9589-231670b14e3f tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:37.224908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8854bb5-5319-4987-9589-231670b14e3f tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:37.225388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8854bb5-5319-4987-9589-231670b14e3f tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:37.225832 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8854bb5-5319-4987-9589-231670b14e3f tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:37.363329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a8854bb5-5319-4987-9589-231670b14e3f tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:07:37.370806 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a8854bb5-5319-4987-9589-231670b14e3f tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 200 len: 1365 microversion: 2.1 time: 0.159696 Aug 30 15:07:37.371402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1133/2272] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:07:37 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:07:38.393810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f3679a17-7f1a-4001-80f2-c1c2d3feed39 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:07:38.394526 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f3679a17-7f1a-4001-80f2-c1c2d3feed39 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:07:38.400580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3679a17-7f1a-4001-80f2-c1c2d3feed39 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:38.401057 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3679a17-7f1a-4001-80f2-c1c2d3feed39 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:38.401488 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3679a17-7f1a-4001-80f2-c1c2d3feed39 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:38.402159 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3679a17-7f1a-4001-80f2-c1c2d3feed39 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:38.402658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3679a17-7f1a-4001-80f2-c1c2d3feed39 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:38.403022 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f3679a17-7f1a-4001-80f2-c1c2d3feed39 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:38.537680 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f3679a17-7f1a-4001-80f2-c1c2d3feed39 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:07:38.545675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f3679a17-7f1a-4001-80f2-c1c2d3feed39 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 200 len: 1554 microversion: 2.1 time: 0.157471 Aug 30 15:07:38.546856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1140/2273] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:07:38 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:07:38.566323 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5d26c2ac-5b57-49fd-92d9-78b4bc2dfbb5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:07:38.566850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5d26c2ac-5b57-49fd-92d9-78b4bc2dfbb5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:07:38.573427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d26c2ac-5b57-49fd-92d9-78b4bc2dfbb5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:38.573903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d26c2ac-5b57-49fd-92d9-78b4bc2dfbb5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:38.574332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d26c2ac-5b57-49fd-92d9-78b4bc2dfbb5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:38.575010 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d26c2ac-5b57-49fd-92d9-78b4bc2dfbb5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:38.575491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d26c2ac-5b57-49fd-92d9-78b4bc2dfbb5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:38.575913 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5d26c2ac-5b57-49fd-92d9-78b4bc2dfbb5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:38.651785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5d26c2ac-5b57-49fd-92d9-78b4bc2dfbb5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089375 Aug 30 15:07:38.652379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1134/2274] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 15:07:38 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:07:39.568093 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-a5125b66-9ea1-44f1-9653-a1309a480201 req-d78bed4d-2e94-45d5-8aa4-3efe93b5bc1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39aba1ac-3d8a-4a6d-b897-2447e6e5137e", "tag": "bc9863a9-c7d0-4d50-8ea8-c950cd775844"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:07:39.572986 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=6 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:07:39.579450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-a5125b66-9ea1-44f1-9653-a1309a480201 req-d78bed4d-2e94-45d5-8aa4-3efe93b5bc1b service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:07:39.579923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-a5125b66-9ea1-44f1-9653-a1309a480201 req-d78bed4d-2e94-45d5-8aa4-3efe93b5bc1b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:07:39.580347 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-a5125b66-9ea1-44f1-9653-a1309a480201 req-d78bed4d-2e94-45d5-8aa4-3efe93b5bc1b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:07:39.591795 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-a5125b66-9ea1-44f1-9653-a1309a480201 req-d78bed4d-2e94-45d5-8aa4-3efe93b5bc1b service nova] Creating event network-changed:bc9863a9-c7d0-4d50-8ea8-c950cd775844 for instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e on hv-cinder-82880 Aug 30 15:07:39.597491 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-a5125b66-9ea1-44f1-9653-a1309a480201 req-d78bed4d-2e94-45d5-8aa4-3efe93b5bc1b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033120 Aug 30 15:07:39.598202 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1141/2275] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:08:15.327990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:08:15.329449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:08:15.330715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:08:15.331421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=36 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:08:15.335743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-849a6f00-768e-453b-a529-8ad227148053 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:08:15.336231 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-849a6f00-768e-453b-a529-8ad227148053 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:08:15.345294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-849a6f00-768e-453b-a529-8ad227148053 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:08:15.345773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-849a6f00-768e-453b-a529-8ad227148053 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:08:15.346205 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-849a6f00-768e-453b-a529-8ad227148053 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:08:15.346880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-849a6f00-768e-453b-a529-8ad227148053 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:08:15.347363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-849a6f00-768e-453b-a529-8ad227148053 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:08:15.347810 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-849a6f00-768e-453b-a529-8ad227148053 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:08:15.370862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-849a6f00-768e-453b-a529-8ad227148053 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e/ips" status: 200 len: 149 microversion: 2.1 time: 0.043725 Aug 30 15:08:15.371455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1135/2276] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 15:08:15 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:09:15.446378 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:09:15.447164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=28 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:09:15.448238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:09:15.448634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:09:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e (ip 10.222.0.30) !!! Aug 30 15:09:15.454322 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b7c21e1a-e800-46a4-8626-2cab7306d3c9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:15.454905 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b7c21e1a-e800-46a4-8626-2cab7306d3c9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:09:15.464485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7c21e1a-e800-46a4-8626-2cab7306d3c9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:15.464914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7c21e1a-e800-46a4-8626-2cab7306d3c9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:15.465348 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7c21e1a-e800-46a4-8626-2cab7306d3c9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:15.466041 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7c21e1a-e800-46a4-8626-2cab7306d3c9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:15.466489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7c21e1a-e800-46a4-8626-2cab7306d3c9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:15.466910 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b7c21e1a-e800-46a4-8626-2cab7306d3c9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:15.494147 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b7c21e1a-e800-46a4-8626-2cab7306d3c9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Going to try to terminate instance {{(pid=127089) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 15:09:15.569807 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b7c21e1a-e800-46a4-8626-2cab7306d3c9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 204 len: 0 microversion: 2.1 time: 0.125247 Aug 30 15:09:15.570396 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1142/2277] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:09:15 2022] DELETE /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 15:09:15.577866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:09:15.579120 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=4 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:09:15.580455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:09:15.580606 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 15:09:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e (ip 10.222.0.30) !!! Aug 30 15:09:15.587200 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dd3bf60e-a385-4539-b098-b1655e519344 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:15.587823 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dd3bf60e-a385-4539-b098-b1655e519344 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:09:15.600531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd3bf60e-a385-4539-b098-b1655e519344 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:15.601022 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd3bf60e-a385-4539-b098-b1655e519344 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:15.601454 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd3bf60e-a385-4539-b098-b1655e519344 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:15.602142 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd3bf60e-a385-4539-b098-b1655e519344 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:15.602595 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd3bf60e-a385-4539-b098-b1655e519344 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:15.603014 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd3bf60e-a385-4539-b098-b1655e519344 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:15.779047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-dd3bf60e-a385-4539-b098-b1655e519344 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:09:15.786545 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dd3bf60e-a385-4539-b098-b1655e519344 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 200 len: 1679 microversion: 2.1 time: 0.211306 Aug 30 15:09:15.787095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1136/2278] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:09:15 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:09:16.809489 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5c9140b4-9108-4b3e-b40d-88e7b18abcb0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:16.810193 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5c9140b4-9108-4b3e-b40d-88e7b18abcb0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:09:16.816568 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c9140b4-9108-4b3e-b40d-88e7b18abcb0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:16.817044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c9140b4-9108-4b3e-b40d-88e7b18abcb0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:16.817530 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c9140b4-9108-4b3e-b40d-88e7b18abcb0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:16.818203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c9140b4-9108-4b3e-b40d-88e7b18abcb0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:16.818653 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c9140b4-9108-4b3e-b40d-88e7b18abcb0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:16.819078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c9140b4-9108-4b3e-b40d-88e7b18abcb0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:16.998967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5c9140b4-9108-4b3e-b40d-88e7b18abcb0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:09:17.006754 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5c9140b4-9108-4b3e-b40d-88e7b18abcb0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 200 len: 1679 microversion: 2.1 time: 0.201606 Aug 30 15:09:17.007338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1143/2279] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:09:16 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:09:18.007502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-cebca336-f8a5-4b57-a1fa-191486df2aac req-f0f509df-749e-440e-aa2c-348e4baea700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39aba1ac-3d8a-4a6d-b897-2447e6e5137e", "name": "network-vif-deleted", "tag": "bc9863a9-c7d0-4d50-8ea8-c950cd775844"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:09:18.020548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-cebca336-f8a5-4b57-a1fa-191486df2aac req-f0f509df-749e-440e-aa2c-348e4baea700 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:18.021923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-cebca336-f8a5-4b57-a1fa-191486df2aac req-f0f509df-749e-440e-aa2c-348e4baea700 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:18.022377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-cebca336-f8a5-4b57-a1fa-191486df2aac req-f0f509df-749e-440e-aa2c-348e4baea700 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:18.028804 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-86b9d225-f44a-48a7-a73d-ccfa9ab63a3b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:18.029531 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-86b9d225-f44a-48a7-a73d-ccfa9ab63a3b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:09:18.034791 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-cebca336-f8a5-4b57-a1fa-191486df2aac req-f0f509df-749e-440e-aa2c-348e4baea700 service nova] Creating event network-vif-deleted:bc9863a9-c7d0-4d50-8ea8-c950cd775844 for instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e on hv-cinder-82880 Aug 30 15:09:18.037493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86b9d225-f44a-48a7-a73d-ccfa9ab63a3b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:18.037989 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86b9d225-f44a-48a7-a73d-ccfa9ab63a3b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:18.038738 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86b9d225-f44a-48a7-a73d-ccfa9ab63a3b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:18.039685 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86b9d225-f44a-48a7-a73d-ccfa9ab63a3b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:18.040128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86b9d225-f44a-48a7-a73d-ccfa9ab63a3b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:18.040668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86b9d225-f44a-48a7-a73d-ccfa9ab63a3b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:18.043004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-cebca336-f8a5-4b57-a1fa-191486df2aac req-f0f509df-749e-440e-aa2c-348e4baea700 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042336 Aug 30 15:09:18.044806 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1137/2280] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:09:18.123533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-86b9d225-f44a-48a7-a73d-ccfa9ab63a3b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:09:18.137203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-86b9d225-f44a-48a7-a73d-ccfa9ab63a3b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 200 len: 1324 microversion: 2.1 time: 0.112192 Aug 30 15:09:18.138266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1144/2281] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:09:18 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 1324 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:09:19.158923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0f11a82b-3dae-4cd9-a8d5-b979f10911f9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:19.159773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0f11a82b-3dae-4cd9-a8d5-b979f10911f9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:09:19.167043 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f11a82b-3dae-4cd9-a8d5-b979f10911f9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:19.167677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f11a82b-3dae-4cd9-a8d5-b979f10911f9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:19.168126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f11a82b-3dae-4cd9-a8d5-b979f10911f9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:19.168833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f11a82b-3dae-4cd9-a8d5-b979f10911f9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:19.169288 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f11a82b-3dae-4cd9-a8d5-b979f10911f9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:19.169718 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f11a82b-3dae-4cd9-a8d5-b979f10911f9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:19.184029 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-0f11a82b-3dae-4cd9-a8d5-b979f10911f9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] HTTP exception thrown: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0f11a82b-3dae-4cd9-a8d5-b979f10911f9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Request method failure captured: Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e HTTP/1.1 Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDieu49-1IBQU-11Rv1n2aVKFlzupcDRd0e-qdS5lTtBm3AFS160p71qNjtlKv-ZoutszJEUmAQQIxfaRsQjOyObIUvmq7e_1m4qZxlfjtD3deDtEY4Dc0zEJnoDow1rMf7GXB4oIxBMME5qRDfUwsfPDIrkVpnbKiqdf_fi6sb3TugM Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:09:19.185665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:09:19.187580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1827feb276a945bb86a2f853126dfb20", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:09:19.187580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:09:19.187580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:09:19.187580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:09:19.187580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:09:19.187580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:09:19.187580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:09:19.187580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: ecec9a5a18b24ae7ab055c37ea85ca18 Aug 30 15:09:19.187580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:09:19.187580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:09:19.187580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. Aug 30 15:09:19.187580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': '39aba1ac-3d8a-4a6d-b897-2447e6e5137e'} Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:09:19.188807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. Aug 30 15:09:19.190580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:09:19.192873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0f11a82b-3dae-4cd9-a8d5-b979f10911f9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Returning 404 to user: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:09:19.192873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0f11a82b-3dae-4cd9-a8d5-b979f10911f9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 404 len: 111 microversion: 2.1 time: 0.033045 Aug 30 15:09:19.192873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1138/2282] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:09:19 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:09:19.197026 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b91a5d46-dfeb-4acc-8fe1-1458c3d9a906 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '.version_select at 0x7f5cbaa1f430>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:19.218980 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b91a5d46-dfeb-4acc-8fe1-1458c3d9a906 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-185646360" status: 202 len: 0 microversion: 2.1 time: 0.026596 Aug 30 15:09:19.219600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1145/2283] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 30 15:09:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-185646360 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 15:09:19.835640 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6d16422a-1180-41d3-a98f-58d95a49d803 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Action: 'create', calling method: .version_select at 0x7f5cba9a43a0>, body: {"keypair": {"name": "tempest-keypair-1754880151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBCRTAFLkOlpu4Q56uOT3Ku+XB7WQJNkM4MAK0w3Dvqztq7YtAO4AW/F/imYchBr7zg4Qav/0bpVst1d3n567MApoJYlMDb2B2MnIDj9sJbpHmGG8dtSD8L7ongfHf4bg=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:09:19.853826 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-6d16422a-1180-41d3-a98f-58d95a49d803 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Getting quotas for project 1827feb276a945bb86a2f853126dfb20. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:09:19.857794 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-6d16422a-1180-41d3-a98f-58d95a49d803 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Getting quotas for user ecec9a5a18b24ae7ab055c37ea85ca18 and project 1827feb276a945bb86a2f853126dfb20. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:09:19.883109 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6d16422a-1180-41d3-a98f-58d95a49d803 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051679 Aug 30 15:09:19.883839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1139/2284] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 15:09:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:09:21.076182 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1521794637", "imageRef": "fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b10504a6-92ca-453e-86ca-1ca20bff4db6"}], "security_groups": [{"name": "tempest-securitygroup--1890272472"}], "key_name": "tempest-keypair-1754880151", "user_data": "}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:09:21.182515 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.network.neutron [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] validate_networks() for [('b10504a6-92ca-453e-86ca-1ca20bff4db6', None, None, None, None, None)] {{(pid=127089) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 15:09:21.821580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Flavor limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 15:09:21.822008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Image limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 15:09:21.822485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Flavor pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 15:09:21.822926 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Image pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 15:09:21.823642 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 15:09:21.832660 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:21.833185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:21.833711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:21.834440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:21.834894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:21.835357 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:21.851988 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Getting quotas for project 1827feb276a945bb86a2f853126dfb20. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:09:21.855976 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Getting quotas for user ecec9a5a18b24ae7ab055c37ea85ca18 and project 1827feb276a945bb86a2f853126dfb20. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:09:21.867230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Going to run 1 instances... {{(pid=127089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 15:09:21.869486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 15:09:21.917127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bb89e3b2-c063-4af6-bb93-9b3e28aa2a81 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.846077 Aug 30 15:09:21.917784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1146/2285] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 15:09:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 15:09:21.929721 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2915a8cb-bfa3-4029-abe3-249ccda86536 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:21.930335 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2915a8cb-bfa3-4029-abe3-249ccda86536 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:09:21.988720 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2915a8cb-bfa3-4029-abe3-249ccda86536 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:09:21.996319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2915a8cb-bfa3-4029-abe3-249ccda86536 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1242 microversion: 2.1 time: 0.071496 Aug 30 15:09:21.998233 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1140/2286] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:09:21 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:09:23.017506 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2479054e-c698-4848-a13f-ea43a8a9139b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:23.018157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2479054e-c698-4848-a13f-ea43a8a9139b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:09:23.025038 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2479054e-c698-4848-a13f-ea43a8a9139b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:23.025577 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2479054e-c698-4848-a13f-ea43a8a9139b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:23.026118 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2479054e-c698-4848-a13f-ea43a8a9139b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:23.026931 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2479054e-c698-4848-a13f-ea43a8a9139b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:23.027491 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2479054e-c698-4848-a13f-ea43a8a9139b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:23.027915 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2479054e-c698-4848-a13f-ea43a8a9139b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:23.093308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2479054e-c698-4848-a13f-ea43a8a9139b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:09:23.101486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2479054e-c698-4848-a13f-ea43a8a9139b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1302 microversion: 2.1 time: 0.088314 Aug 30 15:09:23.102410 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1147/2287] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:09:23 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1302 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:09:24.121793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fbc56b7a-3926-418c-8fb3-c7e435e6cb1d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:24.122444 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fbc56b7a-3926-418c-8fb3-c7e435e6cb1d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:09:24.128559 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fbc56b7a-3926-418c-8fb3-c7e435e6cb1d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:24.129036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fbc56b7a-3926-418c-8fb3-c7e435e6cb1d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:24.129468 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fbc56b7a-3926-418c-8fb3-c7e435e6cb1d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:24.130153 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fbc56b7a-3926-418c-8fb3-c7e435e6cb1d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:24.130656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fbc56b7a-3926-418c-8fb3-c7e435e6cb1d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:24.131322 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fbc56b7a-3926-418c-8fb3-c7e435e6cb1d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:24.330424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fbc56b7a-3926-418c-8fb3-c7e435e6cb1d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:09:24.339763 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fbc56b7a-3926-418c-8fb3-c7e435e6cb1d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1368 microversion: 2.1 time: 0.221753 Aug 30 15:09:24.340493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1141/2288] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:09:24 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:09:24.556140 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-77e63eb2-7cdf-44a3-8e53-9f07ffb7788d req-348bf4aa-6f42-45cf-805e-7067274fe2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ba605d-0996-44eb-b52b-f024db242108", "tag": "60aa4577-ba3f-471a-96f4-c554a3610e9c"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:09:24.566919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-77e63eb2-7cdf-44a3-8e53-9f07ffb7788d req-348bf4aa-6f42-45cf-805e-7067274fe2a0 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:24.567736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-77e63eb2-7cdf-44a3-8e53-9f07ffb7788d req-348bf4aa-6f42-45cf-805e-7067274fe2a0 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:24.568947 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-77e63eb2-7cdf-44a3-8e53-9f07ffb7788d req-348bf4aa-6f42-45cf-805e-7067274fe2a0 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:24.581833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-77e63eb2-7cdf-44a3-8e53-9f07ffb7788d req-348bf4aa-6f42-45cf-805e-7067274fe2a0 service nova] Creating event network-changed:60aa4577-ba3f-471a-96f4-c554a3610e9c for instance f7ba605d-0996-44eb-b52b-f024db242108 on hv-cinder-82880 Aug 30 15:09:24.587747 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-77e63eb2-7cdf-44a3-8e53-9f07ffb7788d req-348bf4aa-6f42-45cf-805e-7067274fe2a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040195 Aug 30 15:09:24.588344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1148/2289] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:09:25.361412 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e1966cd7-5832-4947-b851-a1ba2edebcc4 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:25.362052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e1966cd7-5832-4947-b851-a1ba2edebcc4 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:09:25.368925 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1966cd7-5832-4947-b851-a1ba2edebcc4 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:25.369402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1966cd7-5832-4947-b851-a1ba2edebcc4 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:25.369833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1966cd7-5832-4947-b851-a1ba2edebcc4 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:25.370510 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1966cd7-5832-4947-b851-a1ba2edebcc4 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:25.370956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1966cd7-5832-4947-b851-a1ba2edebcc4 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:25.371415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e1966cd7-5832-4947-b851-a1ba2edebcc4 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:25.508309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e1966cd7-5832-4947-b851-a1ba2edebcc4 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:09:25.515781 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e1966cd7-5832-4947-b851-a1ba2edebcc4 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1368 microversion: 2.1 time: 0.158340 Aug 30 15:09:25.517139 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1142/2290] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:09:25 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:09:26.536187 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0bcd4cde-51b2-4398-8b37-cc890b65a619 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:26.536890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0bcd4cde-51b2-4398-8b37-cc890b65a619 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:09:26.543830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0bcd4cde-51b2-4398-8b37-cc890b65a619 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:26.544302 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0bcd4cde-51b2-4398-8b37-cc890b65a619 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:26.544763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0bcd4cde-51b2-4398-8b37-cc890b65a619 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:26.545426 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0bcd4cde-51b2-4398-8b37-cc890b65a619 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:26.545877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0bcd4cde-51b2-4398-8b37-cc890b65a619 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:26.546300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0bcd4cde-51b2-4398-8b37-cc890b65a619 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:26.674683 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0bcd4cde-51b2-4398-8b37-cc890b65a619 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:09:26.682390 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0bcd4cde-51b2-4398-8b37-cc890b65a619 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1368 microversion: 2.1 time: 0.150524 Aug 30 15:09:26.682956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1149/2291] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:09:26 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:09:27.705041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cd0b3d4b-5e09-4329-b529-afd6c22d71c7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:27.705648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cd0b3d4b-5e09-4329-b529-afd6c22d71c7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:09:27.712537 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd0b3d4b-5e09-4329-b529-afd6c22d71c7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:27.713013 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd0b3d4b-5e09-4329-b529-afd6c22d71c7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:27.713443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd0b3d4b-5e09-4329-b529-afd6c22d71c7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:27.714116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd0b3d4b-5e09-4329-b529-afd6c22d71c7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:27.714570 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd0b3d4b-5e09-4329-b529-afd6c22d71c7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:27.714987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd0b3d4b-5e09-4329-b529-afd6c22d71c7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:27.842199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cd0b3d4b-5e09-4329-b529-afd6c22d71c7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:09:27.850568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cd0b3d4b-5e09-4329-b529-afd6c22d71c7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1368 microversion: 2.1 time: 0.149269 Aug 30 15:09:27.851134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1143/2292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:09:27 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:09:28.871711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-93cbbf1e-9f9e-43d9-90af-fa17caa31773 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:28.872327 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-93cbbf1e-9f9e-43d9-90af-fa17caa31773 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:09:28.878707 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-93cbbf1e-9f9e-43d9-90af-fa17caa31773 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:28.879188 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-93cbbf1e-9f9e-43d9-90af-fa17caa31773 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:28.879651 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-93cbbf1e-9f9e-43d9-90af-fa17caa31773 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:28.880362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-93cbbf1e-9f9e-43d9-90af-fa17caa31773 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:28.880832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-93cbbf1e-9f9e-43d9-90af-fa17caa31773 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:28.881249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-93cbbf1e-9f9e-43d9-90af-fa17caa31773 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:29.008717 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-93cbbf1e-9f9e-43d9-90af-fa17caa31773 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:09:29.016384 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-93cbbf1e-9f9e-43d9-90af-fa17caa31773 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1368 microversion: 2.1 time: 0.148556 Aug 30 15:09:29.016944 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1150/2293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:09:28 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:09:29.427313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-f2432534-ea3b-4595-8797-fb6dc373aa99 req-0aa34ff6-ce5f-458e-9812-1b0afd4a37a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ba605d-0996-44eb-b52b-f024db242108", "name": "network-vif-plugged", "status": "completed", "tag": "60aa4577-ba3f-471a-96f4-c554a3610e9c"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:09:29.439115 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f2432534-ea3b-4595-8797-fb6dc373aa99 req-0aa34ff6-ce5f-458e-9812-1b0afd4a37a0 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:29.439799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f2432534-ea3b-4595-8797-fb6dc373aa99 req-0aa34ff6-ce5f-458e-9812-1b0afd4a37a0 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:29.440229 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f2432534-ea3b-4595-8797-fb6dc373aa99 req-0aa34ff6-ce5f-458e-9812-1b0afd4a37a0 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:29.451829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-f2432534-ea3b-4595-8797-fb6dc373aa99 req-0aa34ff6-ce5f-458e-9812-1b0afd4a37a0 service nova] Creating event network-vif-plugged:60aa4577-ba3f-471a-96f4-c554a3610e9c for instance f7ba605d-0996-44eb-b52b-f024db242108 on hv-cinder-82880 Aug 30 15:09:29.456785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-f2432534-ea3b-4595-8797-fb6dc373aa99 req-0aa34ff6-ce5f-458e-9812-1b0afd4a37a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033457 Aug 30 15:09:29.457557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1144/2294] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:09:30.036734 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ef6cf8f7-cd96-4a06-a464-3bf9bab15871 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:30.037520 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ef6cf8f7-cd96-4a06-a464-3bf9bab15871 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:09:30.043890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef6cf8f7-cd96-4a06-a464-3bf9bab15871 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:30.044375 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef6cf8f7-cd96-4a06-a464-3bf9bab15871 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:30.044814 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef6cf8f7-cd96-4a06-a464-3bf9bab15871 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:30.045502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef6cf8f7-cd96-4a06-a464-3bf9bab15871 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:30.045957 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef6cf8f7-cd96-4a06-a464-3bf9bab15871 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:30.046383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef6cf8f7-cd96-4a06-a464-3bf9bab15871 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:30.173346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ef6cf8f7-cd96-4a06-a464-3bf9bab15871 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:09:30.181304 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ef6cf8f7-cd96-4a06-a464-3bf9bab15871 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1368 microversion: 2.1 time: 0.148531 Aug 30 15:09:30.183321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1151/2295] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:09:30 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:09:31.203679 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a8c4b947-2e7b-4c04-8b5e-812f2ce0b5fe tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:31.204455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a8c4b947-2e7b-4c04-8b5e-812f2ce0b5fe tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:09:31.213183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c4b947-2e7b-4c04-8b5e-812f2ce0b5fe tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:31.213332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c4b947-2e7b-4c04-8b5e-812f2ce0b5fe tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:31.213712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c4b947-2e7b-4c04-8b5e-812f2ce0b5fe tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:31.214443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c4b947-2e7b-4c04-8b5e-812f2ce0b5fe tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:31.215089 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c4b947-2e7b-4c04-8b5e-812f2ce0b5fe tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:31.215544 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8c4b947-2e7b-4c04-8b5e-812f2ce0b5fe tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:31.354815 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a8c4b947-2e7b-4c04-8b5e-812f2ce0b5fe tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:09:31.362430 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a8c4b947-2e7b-4c04-8b5e-812f2ce0b5fe tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1558 microversion: 2.1 time: 0.164173 Aug 30 15:09:31.362985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1145/2296] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:09:31 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:09:31.384291 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4ee01d7a-57ad-4d33-8862-a016dc9a2760 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:09:31.384870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4ee01d7a-57ad-4d33-8862-a016dc9a2760 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:09:31.391359 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4ee01d7a-57ad-4d33-8862-a016dc9a2760 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:31.391846 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4ee01d7a-57ad-4d33-8862-a016dc9a2760 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:31.392477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4ee01d7a-57ad-4d33-8862-a016dc9a2760 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:31.393377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4ee01d7a-57ad-4d33-8862-a016dc9a2760 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:31.393833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4ee01d7a-57ad-4d33-8862-a016dc9a2760 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:31.394256 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4ee01d7a-57ad-4d33-8862-a016dc9a2760 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:31.470562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4ee01d7a-57ad-4d33-8862-a016dc9a2760 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090692 Aug 30 15:09:31.471155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1152/2297] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 15:09:31 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:09:32.626349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-ea88b130-7d07-411b-a9d2-97516f21c85c req-24866e49-9a5d-4f5d-b8b4-5ec6186ad1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ba605d-0996-44eb-b52b-f024db242108", "tag": "60aa4577-ba3f-471a-96f4-c554a3610e9c"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:09:32.631872 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:09:32.638253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ea88b130-7d07-411b-a9d2-97516f21c85c req-24866e49-9a5d-4f5d-b8b4-5ec6186ad1f7 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:09:32.638726 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ea88b130-7d07-411b-a9d2-97516f21c85c req-24866e49-9a5d-4f5d-b8b4-5ec6186ad1f7 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:09:32.639149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ea88b130-7d07-411b-a9d2-97516f21c85c req-24866e49-9a5d-4f5d-b8b4-5ec6186ad1f7 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:09:32.651026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-ea88b130-7d07-411b-a9d2-97516f21c85c req-24866e49-9a5d-4f5d-b8b4-5ec6186ad1f7 service nova] Creating event network-changed:60aa4577-ba3f-471a-96f4-c554a3610e9c for instance f7ba605d-0996-44eb-b52b-f024db242108 on hv-cinder-82880 Aug 30 15:09:32.656381 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-ea88b130-7d07-411b-a9d2-97516f21c85c req-24866e49-9a5d-4f5d-b8b4-5ec6186ad1f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033420 Aug 30 15:09:32.656989 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1146/2298] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:10:07.455660 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:10:07.456440 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=6 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:10:07.457818 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:10:07.458516 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:10:07.463268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-b8b04469-746a-4e95-b5a4-2e3133277f80 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:10:07.463694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-b8b04469-746a-4e95-b5a4-2e3133277f80 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:10:07.471695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b8b04469-746a-4e95-b5a4-2e3133277f80 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:10:07.472251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b8b04469-746a-4e95-b5a4-2e3133277f80 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:10:07.472702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b8b04469-746a-4e95-b5a4-2e3133277f80 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:10:07.473389 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b8b04469-746a-4e95-b5a4-2e3133277f80 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:10:07.473839 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b8b04469-746a-4e95-b5a4-2e3133277f80 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:10:07.474261 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-b8b04469-746a-4e95-b5a4-2e3133277f80 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:10:07.500082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-b8b04469-746a-4e95-b5a4-2e3133277f80 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108/ips" status: 200 len: 150 microversion: 2.1 time: 0.045582 Aug 30 15:10:07.500646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1153/2299] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 15:10:07 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:12:37.253243 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b2720b3-8822-4ca1-8e33-a4e896f2d5ee] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 15:12:37.253877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:12:37.254675 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=38 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:12:37.255760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 15:12:37.255928 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 15:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 (ip 10.222.0.30) !!! Aug 30 15:12:37.257351 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:12:37.257479 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 15:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 (ip 10.222.0.30) !!! Aug 30 15:12:37.258724 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 15:12:37.259369 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 15:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 (ip 10.222.0.30) !!! Aug 30 15:12:37.268834 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8bdce067-065d-4e28-a86b-4b50b2c92186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:12:37.269452 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8bdce067-065d-4e28-a86b-4b50b2c92186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:12:37.280902 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bdce067-065d-4e28-a86b-4b50b2c92186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:12:37.281379 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bdce067-065d-4e28-a86b-4b50b2c92186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:12:37.281841 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bdce067-065d-4e28-a86b-4b50b2c92186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:12:37.282531 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bdce067-065d-4e28-a86b-4b50b2c92186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:12:37.282983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bdce067-065d-4e28-a86b-4b50b2c92186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:12:37.283436 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8bdce067-065d-4e28-a86b-4b50b2c92186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:12:37.310747 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-8bdce067-065d-4e28-a86b-4b50b2c92186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] HTTP exception thrown: Instance df823286-f7fd-4dbf-acb5-7cd297f48da0 could not be found. Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8bdce067-065d-4e28-a86b-4b50b2c92186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Request method failure captured: Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 HTTP/1.1 Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDiHaoM1uIcluQbqcL6qYMUwX1Og20GdmJEA_Rf5hNnXiDzNmruyvQOLrlUko3TVPiaxjXgQQJEbLvJNWj0jnZKDWkkIH1mEK3qXAvzc7S_7TNBZPHR9OVRRV2zc3x9O4HsK4Txa3frmU8uNLtmduZwAqGOFUnXqhQDlCKYhK5Elg1IU Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: a8914c5bc86f4ee6a9797b05a6a7b12b Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-308679917 Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:12:37.312543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:12:37.314400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8914c5bc86f4ee6a9797b05a6a7b12b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a8914c5bc86f4ee6a9797b05a6a7b12b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8914c5bc86f4ee6a9797b05a6a7b12b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a8914c5bc86f4ee6a9797b05a6a7b12b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:12:37.314400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeShelveTestJSON-308679917 Aug 30 15:12:37.314400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: a8914c5bc86f4ee6a9797b05a6a7b12b Aug 30 15:12:37.314400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-308679917 Aug 30 15:12:37.314400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeShelveTestJSON-308679917-project Aug 30 15:12:37.314400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:12:37.314400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:12:37.314400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: 6270e19d6245453ab79555a79532faba Aug 30 15:12:37.314400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeShelveTestJSON-308679917-project Aug 30 15:12:37.314400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:12:37.314400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance df823286-f7fd-4dbf-acb5-7cd297f48da0 could not be found. Aug 30 15:12:37.314400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': 'df823286-f7fd-4dbf-acb5-7cd297f48da0'} Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df823286-f7fd-4dbf-acb5-7cd297f48da0 could not be found. Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:12:37.315750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df823286-f7fd-4dbf-acb5-7cd297f48da0 could not be found. Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df823286-f7fd-4dbf-acb5-7cd297f48da0 could not be found. Aug 30 15:12:37.317584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:12:37.319419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8bdce067-065d-4e28-a86b-4b50b2c92186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Returning 404 to user: Instance df823286-f7fd-4dbf-acb5-7cd297f48da0 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:12:37.319419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8bdce067-065d-4e28-a86b-4b50b2c92186 tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "DELETE /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 404 len: 111 microversion: 2.20 time: 0.062696 Aug 30 15:12:37.319419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1147/2300] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 30 15:12:37 2022] DELETE /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 15:12:37.321076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34884703-4033-4b27-b74a-ef5661add272] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 15:12:37.321693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=4 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:12:37.322328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:12:37.323442 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 15:12:37.323667 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 (ip 10.222.0.30) !!! Aug 30 15:12:37.325398 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 15:12:37.325703 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 (ip 10.222.0.30) !!! Aug 30 15:12:37.326808 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 15:12:37.326930 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 (ip 10.222.0.30) !!! Aug 30 15:12:37.331532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-24b59f3c-3c72-4fb0-83ad-0a172431479b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:12:37.332133 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-24b59f3c-3c72-4fb0-83ad-0a172431479b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] [instance: df823286-f7fd-4dbf-acb5-7cd297f48da0] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:12:37.343832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24b59f3c-3c72-4fb0-83ad-0a172431479b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:12:37.344314 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24b59f3c-3c72-4fb0-83ad-0a172431479b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:12:37.344749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24b59f3c-3c72-4fb0-83ad-0a172431479b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:12:37.345436 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24b59f3c-3c72-4fb0-83ad-0a172431479b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:12:37.345884 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24b59f3c-3c72-4fb0-83ad-0a172431479b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:12:37.346306 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-24b59f3c-3c72-4fb0-83ad-0a172431479b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:12:37.360649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-24b59f3c-3c72-4fb0-83ad-0a172431479b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] HTTP exception thrown: Instance df823286-f7fd-4dbf-acb5-7cd297f48da0 could not be found. Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-24b59f3c-3c72-4fb0-83ad-0a172431479b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Request method failure captured: Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 HTTP/1.1 Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHaoM1uIcluQbqcL6qYMUwX1Og20GdmJEA_Rf5hNnXiDzNmruyvQOLrlUko3TVPiaxjXgQQJEbLvJNWj0jnZKDWkkIH1mEK3qXAvzc7S_7TNBZPHR9OVRRV2zc3x9O4HsK4Txa3frmU8uNLtmduZwAqGOFUnXqhQDlCKYhK5Elg1IU Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: a8914c5bc86f4ee6a9797b05a6a7b12b Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-308679917 Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 15:12:37.362293 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 15:12:37.364186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8914c5bc86f4ee6a9797b05a6a7b12b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a8914c5bc86f4ee6a9797b05a6a7b12b", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a8914c5bc86f4ee6a9797b05a6a7b12b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a8914c5bc86f4ee6a9797b05a6a7b12b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:12:37.364186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-AttachVolumeShelveTestJSON-308679917 Aug 30 15:12:37.364186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: a8914c5bc86f4ee6a9797b05a6a7b12b Aug 30 15:12:37.364186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-308679917 Aug 30 15:12:37.364186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-AttachVolumeShelveTestJSON-308679917-project Aug 30 15:12:37.364186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 15:12:37.364186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 15:12:37.364186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: 6270e19d6245453ab79555a79532faba Aug 30 15:12:37.364186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-AttachVolumeShelveTestJSON-308679917-project Aug 30 15:12:37.364186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 15:12:37.364186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance df823286-f7fd-4dbf-acb5-7cd297f48da0 could not be found. Aug 30 15:12:37.364186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': 'df823286-f7fd-4dbf-acb5-7cd297f48da0'} Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df823286-f7fd-4dbf-acb5-7cd297f48da0 could not be found. Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:12:37.365253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df823286-f7fd-4dbf-acb5-7cd297f48da0 could not be found. Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df823286-f7fd-4dbf-acb5-7cd297f48da0 could not be found. Aug 30 15:12:37.366927 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:12:37.369067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-24b59f3c-3c72-4fb0-83ad-0a172431479b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] Returning 404 to user: Instance df823286-f7fd-4dbf-acb5-7cd297f48da0 could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:12:37.369067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-24b59f3c-3c72-4fb0-83ad-0a172431479b tempest-AttachVolumeShelveTestJSON-308679917 tempest-AttachVolumeShelveTestJSON-308679917-project] 10.222.0.30 "GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0" status: 404 len: 111 microversion: 2.20 time: 0.044788 Aug 30 15:12:37.369067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1154/2301] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 30 15:12:37 2022] GET /compute/v2.1/servers/df823286-f7fd-4dbf-acb5-7cd297f48da0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 15:12:41.322015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b2720b3-8822-4ca1-8e33-a4e896f2d5ee] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 59730. Aug 30 15:12:41.439565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6a3b3421-6c5e-4d63-917e-35f80256a208 tempest-VolumesSnapshotsTestJSON-607872754 tempest-VolumesSnapshotsTestJSON-607872754-project] Action: 'create', calling method: .version_select at 0x7f5cbe160d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-606236709"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:12:47.285240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:12:47.287974 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:14:37.727944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6a3b3421-6c5e-4d63-917e-35f80256a208 tempest-VolumesSnapshotsTestJSON-607872754 tempest-VolumesSnapshotsTestJSON-607872754-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 116.417274 Aug 30 15:14:37.728740 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1148/2302] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Aug 30 15:12:41 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 116419 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 15:17:20.087606 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:17:20.088757 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:17:20.089768 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 15:17:20.089941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:17:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 (ip 10.222.0.30) !!! Aug 30 15:17:20.091070 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 15:17:20.091225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:17:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 (ip 10.222.0.30) !!! Aug 30 15:17:20.093062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 15:17:20.093192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:17:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 (ip 10.222.0.30) !!! Aug 30 15:17:20.099051 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c03a2f84-9ae2-492d-8434-8cc336cbfd08 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:20.099569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c03a2f84-9ae2-492d-8434-8cc336cbfd08 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:20.112869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c03a2f84-9ae2-492d-8434-8cc336cbfd08 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:20.113351 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c03a2f84-9ae2-492d-8434-8cc336cbfd08 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:20.113785 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c03a2f84-9ae2-492d-8434-8cc336cbfd08 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:20.114477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c03a2f84-9ae2-492d-8434-8cc336cbfd08 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:20.114928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c03a2f84-9ae2-492d-8434-8cc336cbfd08 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:20.115385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c03a2f84-9ae2-492d-8434-8cc336cbfd08 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:20.119049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] [34884703-4033-4b27-b74a-ef5661add272] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 59896. Aug 30 15:17:20.142469 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c03a2f84-9ae2-492d-8434-8cc336cbfd08 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Going to try to terminate instance {{(pid=127089) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 15:17:20.222447 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c03a2f84-9ae2-492d-8434-8cc336cbfd08 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 204 len: 0 microversion: 2.1 time: 0.136627 Aug 30 15:17:20.223134 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1155/2303] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:17:20 2022] DELETE /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 15:17:20.229477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b2720b3-8822-4ca1-8e33-a4e896f2d5ee] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 15:17:20.230015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:17:20.230196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 15:17:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 (ip 10.222.0.30) !!! Aug 30 15:17:20.231563 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:17:20.231691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 15:17:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 (ip 10.222.0.30) !!! Aug 30 15:17:20.233722 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:17:20.233847 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 15:17:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 (ip 10.222.0.30) !!! Aug 30 15:17:20.244249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-696a82a6-0218-4369-82f9-dcfe8c976193 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:20.245121 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-696a82a6-0218-4369-82f9-dcfe8c976193 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:20.259727 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-696a82a6-0218-4369-82f9-dcfe8c976193 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:20.260219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-696a82a6-0218-4369-82f9-dcfe8c976193 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:20.260658 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-696a82a6-0218-4369-82f9-dcfe8c976193 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:20.261352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-696a82a6-0218-4369-82f9-dcfe8c976193 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:20.261803 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-696a82a6-0218-4369-82f9-dcfe8c976193 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:20.262433 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-696a82a6-0218-4369-82f9-dcfe8c976193 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:20.402057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-696a82a6-0218-4369-82f9-dcfe8c976193 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:20.410454 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-696a82a6-0218-4369-82f9-dcfe8c976193 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1683 microversion: 2.1 time: 0.182931 Aug 30 15:17:20.411019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1149/2304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:20 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:21.437120 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c8fdcb59-b82f-4dcb-820e-ee24bef6044b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:21.443617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c8fdcb59-b82f-4dcb-820e-ee24bef6044b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:21.456755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8fdcb59-b82f-4dcb-820e-ee24bef6044b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:21.457938 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8fdcb59-b82f-4dcb-820e-ee24bef6044b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:21.458923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8fdcb59-b82f-4dcb-820e-ee24bef6044b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:21.459838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8fdcb59-b82f-4dcb-820e-ee24bef6044b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:21.460450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8fdcb59-b82f-4dcb-820e-ee24bef6044b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:21.461021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c8fdcb59-b82f-4dcb-820e-ee24bef6044b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:21.771164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c8fdcb59-b82f-4dcb-820e-ee24bef6044b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:21.781766 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c8fdcb59-b82f-4dcb-820e-ee24bef6044b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1683 microversion: 2.1 time: 0.353246 Aug 30 15:17:21.783334 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1156/2305] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:21 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1683 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:21.937314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b2720b3-8822-4ca1-8e33-a4e896f2d5ee] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 59994. Aug 30 15:17:22.119559 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-29419178-e32e-41ae-af55-ba2c552a3c81 req-273b1d70-4f7a-4bf9-9111-8a0d4b5bfc79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cae1b8-5973-4846-b2f4-79ed7e98be62", "name": "network-vif-deleted", "tag": "43ef8efc-c930-4960-9ef2-48d6d5f548da"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:17:22.129526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-29419178-e32e-41ae-af55-ba2c552a3c81 req-273b1d70-4f7a-4bf9-9111-8a0d4b5bfc79 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:22.130004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-29419178-e32e-41ae-af55-ba2c552a3c81 req-273b1d70-4f7a-4bf9-9111-8a0d4b5bfc79 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:22.130430 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-29419178-e32e-41ae-af55-ba2c552a3c81 req-273b1d70-4f7a-4bf9-9111-8a0d4b5bfc79 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:22.143721 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-29419178-e32e-41ae-af55-ba2c552a3c81 req-273b1d70-4f7a-4bf9-9111-8a0d4b5bfc79 service nova] Creating event network-vif-deleted:43ef8efc-c930-4960-9ef2-48d6d5f548da for instance 38cae1b8-5973-4846-b2f4-79ed7e98be62 on hv-cinder-82880 Aug 30 15:17:22.153543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-29419178-e32e-41ae-af55-ba2c552a3c81 req-273b1d70-4f7a-4bf9-9111-8a0d4b5bfc79 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227743 Aug 30 15:17:22.156053 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1150/2306] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:17:22.806769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-917e78e3-a70c-4995-9bd0-225e69867e87 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:22.807494 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-917e78e3-a70c-4995-9bd0-225e69867e87 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:22.823872 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-917e78e3-a70c-4995-9bd0-225e69867e87 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:22.834937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-917e78e3-a70c-4995-9bd0-225e69867e87 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:22.837395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-917e78e3-a70c-4995-9bd0-225e69867e87 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:22.838260 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-917e78e3-a70c-4995-9bd0-225e69867e87 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:22.840773 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-917e78e3-a70c-4995-9bd0-225e69867e87 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:22.844450 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-917e78e3-a70c-4995-9bd0-225e69867e87 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:22.957268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-917e78e3-a70c-4995-9bd0-225e69867e87 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:22.965046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-917e78e3-a70c-4995-9bd0-225e69867e87 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1327 microversion: 2.1 time: 0.164268 Aug 30 15:17:22.965936 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1157/2307] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:22 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1327 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:23.036389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-59d7be15-57aa-464a-9436-1c8937ff2710 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:23.037577 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-59d7be15-57aa-464a-9436-1c8937ff2710 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:23.044472 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59d7be15-57aa-464a-9436-1c8937ff2710 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:23.046262 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59d7be15-57aa-464a-9436-1c8937ff2710 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:23.046696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59d7be15-57aa-464a-9436-1c8937ff2710 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:23.047424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59d7be15-57aa-464a-9436-1c8937ff2710 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:23.047875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59d7be15-57aa-464a-9436-1c8937ff2710 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:23.048294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59d7be15-57aa-464a-9436-1c8937ff2710 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:23.073943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-59d7be15-57aa-464a-9436-1c8937ff2710 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 15:17:23.163065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-59d7be15-57aa-464a-9436-1c8937ff2710 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 204 len: 0 microversion: 2.1 time: 0.130525 Aug 30 15:17:23.163757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1151/2308] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:17:23 2022] DELETE /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 15:17:23.172342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-427af23e-3871-4946-8d52-7470426839a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:23.172965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-427af23e-3871-4946-8d52-7470426839a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:23.179028 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-427af23e-3871-4946-8d52-7470426839a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:23.179559 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-427af23e-3871-4946-8d52-7470426839a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:23.180003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-427af23e-3871-4946-8d52-7470426839a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:23.180703 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-427af23e-3871-4946-8d52-7470426839a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:23.181158 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-427af23e-3871-4946-8d52-7470426839a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:23.181585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-427af23e-3871-4946-8d52-7470426839a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:23.338323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-427af23e-3871-4946-8d52-7470426839a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:23.348088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-427af23e-3871-4946-8d52-7470426839a3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1507 microversion: 2.1 time: 0.180155 Aug 30 15:17:23.348670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1158/2309] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:23 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:23.988278 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-382752fd-ff65-47fc-907b-58f139779eb2 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:23.988900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-382752fd-ff65-47fc-907b-58f139779eb2 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:23.994584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-382752fd-ff65-47fc-907b-58f139779eb2 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:23.995060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-382752fd-ff65-47fc-907b-58f139779eb2 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:23.995519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-382752fd-ff65-47fc-907b-58f139779eb2 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:23.996192 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-382752fd-ff65-47fc-907b-58f139779eb2 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:23.996634 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-382752fd-ff65-47fc-907b-58f139779eb2 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:23.997045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-382752fd-ff65-47fc-907b-58f139779eb2 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:24.064448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-382752fd-ff65-47fc-907b-58f139779eb2 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:24.072430 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-382752fd-ff65-47fc-907b-58f139779eb2 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1327 microversion: 2.1 time: 0.088341 Aug 30 15:17:24.073943 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1152/2310] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:23 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1327 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:24.368967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-40097bc7-5da1-4204-96a5-122a4ecd4fc1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:24.369594 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-40097bc7-5da1-4204-96a5-122a4ecd4fc1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:24.376473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-40097bc7-5da1-4204-96a5-122a4ecd4fc1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:24.376991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-40097bc7-5da1-4204-96a5-122a4ecd4fc1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:24.377431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-40097bc7-5da1-4204-96a5-122a4ecd4fc1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:24.378129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-40097bc7-5da1-4204-96a5-122a4ecd4fc1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:24.378585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-40097bc7-5da1-4204-96a5-122a4ecd4fc1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:24.379013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-40097bc7-5da1-4204-96a5-122a4ecd4fc1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:24.496246 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-318dbae4-e3d6-4b3d-823d-da38f9240837 req-59225846-5966-4ec1-bd54-137daf2ec3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ba605d-0996-44eb-b52b-f024db242108", "name": "network-vif-deleted", "tag": "60aa4577-ba3f-471a-96f4-c554a3610e9c"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:17:24.506525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-318dbae4-e3d6-4b3d-823d-da38f9240837 req-59225846-5966-4ec1-bd54-137daf2ec3a7 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:24.507087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-318dbae4-e3d6-4b3d-823d-da38f9240837 req-59225846-5966-4ec1-bd54-137daf2ec3a7 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:24.507610 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-318dbae4-e3d6-4b3d-823d-da38f9240837 req-59225846-5966-4ec1-bd54-137daf2ec3a7 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:24.519849 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-318dbae4-e3d6-4b3d-823d-da38f9240837 req-59225846-5966-4ec1-bd54-137daf2ec3a7 service nova] Creating event network-vif-deleted:60aa4577-ba3f-471a-96f4-c554a3610e9c for instance f7ba605d-0996-44eb-b52b-f024db242108 on hv-cinder-82880 Aug 30 15:17:24.524734 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-318dbae4-e3d6-4b3d-823d-da38f9240837 req-59225846-5966-4ec1-bd54-137daf2ec3a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032120 Aug 30 15:17:24.525333 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1153/2311] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 15:17:24.540464 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-40097bc7-5da1-4204-96a5-122a4ecd4fc1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:24.548359 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-40097bc7-5da1-4204-96a5-122a4ecd4fc1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1507 microversion: 2.1 time: 0.183636 Aug 30 15:17:24.549058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1159/2312] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:24 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:25.095543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5e013a69-e98b-434c-a37a-237dab0b4579 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:25.096253 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5e013a69-e98b-434c-a37a-237dab0b4579 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:25.102370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e013a69-e98b-434c-a37a-237dab0b4579 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:25.102857 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e013a69-e98b-434c-a37a-237dab0b4579 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:25.103318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e013a69-e98b-434c-a37a-237dab0b4579 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:25.104004 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e013a69-e98b-434c-a37a-237dab0b4579 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:25.104455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e013a69-e98b-434c-a37a-237dab0b4579 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:25.104878 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e013a69-e98b-434c-a37a-237dab0b4579 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:25.167838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5e013a69-e98b-434c-a37a-237dab0b4579 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:25.175596 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5e013a69-e98b-434c-a37a-237dab0b4579 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1327 microversion: 2.1 time: 0.085426 Aug 30 15:17:25.176174 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1154/2313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:25 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1327 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:25.570481 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-c4fddbdf-4e06-4256-9d78-867206f02a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:25.571201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-c4fddbdf-4e06-4256-9d78-867206f02a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:25.578904 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c4fddbdf-4e06-4256-9d78-867206f02a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:25.579503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c4fddbdf-4e06-4256-9d78-867206f02a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:25.580025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c4fddbdf-4e06-4256-9d78-867206f02a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:25.580793 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c4fddbdf-4e06-4256-9d78-867206f02a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:25.581312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c4fddbdf-4e06-4256-9d78-867206f02a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:25.581739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-c4fddbdf-4e06-4256-9d78-867206f02a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:25.719935 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-c4fddbdf-4e06-4256-9d78-867206f02a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:25.727391 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-c4fddbdf-4e06-4256-9d78-867206f02a03 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1507 microversion: 2.1 time: 0.160822 Aug 30 15:17:25.727953 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1160/2314] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:25 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:26.196933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0156c5d9-ca3d-47c4-8bf6-c8c4cd9846c5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:26.197549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0156c5d9-ca3d-47c4-8bf6-c8c4cd9846c5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:26.204393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0156c5d9-ca3d-47c4-8bf6-c8c4cd9846c5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:26.204874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0156c5d9-ca3d-47c4-8bf6-c8c4cd9846c5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:26.205344 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0156c5d9-ca3d-47c4-8bf6-c8c4cd9846c5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:26.206040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0156c5d9-ca3d-47c4-8bf6-c8c4cd9846c5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:26.206693 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0156c5d9-ca3d-47c4-8bf6-c8c4cd9846c5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:26.207326 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0156c5d9-ca3d-47c4-8bf6-c8c4cd9846c5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:26.239419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0156c5d9-ca3d-47c4-8bf6-c8c4cd9846c5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:26.239901 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0156c5d9-ca3d-47c4-8bf6-c8c4cd9846c5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:26.240341 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0156c5d9-ca3d-47c4-8bf6-c8c4cd9846c5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:26.240788 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-0156c5d9-ca3d-47c4-8bf6-c8c4cd9846c5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lazy-loading 'fault' on Instance uuid f7ba605d-0996-44eb-b52b-f024db242108 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 15:17:26.281768 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0156c5d9-ca3d-47c4-8bf6-c8c4cd9846c5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:26.289367 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0156c5d9-ca3d-47c4-8bf6-c8c4cd9846c5 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1332 microversion: 2.1 time: 0.096352 Aug 30 15:17:26.290787 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1155/2315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:26 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:26.749096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-eac40489-aa9a-4ee8-965c-7ed3686f278a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:26.749736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-eac40489-aa9a-4ee8-965c-7ed3686f278a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:26.756118 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eac40489-aa9a-4ee8-965c-7ed3686f278a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:26.756608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eac40489-aa9a-4ee8-965c-7ed3686f278a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:26.757079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eac40489-aa9a-4ee8-965c-7ed3686f278a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:26.757771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eac40489-aa9a-4ee8-965c-7ed3686f278a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:26.758220 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eac40489-aa9a-4ee8-965c-7ed3686f278a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:26.758671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-eac40489-aa9a-4ee8-965c-7ed3686f278a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:26.901383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-eac40489-aa9a-4ee8-965c-7ed3686f278a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:26.909067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-eac40489-aa9a-4ee8-965c-7ed3686f278a tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1507 microversion: 2.1 time: 0.164456 Aug 30 15:17:26.909816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1161/2316] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:26 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:27.312227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-216a3adb-ef8d-46c5-bb45-278b2ee19371 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:27.313412 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-216a3adb-ef8d-46c5-bb45-278b2ee19371 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:27.335423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-216a3adb-ef8d-46c5-bb45-278b2ee19371 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:27.339420 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-216a3adb-ef8d-46c5-bb45-278b2ee19371 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:27.341152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-216a3adb-ef8d-46c5-bb45-278b2ee19371 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:27.344965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-216a3adb-ef8d-46c5-bb45-278b2ee19371 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:27.345465 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-216a3adb-ef8d-46c5-bb45-278b2ee19371 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:27.346000 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-216a3adb-ef8d-46c5-bb45-278b2ee19371 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:27.441346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-216a3adb-ef8d-46c5-bb45-278b2ee19371 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:27.441822 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-216a3adb-ef8d-46c5-bb45-278b2ee19371 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:27.442465 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-216a3adb-ef8d-46c5-bb45-278b2ee19371 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:27.443143 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-216a3adb-ef8d-46c5-bb45-278b2ee19371 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lazy-loading 'fault' on Instance uuid f7ba605d-0996-44eb-b52b-f024db242108 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 15:17:27.498271 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-216a3adb-ef8d-46c5-bb45-278b2ee19371 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:27.507824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-216a3adb-ef8d-46c5-bb45-278b2ee19371 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 200 len: 1332 microversion: 2.1 time: 0.200202 Aug 30 15:17:27.509039 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1156/2317] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:27 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 1332 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:27.793923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-6b8402ac-1a32-425c-8403-a46b8bf2b70e req-ef397b67-8115-4fa2-87c8-2561a8c405fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bf1e549-0324-4db6-a4c7-3921ff741e3c", "name": "network-vif-deleted", "tag": "1d53322c-4273-4da0-9fbb-eddde20eee0f"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:17:27.804767 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-6b8402ac-1a32-425c-8403-a46b8bf2b70e req-ef397b67-8115-4fa2-87c8-2561a8c405fe service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:27.805250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-6b8402ac-1a32-425c-8403-a46b8bf2b70e req-ef397b67-8115-4fa2-87c8-2561a8c405fe service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:27.805681 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-6b8402ac-1a32-425c-8403-a46b8bf2b70e req-ef397b67-8115-4fa2-87c8-2561a8c405fe service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:27.819065 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-6b8402ac-1a32-425c-8403-a46b8bf2b70e req-ef397b67-8115-4fa2-87c8-2561a8c405fe service nova] Creating event network-vif-deleted:1d53322c-4273-4da0-9fbb-eddde20eee0f for instance 1bf1e549-0324-4db6-a4c7-3921ff741e3c on hv-cinder-82880 Aug 30 15:17:27.825003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-6b8402ac-1a32-425c-8403-a46b8bf2b70e req-ef397b67-8115-4fa2-87c8-2561a8c405fe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035309 Aug 30 15:17:27.825629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1162/2318] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:17:27.929936 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fd977ddb-145b-4153-a14e-8ea8332a2f13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:27.930540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fd977ddb-145b-4153-a14e-8ea8332a2f13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:27.937141 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd977ddb-145b-4153-a14e-8ea8332a2f13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:27.937619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd977ddb-145b-4153-a14e-8ea8332a2f13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:27.938047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd977ddb-145b-4153-a14e-8ea8332a2f13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:27.938720 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd977ddb-145b-4153-a14e-8ea8332a2f13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:27.939160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd977ddb-145b-4153-a14e-8ea8332a2f13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:27.939604 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd977ddb-145b-4153-a14e-8ea8332a2f13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:27.971965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd977ddb-145b-4153-a14e-8ea8332a2f13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:27.972460 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd977ddb-145b-4153-a14e-8ea8332a2f13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:27.972887 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd977ddb-145b-4153-a14e-8ea8332a2f13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:27.973317 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-fd977ddb-145b-4153-a14e-8ea8332a2f13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lazy-loading 'fault' on Instance uuid 1bf1e549-0324-4db6-a4c7-3921ff741e3c {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 15:17:28.016036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fd977ddb-145b-4153-a14e-8ea8332a2f13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:28.023622 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fd977ddb-145b-4153-a14e-8ea8332a2f13 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 200 len: 1311 microversion: 2.1 time: 0.097512 Aug 30 15:17:28.024183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1157/2319] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:27 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:28.531064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-81d479f4-cc04-4942-bad9-31d36516c892 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:28.532149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-81d479f4-cc04-4942-bad9-31d36516c892 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:28.540369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81d479f4-cc04-4942-bad9-31d36516c892 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:28.541308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81d479f4-cc04-4942-bad9-31d36516c892 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:28.541838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81d479f4-cc04-4942-bad9-31d36516c892 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:28.542789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81d479f4-cc04-4942-bad9-31d36516c892 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:28.543621 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81d479f4-cc04-4942-bad9-31d36516c892 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:28.544296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-81d479f4-cc04-4942-bad9-31d36516c892 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:28.560420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-81d479f4-cc04-4942-bad9-31d36516c892 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] HTTP exception thrown: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-81d479f4-cc04-4942-bad9-31d36516c892 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Request method failure captured: Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 HTTP/1.1 Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDieu49-1IBQU-11Rv1n2aVKFlzupcDRd0e-qdS5lTtBm3AFS160p71qNjtlKv-ZoutszJEUmAQQIxfaRsQjOyObIUvmq7e_1m4qZxlfjtD3deDtEY4Dc0zEJnoDow1rMf7GXB4oIxBMME5qRDfUwsfPDIrkVpnbKiqdf_fi6sb3TugM Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 15:17:28.562325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 15:17:28.564244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1827feb276a945bb86a2f853126dfb20", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:17:28.564244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:17:28.564244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:17:28.564244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:17:28.564244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:17:28.564244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 15:17:28.564244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 15:17:28.564244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: ecec9a5a18b24ae7ab055c37ea85ca18 Aug 30 15:17:28.564244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:17:28.564244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 15:17:28.564244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. Aug 30 15:17:28.564244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': 'f7ba605d-0996-44eb-b52b-f024db242108'} Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:17:28.565362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. Aug 30 15:17:28.567042 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:17:28.568570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-81d479f4-cc04-4942-bad9-31d36516c892 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Returning 404 to user: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:17:28.568570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-81d479f4-cc04-4942-bad9-31d36516c892 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 404 len: 111 microversion: 2.1 time: 0.038676 Aug 30 15:17:28.568570 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1163/2320] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:28 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:17:28.572986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-59e5b0c8-a682-4370-a0c3-3a7ea853fac0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '.version_select at 0x7f5cba8f3550>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:28.602646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-59e5b0c8-a682-4370-a0c3-3a7ea853fac0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754880151" status: 202 len: 0 microversion: 2.1 time: 0.033118 Aug 30 15:17:28.603730 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1158/2321] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Aug 30 15:17:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754880151 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 15:17:29.044110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-58eb999a-f446-46d9-b6c1-fabe31059cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:29.044800 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-58eb999a-f446-46d9-b6c1-fabe31059cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: 1bf1e549-0324-4db6-a4c7-3921ff741e3c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:29.051905 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-58eb999a-f446-46d9-b6c1-fabe31059cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:29.052439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-58eb999a-f446-46d9-b6c1-fabe31059cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:29.052864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-58eb999a-f446-46d9-b6c1-fabe31059cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:29.053559 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-58eb999a-f446-46d9-b6c1-fabe31059cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:29.054005 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-58eb999a-f446-46d9-b6c1-fabe31059cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:29.054427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-58eb999a-f446-46d9-b6c1-fabe31059cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:29.072072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-58eb999a-f446-46d9-b6c1-fabe31059cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] HTTP exception thrown: Instance 1bf1e549-0324-4db6-a4c7-3921ff741e3c could not be found. Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-58eb999a-f446-46d9-b6c1-fabe31059cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Request method failure captured: Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c HTTP/1.1 Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiHV8l34OZZHwNsM6lH1lEq9yVrUpRfBmeZovqeGZdHzP-i2fdi3fDhAn1Yn4OqxAY-c8j3adWS2dsfjLxxuH2lkmuX086z2M_u_ap-gLP6YJy1Q6J4kjuRWRTjpojkyG-eVDtFa0STcuNEHUUsJRYwLv6xBXQ1t71A68FFQivqPRdQ Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: 65bab38256b44ad6b4b573a2441eb6d3 Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-420783002 Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 15:17:29.073619 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 15:17:29.076374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65bab38256b44ad6b4b573a2441eb6d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_65bab38256b44ad6b4b573a2441eb6d3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65bab38256b44ad6b4b573a2441eb6d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/65bab38256b44ad6b4b573a2441eb6d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:17:29.076374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-ServerRescueNegativeTestJSON-420783002 Aug 30 15:17:29.076374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: 65bab38256b44ad6b4b573a2441eb6d3 Aug 30 15:17:29.076374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-420783002 Aug 30 15:17:29.076374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-ServerRescueNegativeTestJSON-420783002-project Aug 30 15:17:29.076374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 15:17:29.076374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 15:17:29.076374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: 35f28006916040c3b988de6c15093166 Aug 30 15:17:29.076374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-ServerRescueNegativeTestJSON-420783002-project Aug 30 15:17:29.076374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 15:17:29.076374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance 1bf1e549-0324-4db6-a4c7-3921ff741e3c could not be found. Aug 30 15:17:29.076374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': '1bf1e549-0324-4db6-a4c7-3921ff741e3c'} Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bf1e549-0324-4db6-a4c7-3921ff741e3c could not be found. Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:17:29.077439 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bf1e549-0324-4db6-a4c7-3921ff741e3c could not be found. Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bf1e549-0324-4db6-a4c7-3921ff741e3c could not be found. Aug 30 15:17:29.079137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:17:29.081324 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-58eb999a-f446-46d9-b6c1-fabe31059cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Returning 404 to user: Instance 1bf1e549-0324-4db6-a4c7-3921ff741e3c could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:17:29.081324 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-58eb999a-f446-46d9-b6c1-fabe31059cd9 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c" status: 404 len: 111 microversion: 2.1 time: 0.035082 Aug 30 15:17:29.081324 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1164/2322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:29 2022] GET /compute/v2.1/servers/1bf1e549-0324-4db6-a4c7-3921ff741e3c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:17:29.087507 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fe31eb1f-331a-4a17-9e8f-4902c9f29643 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:29.088008 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fe31eb1f-331a-4a17-9e8f-4902c9f29643 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:29.094230 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe31eb1f-331a-4a17-9e8f-4902c9f29643 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:29.094713 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe31eb1f-331a-4a17-9e8f-4902c9f29643 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:29.095150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe31eb1f-331a-4a17-9e8f-4902c9f29643 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:29.095926 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe31eb1f-331a-4a17-9e8f-4902c9f29643 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:29.096371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe31eb1f-331a-4a17-9e8f-4902c9f29643 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:29.096794 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe31eb1f-331a-4a17-9e8f-4902c9f29643 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:29.125310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fe31eb1f-331a-4a17-9e8f-4902c9f29643 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 15:17:29.204682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fe31eb1f-331a-4a17-9e8f-4902c9f29643 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 204 len: 0 microversion: 2.1 time: 0.120346 Aug 30 15:17:29.210163 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1159/2323] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:17:29 2022] DELETE /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 15:17:29.217290 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1462dbef-5d91-4c14-b2de-a07e2603f7be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:29.217997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1462dbef-5d91-4c14-b2de-a07e2603f7be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:29.224163 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1462dbef-5d91-4c14-b2de-a07e2603f7be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:29.224731 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1462dbef-5d91-4c14-b2de-a07e2603f7be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:29.225237 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1462dbef-5d91-4c14-b2de-a07e2603f7be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:29.226144 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1462dbef-5d91-4c14-b2de-a07e2603f7be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:29.226600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1462dbef-5d91-4c14-b2de-a07e2603f7be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:29.227027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1462dbef-5d91-4c14-b2de-a07e2603f7be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:29.431058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1462dbef-5d91-4c14-b2de-a07e2603f7be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:29.439916 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1462dbef-5d91-4c14-b2de-a07e2603f7be tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.227514 Aug 30 15:17:29.440476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1165/2324] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:29 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:29.559888 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5ef6cb07-3d2a-4cd4-9dd3-a8a9d68d12cb tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Action: 'create', calling method: .version_select at 0x7f5cbe0a53a0>, body: {"keypair": {"name": "tempest-keypair-1927656043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvMQP67u0xJD52eqQuBcFLh26mPsXfc2Vmrg6DOrhDvCvsnHvgAgPbnyxShdPk5vOA1Wb4ouMF5HL565PaJ9GzpCKNoEsv/ui+ga0QKWMG0EJ9hJ/iDaqycRRPfbgTKgA=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:17:29.575586 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-5ef6cb07-3d2a-4cd4-9dd3-a8a9d68d12cb tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Getting quotas for project 1827feb276a945bb86a2f853126dfb20. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:17:29.579509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-5ef6cb07-3d2a-4cd4-9dd3-a8a9d68d12cb tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Getting quotas for user ecec9a5a18b24ae7ab055c37ea85ca18 and project 1827feb276a945bb86a2f853126dfb20. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:17:29.600690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5ef6cb07-3d2a-4cd4-9dd3-a8a9d68d12cb tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045088 Aug 30 15:17:29.601318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1160/2325] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 15:17:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:17:30.461367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e4b2d6ff-2b02-4437-8e7f-65160256c303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:30.462109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e4b2d6ff-2b02-4437-8e7f-65160256c303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:30.468864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e4b2d6ff-2b02-4437-8e7f-65160256c303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:30.469339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e4b2d6ff-2b02-4437-8e7f-65160256c303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:30.469771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e4b2d6ff-2b02-4437-8e7f-65160256c303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:30.470467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e4b2d6ff-2b02-4437-8e7f-65160256c303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:30.470919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e4b2d6ff-2b02-4437-8e7f-65160256c303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:30.471368 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e4b2d6ff-2b02-4437-8e7f-65160256c303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:30.693383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e4b2d6ff-2b02-4437-8e7f-65160256c303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:30.702329 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e4b2d6ff-2b02-4437-8e7f-65160256c303 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.244603 Aug 30 15:17:30.703017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1166/2326] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:30 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:30.982184 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-756235406", "imageRef": "fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b10504a6-92ca-453e-86ca-1ca20bff4db6"}], "security_groups": [{"name": "tempest-securitygroup--202188793"}], "key_name": "tempest-keypair-1927656043", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:17:31.089415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] validate_networks() for [('b10504a6-92ca-453e-86ca-1ca20bff4db6', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 15:17:31.557522 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 15:17:31.557937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 15:17:31.558402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 15:17:31.558801 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 15:17:31.559227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 15:17:31.568530 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:31.568997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:31.569421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:31.570127 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:31.570568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:31.570984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:31.588782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Getting quotas for project 1827feb276a945bb86a2f853126dfb20. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:17:31.593310 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Getting quotas for user ecec9a5a18b24ae7ab055c37ea85ca18 and project 1827feb276a945bb86a2f853126dfb20. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:17:31.603882 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 15:17:31.606239 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fd2f6a46-009f-42ef-b1e6-f9abf06ecb5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 15:17:31.654824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-23b81b45-bbac-4aa5-a0d9-c9a587941ef7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.677909 Aug 30 15:17:31.655690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1161/2327] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 15:17:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 15:17:31.666369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bf78f99c-0ebd-4eeb-beec-0af84dc30aa7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:31.666992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bf78f99c-0ebd-4eeb-beec-0af84dc30aa7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:31.723552 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-75a2138d-60fe-4f8b-b4bc-e5078a127772 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:31.724596 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-75a2138d-60fe-4f8b-b4bc-e5078a127772 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:31.732187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75a2138d-60fe-4f8b-b4bc-e5078a127772 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:31.733085 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75a2138d-60fe-4f8b-b4bc-e5078a127772 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:31.733749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75a2138d-60fe-4f8b-b4bc-e5078a127772 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:31.734853 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75a2138d-60fe-4f8b-b4bc-e5078a127772 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:31.735337 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75a2138d-60fe-4f8b-b4bc-e5078a127772 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:31.735477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bf78f99c-0ebd-4eeb-beec-0af84dc30aa7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:31.736061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75a2138d-60fe-4f8b-b4bc-e5078a127772 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:31.747052 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bf78f99c-0ebd-4eeb-beec-0af84dc30aa7 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1241 microversion: 2.1 time: 0.084518 Aug 30 15:17:31.760459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1167/2328] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:31 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:31.876996 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-75a2138d-60fe-4f8b-b4bc-e5078a127772 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:31.884895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-75a2138d-60fe-4f8b-b4bc-e5078a127772 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1522 microversion: 2.1 time: 0.165422 Aug 30 15:17:31.885454 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1162/2329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:31 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:17:32.768984 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fe0ebe81-4477-499f-9b6c-1f56413afa24 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:32.769602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fe0ebe81-4477-499f-9b6c-1f56413afa24 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:32.776578 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe0ebe81-4477-499f-9b6c-1f56413afa24 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:32.777076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe0ebe81-4477-499f-9b6c-1f56413afa24 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:32.777564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe0ebe81-4477-499f-9b6c-1f56413afa24 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:32.778328 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe0ebe81-4477-499f-9b6c-1f56413afa24 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:32.778773 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe0ebe81-4477-499f-9b6c-1f56413afa24 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:32.779292 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fe0ebe81-4477-499f-9b6c-1f56413afa24 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:32.843466 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fe0ebe81-4477-499f-9b6c-1f56413afa24 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:32.857537 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fe0ebe81-4477-499f-9b6c-1f56413afa24 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1293 microversion: 2.1 time: 0.092253 Aug 30 15:17:32.860025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1168/2330] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:32 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:17:32.908691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f2d62efe-a8a3-42d2-9108-8123d3577e11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:32.909514 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f2d62efe-a8a3-42d2-9108-8123d3577e11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:32.918858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2d62efe-a8a3-42d2-9108-8123d3577e11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:32.919579 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2d62efe-a8a3-42d2-9108-8123d3577e11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:32.920613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2d62efe-a8a3-42d2-9108-8123d3577e11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:32.921982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2d62efe-a8a3-42d2-9108-8123d3577e11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:32.922584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2d62efe-a8a3-42d2-9108-8123d3577e11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:32.923157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f2d62efe-a8a3-42d2-9108-8123d3577e11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:32.932693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-1b84a9fb-98a5-49af-85ac-740235a7a995 req-e6e2d9ae-6732-4777-a5db-1a50f668e192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6", "name": "network-vif-deleted", "tag": "a7d69bde-3345-496f-9c80-be4cf35b221d"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:17:32.942703 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-1b84a9fb-98a5-49af-85ac-740235a7a995 req-e6e2d9ae-6732-4777-a5db-1a50f668e192 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:32.943291 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-1b84a9fb-98a5-49af-85ac-740235a7a995 req-e6e2d9ae-6732-4777-a5db-1a50f668e192 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:32.943782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-1b84a9fb-98a5-49af-85ac-740235a7a995 req-e6e2d9ae-6732-4777-a5db-1a50f668e192 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:32.955928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-1b84a9fb-98a5-49af-85ac-740235a7a995 req-e6e2d9ae-6732-4777-a5db-1a50f668e192 service nova] Creating event network-vif-deleted:a7d69bde-3345-496f-9c80-be4cf35b221d for instance d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 on hv-cinder-82880 Aug 30 15:17:32.961407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-1b84a9fb-98a5-49af-85ac-740235a7a995 req-e6e2d9ae-6732-4777-a5db-1a50f668e192 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032238 Aug 30 15:17:32.962608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1169/2331] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 15:17:32.995264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f2d62efe-a8a3-42d2-9108-8123d3577e11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:33.003558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f2d62efe-a8a3-42d2-9108-8123d3577e11 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1480 microversion: 2.1 time: 0.101326 Aug 30 15:17:33.004244 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1163/2332] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:32 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1480 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:33.881496 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-22e5d8e5-6d20-4b2c-9184-4925ebb643de tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:33.882194 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-22e5d8e5-6d20-4b2c-9184-4925ebb643de tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:33.889573 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-22e5d8e5-6d20-4b2c-9184-4925ebb643de tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:33.890055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-22e5d8e5-6d20-4b2c-9184-4925ebb643de tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:33.890484 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-22e5d8e5-6d20-4b2c-9184-4925ebb643de tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:33.891162 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-22e5d8e5-6d20-4b2c-9184-4925ebb643de tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:33.891634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-22e5d8e5-6d20-4b2c-9184-4925ebb643de tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:33.892048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-22e5d8e5-6d20-4b2c-9184-4925ebb643de tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:33.954742 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-22e5d8e5-6d20-4b2c-9184-4925ebb643de tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:33.962238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-22e5d8e5-6d20-4b2c-9184-4925ebb643de tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1293 microversion: 2.1 time: 0.085438 Aug 30 15:17:33.962798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1170/2333] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:33 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:34.028087 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b1ff037d-be2c-4a9e-996a-838c49a061e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:34.029245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b1ff037d-be2c-4a9e-996a-838c49a061e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:34.035584 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1ff037d-be2c-4a9e-996a-838c49a061e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:34.036058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1ff037d-be2c-4a9e-996a-838c49a061e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:34.036483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1ff037d-be2c-4a9e-996a-838c49a061e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:34.037161 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1ff037d-be2c-4a9e-996a-838c49a061e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:34.037603 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1ff037d-be2c-4a9e-996a-838c49a061e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:34.038018 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b1ff037d-be2c-4a9e-996a-838c49a061e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:34.098131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b1ff037d-be2c-4a9e-996a-838c49a061e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:34.105573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b1ff037d-be2c-4a9e-996a-838c49a061e3 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1480 microversion: 2.1 time: 0.081376 Aug 30 15:17:34.106136 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1164/2334] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:34 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1480 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:34.984156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f9bad9b2-5415-447b-a54d-45582a0278c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:34.984762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f9bad9b2-5415-447b-a54d-45582a0278c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:34.991161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9bad9b2-5415-447b-a54d-45582a0278c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:34.991672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9bad9b2-5415-447b-a54d-45582a0278c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:34.992108 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9bad9b2-5415-447b-a54d-45582a0278c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:34.992799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9bad9b2-5415-447b-a54d-45582a0278c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:34.993253 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9bad9b2-5415-447b-a54d-45582a0278c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:34.993679 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f9bad9b2-5415-447b-a54d-45582a0278c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:35.053550 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f9bad9b2-5415-447b-a54d-45582a0278c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:35.061082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f9bad9b2-5415-447b-a54d-45582a0278c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1293 microversion: 2.1 time: 0.081509 Aug 30 15:17:35.061651 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1171/2335] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:34 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:35.125892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-21602216-2846-4343-85cf-863ab7a66fa1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:35.126501 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-21602216-2846-4343-85cf-863ab7a66fa1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:35.132820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21602216-2846-4343-85cf-863ab7a66fa1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:35.133295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21602216-2846-4343-85cf-863ab7a66fa1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:35.133728 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21602216-2846-4343-85cf-863ab7a66fa1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:35.134402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21602216-2846-4343-85cf-863ab7a66fa1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:35.134879 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21602216-2846-4343-85cf-863ab7a66fa1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:35.135327 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21602216-2846-4343-85cf-863ab7a66fa1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:35.139358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:17:35.206019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-21602216-2846-4343-85cf-863ab7a66fa1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f28006916040c3b988de6c15093166', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65bab38256b44ad6b4b573a2441eb6d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:35.214056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-21602216-2846-4343-85cf-863ab7a66fa1 tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 200 len: 1480 microversion: 2.1 time: 0.092177 Aug 30 15:17:35.214629 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1165/2336] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:35 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 1480 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:36.082862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fa93da57-ff16-4354-80fe-503f0c5c8bfd tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:36.083540 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fa93da57-ff16-4354-80fe-503f0c5c8bfd tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:36.089563 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa93da57-ff16-4354-80fe-503f0c5c8bfd tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:36.090037 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa93da57-ff16-4354-80fe-503f0c5c8bfd tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:36.090467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa93da57-ff16-4354-80fe-503f0c5c8bfd tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:36.091162 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa93da57-ff16-4354-80fe-503f0c5c8bfd tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:36.091631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa93da57-ff16-4354-80fe-503f0c5c8bfd tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:36.092061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa93da57-ff16-4354-80fe-503f0c5c8bfd tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:36.210609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fa93da57-ff16-4354-80fe-503f0c5c8bfd tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:36.219243 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fa93da57-ff16-4354-80fe-503f0c5c8bfd tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1299 microversion: 2.1 time: 0.140804 Aug 30 15:17:36.219827 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1172/2337] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:36 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:36.236968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-832f1dfb-9d2d-457c-8732-a89ebdd278bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:36.237611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-832f1dfb-9d2d-457c-8732-a89ebdd278bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] [instance: d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:36.243975 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-832f1dfb-9d2d-457c-8732-a89ebdd278bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:36.244455 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-832f1dfb-9d2d-457c-8732-a89ebdd278bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:36.244885 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-832f1dfb-9d2d-457c-8732-a89ebdd278bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:36.245574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-832f1dfb-9d2d-457c-8732-a89ebdd278bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:36.246019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-832f1dfb-9d2d-457c-8732-a89ebdd278bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:36.246441 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-832f1dfb-9d2d-457c-8732-a89ebdd278bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:36.260249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-832f1dfb-9d2d-457c-8732-a89ebdd278bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] HTTP exception thrown: Instance d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 could not be found. Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-832f1dfb-9d2d-457c-8732-a89ebdd278bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Request method failure captured: Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 HTTP/1.1 Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDiHV8l34OZZHwNsM6lH1lEq9yVrUpRfBmeZovqeGZdHzP-i2fdi3fDhAn1Yn4OqxAY-c8j3adWS2dsfjLxxuH2lkmuX086z2M_u_ap-gLP6YJy1Q6J4kjuRWRTjpojkyG-eVDtFa0STcuNEHUUsJRYwLv6xBXQ1t71A68FFQivqPRdQ Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: 65bab38256b44ad6b4b573a2441eb6d3 Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-420783002 Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:17:36.261929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:17:36.263937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65bab38256b44ad6b4b573a2441eb6d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_65bab38256b44ad6b4b573a2441eb6d3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/65bab38256b44ad6b4b573a2441eb6d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/65bab38256b44ad6b4b573a2441eb6d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:17:36.263937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-ServerRescueNegativeTestJSON-420783002 Aug 30 15:17:36.263937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 65bab38256b44ad6b4b573a2441eb6d3 Aug 30 15:17:36.263937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-420783002 Aug 30 15:17:36.263937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-ServerRescueNegativeTestJSON-420783002-project Aug 30 15:17:36.263937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:17:36.263937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:17:36.263937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: 35f28006916040c3b988de6c15093166 Aug 30 15:17:36.263937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-ServerRescueNegativeTestJSON-420783002-project Aug 30 15:17:36.263937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:17:36.263937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 could not be found. Aug 30 15:17:36.263937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': 'd9a82dfc-22d1-4a29-8457-b2ddb14fa0e6'} Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 could not be found. Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:17:36.265007 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 could not be found. Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 could not be found. Aug 30 15:17:36.266565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:17:36.268075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-832f1dfb-9d2d-457c-8732-a89ebdd278bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] Returning 404 to user: Instance d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:17:36.268075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-832f1dfb-9d2d-457c-8732-a89ebdd278bb tempest-ServerRescueNegativeTestJSON-420783002 tempest-ServerRescueNegativeTestJSON-420783002-project] 10.222.0.30 "GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6" status: 404 len: 111 microversion: 2.1 time: 0.030277 Aug 30 15:17:36.268075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1166/2338] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:36 2022] GET /compute/v2.1/servers/d9a82dfc-22d1-4a29-8457-b2ddb14fa0e6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:17:37.240856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2f89f27e-1a14-466f-8f23-b485ac9a5f35 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:37.241476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2f89f27e-1a14-466f-8f23-b485ac9a5f35 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:37.248846 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f89f27e-1a14-466f-8f23-b485ac9a5f35 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:37.249400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f89f27e-1a14-466f-8f23-b485ac9a5f35 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:37.249908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f89f27e-1a14-466f-8f23-b485ac9a5f35 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:37.250673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f89f27e-1a14-466f-8f23-b485ac9a5f35 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:37.251198 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f89f27e-1a14-466f-8f23-b485ac9a5f35 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:37.251723 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f89f27e-1a14-466f-8f23-b485ac9a5f35 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:37.270442 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:17:37.395034 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-2f89f27e-1a14-466f-8f23-b485ac9a5f35 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:37.402702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2f89f27e-1a14-466f-8f23-b485ac9a5f35 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1366 microversion: 2.1 time: 0.165864 Aug 30 15:17:37.403282 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1173/2339] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:37 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:37.973542 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-bc293939-77ac-4529-9ecf-e777978ba35f req-bd36b00e-5106-48cf-80c4-87a8545e58fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd", "tag": "2055d908-1b44-4384-b9fb-af15852ac4f9"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:17:37.991711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bc293939-77ac-4529-9ecf-e777978ba35f req-bd36b00e-5106-48cf-80c4-87a8545e58fd service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:37.992307 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bc293939-77ac-4529-9ecf-e777978ba35f req-bd36b00e-5106-48cf-80c4-87a8545e58fd service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:37.992983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bc293939-77ac-4529-9ecf-e777978ba35f req-bd36b00e-5106-48cf-80c4-87a8545e58fd service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:38.006892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-bc293939-77ac-4529-9ecf-e777978ba35f req-bd36b00e-5106-48cf-80c4-87a8545e58fd service nova] Creating event network-changed:2055d908-1b44-4384-b9fb-af15852ac4f9 for instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd on hv-cinder-82880 Aug 30 15:17:38.018407 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-bc293939-77ac-4529-9ecf-e777978ba35f req-bd36b00e-5106-48cf-80c4-87a8545e58fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058151 Aug 30 15:17:38.021279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1167/2340] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:17:38.424135 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1157e6e1-67dd-4397-a439-bda2aed80a59 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:38.424918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1157e6e1-67dd-4397-a439-bda2aed80a59 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:38.432713 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1157e6e1-67dd-4397-a439-bda2aed80a59 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:38.433482 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1157e6e1-67dd-4397-a439-bda2aed80a59 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:38.433929 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1157e6e1-67dd-4397-a439-bda2aed80a59 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:38.434817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1157e6e1-67dd-4397-a439-bda2aed80a59 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:38.435494 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1157e6e1-67dd-4397-a439-bda2aed80a59 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:38.435931 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1157e6e1-67dd-4397-a439-bda2aed80a59 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:38.583869 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1157e6e1-67dd-4397-a439-bda2aed80a59 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:38.596577 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1157e6e1-67dd-4397-a439-bda2aed80a59 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1366 microversion: 2.1 time: 0.177092 Aug 30 15:17:38.597777 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1174/2341] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:38 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:39.619237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bf572814-3f65-47be-97ec-cec2d2eca8b8 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:39.619951 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bf572814-3f65-47be-97ec-cec2d2eca8b8 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:39.630084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf572814-3f65-47be-97ec-cec2d2eca8b8 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:39.630571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf572814-3f65-47be-97ec-cec2d2eca8b8 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:39.630998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf572814-3f65-47be-97ec-cec2d2eca8b8 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:39.631715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf572814-3f65-47be-97ec-cec2d2eca8b8 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:39.632358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf572814-3f65-47be-97ec-cec2d2eca8b8 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:39.632951 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bf572814-3f65-47be-97ec-cec2d2eca8b8 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:39.889568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bf572814-3f65-47be-97ec-cec2d2eca8b8 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:39.901815 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bf572814-3f65-47be-97ec-cec2d2eca8b8 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1366 microversion: 2.1 time: 0.287263 Aug 30 15:17:39.907242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1168/2342] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:39 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:40.923901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-59969751-329e-4349-8752-935364702ecf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:40.924523 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-59969751-329e-4349-8752-935364702ecf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:40.931248 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-59969751-329e-4349-8752-935364702ecf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:40.931723 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-59969751-329e-4349-8752-935364702ecf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:40.932159 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-59969751-329e-4349-8752-935364702ecf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:40.932862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-59969751-329e-4349-8752-935364702ecf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:40.933376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-59969751-329e-4349-8752-935364702ecf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:40.933746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-59969751-329e-4349-8752-935364702ecf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:41.256040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-59969751-329e-4349-8752-935364702ecf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:41.272653 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-59969751-329e-4349-8752-935364702ecf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1366 microversion: 2.1 time: 0.352462 Aug 30 15:17:41.273564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1175/2343] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:40 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:42.293964 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7ffee853-69cb-4993-8901-8a1a07631d37 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:42.294725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7ffee853-69cb-4993-8901-8a1a07631d37 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:42.297994 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:17:42.298741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=10 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:17:42.304234 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ffee853-69cb-4993-8901-8a1a07631d37 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:42.304721 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ffee853-69cb-4993-8901-8a1a07631d37 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:42.305433 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ffee853-69cb-4993-8901-8a1a07631d37 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:42.306568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ffee853-69cb-4993-8901-8a1a07631d37 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:42.307312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ffee853-69cb-4993-8901-8a1a07631d37 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:42.307983 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ffee853-69cb-4993-8901-8a1a07631d37 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:42.457329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7ffee853-69cb-4993-8901-8a1a07631d37 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:42.465540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7ffee853-69cb-4993-8901-8a1a07631d37 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1366 microversion: 2.1 time: 0.175478 Aug 30 15:17:42.466202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1169/2344] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:42 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:17:43.391251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:17:43.487473 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dc2ef8d3-3f50-458e-91c5-ed961bdc8e6a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:43.489264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dc2ef8d3-3f50-458e-91c5-ed961bdc8e6a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:43.496149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dc2ef8d3-3f50-458e-91c5-ed961bdc8e6a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:43.496897 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dc2ef8d3-3f50-458e-91c5-ed961bdc8e6a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:43.497536 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dc2ef8d3-3f50-458e-91c5-ed961bdc8e6a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:43.498423 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dc2ef8d3-3f50-458e-91c5-ed961bdc8e6a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:43.498868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dc2ef8d3-3f50-458e-91c5-ed961bdc8e6a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:43.499328 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dc2ef8d3-3f50-458e-91c5-ed961bdc8e6a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:43.547843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-03c5a767-1deb-4ef7-bab9-678ccd074336 req-cf8de86e-e0e2-45de-a80c-31c0017e12a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd", "name": "network-vif-plugged", "status": "completed", "tag": "2055d908-1b44-4384-b9fb-af15852ac4f9"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:17:43.565297 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-03c5a767-1deb-4ef7-bab9-678ccd074336 req-cf8de86e-e0e2-45de-a80c-31c0017e12a7 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:43.565776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-03c5a767-1deb-4ef7-bab9-678ccd074336 req-cf8de86e-e0e2-45de-a80c-31c0017e12a7 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:43.566392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-03c5a767-1deb-4ef7-bab9-678ccd074336 req-cf8de86e-e0e2-45de-a80c-31c0017e12a7 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:43.580247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-03c5a767-1deb-4ef7-bab9-678ccd074336 req-cf8de86e-e0e2-45de-a80c-31c0017e12a7 service nova] Creating event network-vif-plugged:2055d908-1b44-4384-b9fb-af15852ac4f9 for instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd on hv-cinder-82880 Aug 30 15:17:43.585746 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-03c5a767-1deb-4ef7-bab9-678ccd074336 req-cf8de86e-e0e2-45de-a80c-31c0017e12a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199486 Aug 30 15:17:43.587360 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1176/2345] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:17:43.664920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-dc2ef8d3-3f50-458e-91c5-ed961bdc8e6a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:43.681364 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dc2ef8d3-3f50-458e-91c5-ed961bdc8e6a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1366 microversion: 2.1 time: 0.197867 Aug 30 15:17:43.682149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1170/2346] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:43 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:44.704659 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-faa4160a-d48c-4714-ba35-370217d09b30 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:44.705557 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-faa4160a-d48c-4714-ba35-370217d09b30 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:44.712677 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-faa4160a-d48c-4714-ba35-370217d09b30 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:44.713256 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-faa4160a-d48c-4714-ba35-370217d09b30 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:44.713788 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-faa4160a-d48c-4714-ba35-370217d09b30 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:44.714575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-faa4160a-d48c-4714-ba35-370217d09b30 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:44.715140 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-faa4160a-d48c-4714-ba35-370217d09b30 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:44.716452 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-faa4160a-d48c-4714-ba35-370217d09b30 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:44.891403 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-faa4160a-d48c-4714-ba35-370217d09b30 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:44.900586 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-faa4160a-d48c-4714-ba35-370217d09b30 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1366 microversion: 2.1 time: 0.202158 Aug 30 15:17:44.901165 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1177/2347] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:44 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:45.921944 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-28a2ab2b-b1bb-48ce-8883-fd278df8939b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:45.923238 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-28a2ab2b-b1bb-48ce-8883-fd278df8939b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:45.930106 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28a2ab2b-b1bb-48ce-8883-fd278df8939b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:45.930827 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28a2ab2b-b1bb-48ce-8883-fd278df8939b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:45.931354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28a2ab2b-b1bb-48ce-8883-fd278df8939b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:45.932049 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28a2ab2b-b1bb-48ce-8883-fd278df8939b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:45.932733 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28a2ab2b-b1bb-48ce-8883-fd278df8939b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:45.933351 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28a2ab2b-b1bb-48ce-8883-fd278df8939b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:46.077920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-28a2ab2b-b1bb-48ce-8883-fd278df8939b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:17:46.086739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-28a2ab2b-b1bb-48ce-8883-fd278df8939b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1556 microversion: 2.1 time: 0.169017 Aug 30 15:17:46.087588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1171/2348] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:17:45 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:17:46.108295 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2d8533b9-5a38-4838-bc1a-a4ebdafbe9c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:17:46.108847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2d8533b9-5a38-4838-bc1a-a4ebdafbe9c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:17:46.116505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d8533b9-5a38-4838-bc1a-a4ebdafbe9c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:46.116934 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d8533b9-5a38-4838-bc1a-a4ebdafbe9c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:46.117565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d8533b9-5a38-4838-bc1a-a4ebdafbe9c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:46.118405 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d8533b9-5a38-4838-bc1a-a4ebdafbe9c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:46.119048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d8533b9-5a38-4838-bc1a-a4ebdafbe9c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:46.119804 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d8533b9-5a38-4838-bc1a-a4ebdafbe9c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:46.232553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2d8533b9-5a38-4838-bc1a-a4ebdafbe9c0 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128868 Aug 30 15:17:46.233524 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1178/2349] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 30 15:17:46 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:17:47.643202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-2a4b9487-6ab3-4535-b135-3835260c3257 req-79802b95-6f13-4001-9b28-51197fc24d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd", "tag": "2055d908-1b44-4384-b9fb-af15852ac4f9"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:17:47.653527 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2a4b9487-6ab3-4535-b135-3835260c3257 req-79802b95-6f13-4001-9b28-51197fc24d92 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:17:47.654327 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2a4b9487-6ab3-4535-b135-3835260c3257 req-79802b95-6f13-4001-9b28-51197fc24d92 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:17:47.654951 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2a4b9487-6ab3-4535-b135-3835260c3257 req-79802b95-6f13-4001-9b28-51197fc24d92 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:17:47.666835 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-2a4b9487-6ab3-4535-b135-3835260c3257 req-79802b95-6f13-4001-9b28-51197fc24d92 service nova] Creating event network-changed:2055d908-1b44-4384-b9fb-af15852ac4f9 for instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd on hv-cinder-82880 Aug 30 15:17:47.672982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-2a4b9487-6ab3-4535-b135-3835260c3257 req-79802b95-6f13-4001-9b28-51197fc24d92 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033597 Aug 30 15:17:47.677680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1172/2350] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:17:58.097269 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:17:58.098834 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=26 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:17:58.448908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ea736542-6560-46ca-9f89-7b9a1a48536b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Action: 'create', calling method: .version_select at 0x7f5cbaa0b9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-738696658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH8emF8Q4rQjfq+O1f2rVioA8lIGheHEkGnAopcagx2iDYldVVs2wYzUfLGzy7s14C3jB/SU6IxkQgVhAz+0t2scIgB7LvEbaNNk6fq081p2VxsVsrTqlevsyGL17mKwQ=="}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:17:58.465667 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-ea736542-6560-46ca-9f89-7b9a1a48536b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Getting quotas for project 7034e8a9461846a7b08fe7328ecf7a47. Resources: {'key_pairs'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:17:58.470519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-ea736542-6560-46ca-9f89-7b9a1a48536b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Getting quotas for user b2905d19c05b4f53ba70e2bb3d165bc1 and project 7034e8a9461846a7b08fe7328ecf7a47. Resources: {'key_pairs'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:17:58.497822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ea736542-6560-46ca-9f89-7b9a1a48536b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.407765 Aug 30 15:17:58.498534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1179/2351] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 15:17:58 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 15:18:18.250249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:18:18.251608 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=34 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:18:18.256580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2026860304", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-738696658", "security_groups": [{"name": "tempest-secgroup-smoke-254188895"}], "networks": [{"uuid": "04adfbb0-bf0a-45dc-b15a-0b60aecfc0cd"}], "block_device_mapping_v2": [{"uuid": "a7ab36b5-f6bf-45f3-bf6a-e1de0b9a8b24", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:18:18.384994 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] validate_networks() for [('04adfbb0-bf0a-45dc-b15a-0b60aecfc0cd', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 15:18:18.833607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 15:18:18.834425 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 15:18:18.835025 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 15:18:18.835567 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 15:18:18.836041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 15:18:18.847176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:18.847775 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:18.848288 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:18.849108 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:18.849824 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:18.850314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:18.872005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Getting quotas for project 7034e8a9461846a7b08fe7328ecf7a47. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:18:18.877464 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Getting quotas for user b2905d19c05b4f53ba70e2bb3d165bc1 and project 7034e8a9461846a7b08fe7328ecf7a47. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:18:18.943861 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 15:18:18.947431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a7ab36b5-f6bf-45f3-bf6a-e1de0b9a8b24',volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 15:18:19.115367 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-051ec890-88fe-4de0-b323-f602ac61f9e8 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.866544 Aug 30 15:18:19.123077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1173/2352] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 15:18:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 15:18:19.124889 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=4 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:18:19.126031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:18:19.130634 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-feed28f0-af84-430a-96d5-cbe3f04391bc tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:19.134462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-feed28f0-af84-430a-96d5-cbe3f04391bc tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:19.272393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-feed28f0-af84-430a-96d5-cbe3f04391bc tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:19.287561 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-feed28f0-af84-430a-96d5-cbe3f04391bc tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1088 microversion: 2.1 time: 0.163746 Aug 30 15:18:19.288205 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1180/2353] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:19 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1088 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:20.309321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7e7b73b5-f135-4f59-afe9-4357ea464b88 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:20.309948 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7e7b73b5-f135-4f59-afe9-4357ea464b88 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:20.318843 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e7b73b5-f135-4f59-afe9-4357ea464b88 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:20.319428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e7b73b5-f135-4f59-afe9-4357ea464b88 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:20.319861 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e7b73b5-f135-4f59-afe9-4357ea464b88 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:20.320626 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e7b73b5-f135-4f59-afe9-4357ea464b88 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:20.321150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e7b73b5-f135-4f59-afe9-4357ea464b88 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:20.321576 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e7b73b5-f135-4f59-afe9-4357ea464b88 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:20.420352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7e7b73b5-f135-4f59-afe9-4357ea464b88 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:20.428493 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7e7b73b5-f135-4f59-afe9-4357ea464b88 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1186 microversion: 2.1 time: 0.124255 Aug 30 15:18:20.442898 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1174/2354] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:20 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1186 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:21.450238 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e2a69d3b-4e83-43ab-afed-f558e9b29c2b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:21.450800 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e2a69d3b-4e83-43ab-afed-f558e9b29c2b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:21.468112 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e2a69d3b-4e83-43ab-afed-f558e9b29c2b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:21.468626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e2a69d3b-4e83-43ab-afed-f558e9b29c2b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:21.469050 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e2a69d3b-4e83-43ab-afed-f558e9b29c2b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:21.469763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e2a69d3b-4e83-43ab-afed-f558e9b29c2b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:21.470218 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e2a69d3b-4e83-43ab-afed-f558e9b29c2b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:21.470643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e2a69d3b-4e83-43ab-afed-f558e9b29c2b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:21.933303 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e2a69d3b-4e83-43ab-afed-f558e9b29c2b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:21.945085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e2a69d3b-4e83-43ab-afed-f558e9b29c2b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1259 microversion: 2.1 time: 0.498107 Aug 30 15:18:21.972503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1181/2355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:21 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1259 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:22.484255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-a0cd7d73-8822-4680-a220-ab1f92dd9f98 req-6bb96442-969f-40ce-a2b4-30062e227259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f3327fd-09b4-4774-a642-4536e8e856ce", "tag": "a601c9e3-c68b-4e16-9f98-1e1c89bffd76"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:18:22.514739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a0cd7d73-8822-4680-a220-ab1f92dd9f98 req-6bb96442-969f-40ce-a2b4-30062e227259 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:22.515238 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a0cd7d73-8822-4680-a220-ab1f92dd9f98 req-6bb96442-969f-40ce-a2b4-30062e227259 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:22.517787 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a0cd7d73-8822-4680-a220-ab1f92dd9f98 req-6bb96442-969f-40ce-a2b4-30062e227259 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:22.544367 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-a0cd7d73-8822-4680-a220-ab1f92dd9f98 req-6bb96442-969f-40ce-a2b4-30062e227259 service nova] Creating event network-changed:a601c9e3-c68b-4e16-9f98-1e1c89bffd76 for instance 0f3327fd-09b4-4774-a642-4536e8e856ce on hv-cinder-82880 Aug 30 15:18:22.555138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-a0cd7d73-8822-4680-a220-ab1f92dd9f98 req-6bb96442-969f-40ce-a2b4-30062e227259 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075313 Aug 30 15:18:22.559929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1175/2356] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:18:22.970782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9a905d4b-b7db-494a-8a3f-ad5418725c5a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:22.971454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9a905d4b-b7db-494a-8a3f-ad5418725c5a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:22.977886 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a905d4b-b7db-494a-8a3f-ad5418725c5a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:22.981669 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a905d4b-b7db-494a-8a3f-ad5418725c5a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:22.991376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a905d4b-b7db-494a-8a3f-ad5418725c5a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:22.992151 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a905d4b-b7db-494a-8a3f-ad5418725c5a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:22.992627 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a905d4b-b7db-494a-8a3f-ad5418725c5a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:22.993055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9a905d4b-b7db-494a-8a3f-ad5418725c5a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:23.207359 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9a905d4b-b7db-494a-8a3f-ad5418725c5a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:23.232785 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9a905d4b-b7db-494a-8a3f-ad5418725c5a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1259 microversion: 2.1 time: 0.265153 Aug 30 15:18:23.235473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1182/2357] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:22 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1259 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:24.256543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8d30239a-863c-44be-8f01-08f0a72102d7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:24.257548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8d30239a-863c-44be-8f01-08f0a72102d7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:24.264176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d30239a-863c-44be-8f01-08f0a72102d7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:24.266511 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d30239a-863c-44be-8f01-08f0a72102d7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:24.267322 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d30239a-863c-44be-8f01-08f0a72102d7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:24.268313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d30239a-863c-44be-8f01-08f0a72102d7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:24.268933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d30239a-863c-44be-8f01-08f0a72102d7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:24.269528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d30239a-863c-44be-8f01-08f0a72102d7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:24.502134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8d30239a-863c-44be-8f01-08f0a72102d7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:24.510799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8d30239a-863c-44be-8f01-08f0a72102d7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1259 microversion: 2.1 time: 0.258299 Aug 30 15:18:24.511659 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1176/2358] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:24 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1259 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:25.243377 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7ddf27a4-829e-4dcc-b187-7566e84dfae6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:25.244799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7ddf27a4-829e-4dcc-b187-7566e84dfae6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:25.251813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ddf27a4-829e-4dcc-b187-7566e84dfae6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:25.252294 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ddf27a4-829e-4dcc-b187-7566e84dfae6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:25.252724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ddf27a4-829e-4dcc-b187-7566e84dfae6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:25.253413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ddf27a4-829e-4dcc-b187-7566e84dfae6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:25.253857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ddf27a4-829e-4dcc-b187-7566e84dfae6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:25.254536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7ddf27a4-829e-4dcc-b187-7566e84dfae6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:25.294551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7ddf27a4-829e-4dcc-b187-7566e84dfae6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd/ips" status: 200 len: 150 microversion: 2.1 time: 0.051059 Aug 30 15:18:25.295459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1183/2359] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 30 15:18:25 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd/ips => generated 150 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:18:25.532212 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-59c1579f-9ac6-4e73-aec2-c53d2bd938ac tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:25.533471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-59c1579f-9ac6-4e73-aec2-c53d2bd938ac tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:25.541903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59c1579f-9ac6-4e73-aec2-c53d2bd938ac tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:25.543191 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59c1579f-9ac6-4e73-aec2-c53d2bd938ac tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:25.543957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59c1579f-9ac6-4e73-aec2-c53d2bd938ac tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:25.545146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59c1579f-9ac6-4e73-aec2-c53d2bd938ac tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:25.550296 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59c1579f-9ac6-4e73-aec2-c53d2bd938ac tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:25.550799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59c1579f-9ac6-4e73-aec2-c53d2bd938ac tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:25.752252 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-59c1579f-9ac6-4e73-aec2-c53d2bd938ac tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:25.762802 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-59c1579f-9ac6-4e73-aec2-c53d2bd938ac tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1259 microversion: 2.1 time: 0.233998 Aug 30 15:18:25.763348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1177/2360] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:25 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:26.752385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4543e8b7-ab0b-4da9-a1a9-e559d5399245 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a760d33-c7ad-4440-aad6-b94f8deb13bf"}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:18:26.754814 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4543e8b7-ab0b-4da9-a1a9-e559d5399245 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:26.768040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4543e8b7-ab0b-4da9-a1a9-e559d5399245 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:26.768690 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4543e8b7-ab0b-4da9-a1a9-e559d5399245 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:26.769221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4543e8b7-ab0b-4da9-a1a9-e559d5399245 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:26.770049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4543e8b7-ab0b-4da9-a1a9-e559d5399245 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:26.770609 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4543e8b7-ab0b-4da9-a1a9-e559d5399245 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:26.771134 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4543e8b7-ab0b-4da9-a1a9-e559d5399245 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:26.786806 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e091fa12-3b57-4795-9272-29073cef0f10 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:26.787561 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e091fa12-3b57-4795-9272-29073cef0f10 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:26.802889 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e091fa12-3b57-4795-9272-29073cef0f10 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:26.803968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e091fa12-3b57-4795-9272-29073cef0f10 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:26.805842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e091fa12-3b57-4795-9272-29073cef0f10 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:26.806809 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e091fa12-3b57-4795-9272-29073cef0f10 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:26.813005 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e091fa12-3b57-4795-9272-29073cef0f10 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:26.814001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e091fa12-3b57-4795-9272-29073cef0f10 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:27.008948 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e091fa12-3b57-4795-9272-29073cef0f10 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:27.020321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e091fa12-3b57-4795-9272-29073cef0f10 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1259 microversion: 2.1 time: 0.240309 Aug 30 15:18:27.021417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1178/2361] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:26 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:18:27.202548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4543e8b7-ab0b-4da9-a1a9-e559d5399245 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "POST /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.453935 Aug 30 15:18:27.203380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1184/2362] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 15:18:26 2022] POST /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:18:28.043799 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c9757409-d793-4356-975d-34b2531009fd tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:28.044424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c9757409-d793-4356-975d-34b2531009fd tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:28.060769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9757409-d793-4356-975d-34b2531009fd tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:28.061426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9757409-d793-4356-975d-34b2531009fd tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:28.061933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9757409-d793-4356-975d-34b2531009fd tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:28.063245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9757409-d793-4356-975d-34b2531009fd tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:28.063916 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9757409-d793-4356-975d-34b2531009fd tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:28.069588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9757409-d793-4356-975d-34b2531009fd tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:28.310671 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c9757409-d793-4356-975d-34b2531009fd tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:28.319524 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c9757409-d793-4356-975d-34b2531009fd tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1259 microversion: 2.1 time: 0.281547 Aug 30 15:18:28.321146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1179/2363] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:28 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1259 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:29.339551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:18:29.345833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-67ecb7e4-10dd-4d03-9ecc-f46bc67f219c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:29.346817 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-67ecb7e4-10dd-4d03-9ecc-f46bc67f219c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:29.357277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-67ecb7e4-10dd-4d03-9ecc-f46bc67f219c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:29.358086 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-67ecb7e4-10dd-4d03-9ecc-f46bc67f219c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:29.358692 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-67ecb7e4-10dd-4d03-9ecc-f46bc67f219c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:29.359738 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-67ecb7e4-10dd-4d03-9ecc-f46bc67f219c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:29.360365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-67ecb7e4-10dd-4d03-9ecc-f46bc67f219c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:29.360954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-67ecb7e4-10dd-4d03-9ecc-f46bc67f219c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:29.557063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-67ecb7e4-10dd-4d03-9ecc-f46bc67f219c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:29.570225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-67ecb7e4-10dd-4d03-9ecc-f46bc67f219c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1259 microversion: 2.1 time: 0.232617 Aug 30 15:18:29.585363 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1185/2364] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:29 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:30.593309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f5fb4c4e-bab0-4f3f-9bee-45100ef1f657 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:30.594075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f5fb4c4e-bab0-4f3f-9bee-45100ef1f657 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:30.599746 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:18:30.600777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:18:30.602963 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5fb4c4e-bab0-4f3f-9bee-45100ef1f657 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:30.603640 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5fb4c4e-bab0-4f3f-9bee-45100ef1f657 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:30.604113 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5fb4c4e-bab0-4f3f-9bee-45100ef1f657 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:30.604908 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5fb4c4e-bab0-4f3f-9bee-45100ef1f657 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:30.605439 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5fb4c4e-bab0-4f3f-9bee-45100ef1f657 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:30.605919 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5fb4c4e-bab0-4f3f-9bee-45100ef1f657 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:30.759021 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f5fb4c4e-bab0-4f3f-9bee-45100ef1f657 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:30.771508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f5fb4c4e-bab0-4f3f-9bee-45100ef1f657 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1259 microversion: 2.1 time: 0.181857 Aug 30 15:18:30.787263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1180/2365] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:30 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:31.792244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-90a0a4b9-e220-4426-9e79-05e0419c0b9a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:31.792991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-90a0a4b9-e220-4426-9e79-05e0419c0b9a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:31.799405 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-90a0a4b9-e220-4426-9e79-05e0419c0b9a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:31.799952 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-90a0a4b9-e220-4426-9e79-05e0419c0b9a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:31.800626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-90a0a4b9-e220-4426-9e79-05e0419c0b9a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:31.801494 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-90a0a4b9-e220-4426-9e79-05e0419c0b9a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:31.801943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-90a0a4b9-e220-4426-9e79-05e0419c0b9a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:31.802388 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-90a0a4b9-e220-4426-9e79-05e0419c0b9a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:32.289704 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-90a0a4b9-e220-4426-9e79-05e0419c0b9a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:32.297497 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-90a0a4b9-e220-4426-9e79-05e0419c0b9a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1259 microversion: 2.1 time: 0.509050 Aug 30 15:18:32.311505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1186/2366] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:31 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1259 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:33.318313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9c1bfda3-6936-4574-a3ea-0cdfba00d268 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:33.318930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9c1bfda3-6936-4574-a3ea-0cdfba00d268 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:33.331067 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c1bfda3-6936-4574-a3ea-0cdfba00d268 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:33.331716 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c1bfda3-6936-4574-a3ea-0cdfba00d268 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:33.332150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c1bfda3-6936-4574-a3ea-0cdfba00d268 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:33.332882 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c1bfda3-6936-4574-a3ea-0cdfba00d268 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:33.333333 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c1bfda3-6936-4574-a3ea-0cdfba00d268 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:33.333753 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9c1bfda3-6936-4574-a3ea-0cdfba00d268 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:33.493502 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9c1bfda3-6936-4574-a3ea-0cdfba00d268 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:33.502558 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9c1bfda3-6936-4574-a3ea-0cdfba00d268 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1259 microversion: 2.1 time: 0.188357 Aug 30 15:18:33.520858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1181/2367] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:33 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1259 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:33.674448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-2aa40545-eeaf-499b-8963-394608eb395f req-2685c592-0b3e-49a8-a300-86eaf1493424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3327fd-09b4-4774-a642-4536e8e856ce", "name": "network-vif-plugged", "status": "completed", "tag": "a601c9e3-c68b-4e16-9f98-1e1c89bffd76"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:18:33.689903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-2aa40545-eeaf-499b-8963-394608eb395f req-2685c592-0b3e-49a8-a300-86eaf1493424 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:33.690392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-2aa40545-eeaf-499b-8963-394608eb395f req-2685c592-0b3e-49a8-a300-86eaf1493424 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:33.690847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-2aa40545-eeaf-499b-8963-394608eb395f req-2685c592-0b3e-49a8-a300-86eaf1493424 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:33.727643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-2aa40545-eeaf-499b-8963-394608eb395f req-2685c592-0b3e-49a8-a300-86eaf1493424 service nova] Creating event network-vif-plugged:a601c9e3-c68b-4e16-9f98-1e1c89bffd76 for instance 0f3327fd-09b4-4774-a642-4536e8e856ce on hv-cinder-82880 Aug 30 15:18:33.734516 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-2aa40545-eeaf-499b-8963-394608eb395f req-2685c592-0b3e-49a8-a300-86eaf1493424 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063664 Aug 30 15:18:33.735921 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1187/2368] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:18:34.525961 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1d9ff00e-f5d7-401e-887a-a5584691976c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:34.527311 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1d9ff00e-f5d7-401e-887a-a5584691976c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:34.534157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d9ff00e-f5d7-401e-887a-a5584691976c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:34.534993 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d9ff00e-f5d7-401e-887a-a5584691976c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:34.535635 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d9ff00e-f5d7-401e-887a-a5584691976c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:34.536550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d9ff00e-f5d7-401e-887a-a5584691976c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:34.537196 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d9ff00e-f5d7-401e-887a-a5584691976c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:34.537792 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d9ff00e-f5d7-401e-887a-a5584691976c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:34.688077 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1d9ff00e-f5d7-401e-887a-a5584691976c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:34.695720 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1d9ff00e-f5d7-401e-887a-a5584691976c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1259 microversion: 2.1 time: 0.173701 Aug 30 15:18:34.709665 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1182/2369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:34 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:34.966048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9c918537-7f65-4f03-8e70-1e395998e113 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Action: 'create', calling method: .version_select at 0x7f5cbaa1faf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-511404298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFa39hIPrTuMImYy1rDKEil3AWQDREkEicbTbWTWm5fJ9cxIpiq6BoCr7dV7hcZVEKW9LNf2SNbZL0OJ2BXaTUl27jJZgSp/7dpTl6pmY5TiY7yh0Xdf1IWIcCWDujs1g=="}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:18:34.984954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-9c918537-7f65-4f03-8e70-1e395998e113 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Getting quotas for project 4edd140cb317483e8e7e3f04cdee048c. Resources: {'key_pairs'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:18:34.988889 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-9c918537-7f65-4f03-8e70-1e395998e113 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Getting quotas for user 93a00d9af55a42fa8d5628fa81dcae80 and project 4edd140cb317483e8e7e3f04cdee048c. Resources: {'key_pairs'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:18:35.011392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9c918537-7f65-4f03-8e70-1e395998e113 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049955 Aug 30 15:18:35.011984 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1188/2370] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 15:18:34 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:18:35.046321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c0d6d37b-2054-40cc-9dd4-9e6cf69fbd03 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:35.046807 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c0d6d37b-2054-40cc-9dd4-9e6cf69fbd03 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:35.052589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0d6d37b-2054-40cc-9dd4-9e6cf69fbd03 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:35.053060 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0d6d37b-2054-40cc-9dd4-9e6cf69fbd03 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:35.053486 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0d6d37b-2054-40cc-9dd4-9e6cf69fbd03 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:35.054501 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0d6d37b-2054-40cc-9dd4-9e6cf69fbd03 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:35.054954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0d6d37b-2054-40cc-9dd4-9e6cf69fbd03 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:35.055400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c0d6d37b-2054-40cc-9dd4-9e6cf69fbd03 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:35.063373 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-300530447", "imageRef": "26e88d23-6a43-4eda-ad83-3e55439b89c5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-511404298", "networks": [{"uuid": "281b09e8-00d6-4180-8005-3b46f13ea18a"}]}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:18:35.116811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.network.neutron [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] validate_networks() for [('281b09e8-00d6-4180-8005-3b46f13ea18a', None, None, None, None, None)] {{(pid=127089) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 15:18:35.158049 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-c0d6d37b-2054-40cc-9dd4-9e6cf69fbd03 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lazy-loading 'services' on Instance uuid 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 15:18:35.233319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c0d6d37b-2054-40cc-9dd4-9e6cf69fbd03 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd/os-volume_attachments/3a760d33-c7ad-4440-aad6-b94f8deb13bf" status: 202 len: 0 microversion: 2.1 time: 0.191175 Aug 30 15:18:35.233911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1183/2371] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 15:18:35 2022] DELETE /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd/os-volume_attachments/3a760d33-c7ad-4440-aad6-b94f8deb13bf => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 15:18:35.242760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-25355961-a921-4fe3-b49d-841c2b4e9e61 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:35.245283 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-25355961-a921-4fe3-b49d-841c2b4e9e61 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:35.251845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25355961-a921-4fe3-b49d-841c2b4e9e61 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:35.252326 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25355961-a921-4fe3-b49d-841c2b4e9e61 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:35.252760 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25355961-a921-4fe3-b49d-841c2b4e9e61 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:35.253508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25355961-a921-4fe3-b49d-841c2b4e9e61 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:35.253977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25355961-a921-4fe3-b49d-841c2b4e9e61 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:35.254398 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25355961-a921-4fe3-b49d-841c2b4e9e61 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:35.285131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-25355961-a921-4fe3-b49d-841c2b4e9e61 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046497 Aug 30 15:18:35.285687 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1184/2372] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 15:18:35 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:18:35.599755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Flavor limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 15:18:35.600306 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Image limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 15:18:35.601012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Flavor pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 15:18:35.601870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Image pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 15:18:35.602367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 15:18:35.611353 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:35.611833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:35.612285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:35.613032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:35.613483 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:35.613903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:35.630056 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Getting quotas for project 4edd140cb317483e8e7e3f04cdee048c. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:18:35.634019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Getting quotas for user 93a00d9af55a42fa8d5628fa81dcae80 and project 4edd140cb317483e8e7e3f04cdee048c. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:18:35.645249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Going to run 1 instances... {{(pid=127089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 15:18:35.647571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26e88d23-6a43-4eda-ad83-3e55439b89c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 15:18:35.695959 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0a306efa-ecb6-4b41-9c1e-a49ea4f65d38 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636560 Aug 30 15:18:35.696594 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1189/2373] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 15:18:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 15:18:35.707649 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cc9c91ef-2917-4863-a5a5-75f12dce63d1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:35.708254 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cc9c91ef-2917-4863-a5a5-75f12dce63d1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:35.717607 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0c618c8d-00c6-4ca7-ade8-a7bb88e6c114 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:35.718546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0c618c8d-00c6-4ca7-ade8-a7bb88e6c114 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:35.724376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c618c8d-00c6-4ca7-ade8-a7bb88e6c114 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:35.724864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c618c8d-00c6-4ca7-ade8-a7bb88e6c114 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:35.725290 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c618c8d-00c6-4ca7-ade8-a7bb88e6c114 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:35.726017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c618c8d-00c6-4ca7-ade8-a7bb88e6c114 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:35.726757 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c618c8d-00c6-4ca7-ade8-a7bb88e6c114 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:35.727185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0c618c8d-00c6-4ca7-ade8-a7bb88e6c114 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:35.770990 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cc9c91ef-2917-4863-a5a5-75f12dce63d1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:35.780398 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cc9c91ef-2917-4863-a5a5-75f12dce63d1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1257 microversion: 2.1 time: 0.076421 Aug 30 15:18:35.780978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1185/2374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:35 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1257 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:18:35.866670 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0c618c8d-00c6-4ca7-ade8-a7bb88e6c114 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:35.875605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0c618c8d-00c6-4ca7-ade8-a7bb88e6c114 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1442 microversion: 2.1 time: 0.162605 Aug 30 15:18:35.876180 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1190/2375] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:35 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1442 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:18:35.896543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5b7f5570-5e50-4625-8bd1-5a9903d68a7b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:35.897237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5b7f5570-5e50-4625-8bd1-5a9903d68a7b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:35.903438 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b7f5570-5e50-4625-8bd1-5a9903d68a7b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:35.903924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b7f5570-5e50-4625-8bd1-5a9903d68a7b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:35.904359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b7f5570-5e50-4625-8bd1-5a9903d68a7b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:35.905047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b7f5570-5e50-4625-8bd1-5a9903d68a7b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:35.905497 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b7f5570-5e50-4625-8bd1-5a9903d68a7b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:35.905913 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5b7f5570-5e50-4625-8bd1-5a9903d68a7b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:36.056821 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5b7f5570-5e50-4625-8bd1-5a9903d68a7b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:36.065309 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5b7f5570-5e50-4625-8bd1-5a9903d68a7b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1442 microversion: 2.1 time: 0.172866 Aug 30 15:18:36.065881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1186/2376] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:35 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1442 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:36.298701 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-da68749a-e61c-4f8d-a680-3e85f8196aa6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:36.301125 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-da68749a-e61c-4f8d-a680-3e85f8196aa6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:36.310145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da68749a-e61c-4f8d-a680-3e85f8196aa6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:36.310844 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da68749a-e61c-4f8d-a680-3e85f8196aa6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:36.311486 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da68749a-e61c-4f8d-a680-3e85f8196aa6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:36.313300 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da68749a-e61c-4f8d-a680-3e85f8196aa6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:36.313910 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da68749a-e61c-4f8d-a680-3e85f8196aa6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:36.314856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-da68749a-e61c-4f8d-a680-3e85f8196aa6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:36.359991 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-da68749a-e61c-4f8d-a680-3e85f8196aa6 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065538 Aug 30 15:18:36.360882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1191/2377] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 15:18:36 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:18:36.800614 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f7f10895-c07a-4f1b-a042-059dd4a7e2eb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:36.801133 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f7f10895-c07a-4f1b-a042-059dd4a7e2eb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:36.808038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7f10895-c07a-4f1b-a042-059dd4a7e2eb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:36.808528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7f10895-c07a-4f1b-a042-059dd4a7e2eb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:36.808968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7f10895-c07a-4f1b-a042-059dd4a7e2eb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:36.809697 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7f10895-c07a-4f1b-a042-059dd4a7e2eb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:36.810438 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7f10895-c07a-4f1b-a042-059dd4a7e2eb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:36.810869 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7f10895-c07a-4f1b-a042-059dd4a7e2eb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:36.886565 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f7f10895-c07a-4f1b-a042-059dd4a7e2eb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:36.899645 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f7f10895-c07a-4f1b-a042-059dd4a7e2eb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1309 microversion: 2.1 time: 0.102747 Aug 30 15:18:36.900279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1187/2378] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:36 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:37.377536 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2f7723c8-e76d-4809-9c91-2c57fcd8ccfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:37.385121 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2f7723c8-e76d-4809-9c91-2c57fcd8ccfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:37.403720 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f7723c8-e76d-4809-9c91-2c57fcd8ccfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:37.404605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f7723c8-e76d-4809-9c91-2c57fcd8ccfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:37.406161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f7723c8-e76d-4809-9c91-2c57fcd8ccfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:37.408420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f7723c8-e76d-4809-9c91-2c57fcd8ccfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:37.410995 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f7723c8-e76d-4809-9c91-2c57fcd8ccfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:37.411519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2f7723c8-e76d-4809-9c91-2c57fcd8ccfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:37.480699 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2f7723c8-e76d-4809-9c91-2c57fcd8ccfc tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109048 Aug 30 15:18:37.481307 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1192/2379] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 15:18:37 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 15:18:37.589946 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a961ece9-ab34-452a-b88a-e11599f3420e tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:37.590569 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a961ece9-ab34-452a-b88a-e11599f3420e tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:37.602999 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a961ece9-ab34-452a-b88a-e11599f3420e tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:37.603574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a961ece9-ab34-452a-b88a-e11599f3420e tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:37.604010 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a961ece9-ab34-452a-b88a-e11599f3420e tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:37.605768 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a961ece9-ab34-452a-b88a-e11599f3420e tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:37.606224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a961ece9-ab34-452a-b88a-e11599f3420e tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:37.606690 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a961ece9-ab34-452a-b88a-e11599f3420e tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:37.664939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a961ece9-ab34-452a-b88a-e11599f3420e tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 15:18:37.840185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a961ece9-ab34-452a-b88a-e11599f3420e tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 204 len: 0 microversion: 2.1 time: 0.253567 Aug 30 15:18:37.840982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1188/2380] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:18:37 2022] DELETE /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 15:18:37.850851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d98fdc99-45b7-44e2-9d8e-d216d605defb tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:37.851857 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d98fdc99-45b7-44e2-9d8e-d216d605defb tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:37.866080 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d98fdc99-45b7-44e2-9d8e-d216d605defb tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:37.868079 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d98fdc99-45b7-44e2-9d8e-d216d605defb tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:37.868883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d98fdc99-45b7-44e2-9d8e-d216d605defb tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:37.870895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d98fdc99-45b7-44e2-9d8e-d216d605defb tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:37.875919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d98fdc99-45b7-44e2-9d8e-d216d605defb tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:37.876707 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d98fdc99-45b7-44e2-9d8e-d216d605defb tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:37.922322 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b5b48886-702b-437f-aa02-87ab8a1b5c2c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:37.923445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b5b48886-702b-437f-aa02-87ab8a1b5c2c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:37.929791 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5b48886-702b-437f-aa02-87ab8a1b5c2c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:37.944776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5b48886-702b-437f-aa02-87ab8a1b5c2c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:37.945519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5b48886-702b-437f-aa02-87ab8a1b5c2c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:37.946570 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5b48886-702b-437f-aa02-87ab8a1b5c2c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:37.947741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5b48886-702b-437f-aa02-87ab8a1b5c2c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:37.948873 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5b48886-702b-437f-aa02-87ab8a1b5c2c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:38.000549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:18:38.102096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b5b48886-702b-437f-aa02-87ab8a1b5c2c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:38.119532 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b5b48886-702b-437f-aa02-87ab8a1b5c2c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1315 microversion: 2.1 time: 0.197101 Aug 30 15:18:38.122786 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1189/2381] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:37 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:18:38.324242 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d98fdc99-45b7-44e2-9d8e-d216d605defb tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:38.333105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d98fdc99-45b7-44e2-9d8e-d216d605defb tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1681 microversion: 2.1 time: 0.487499 Aug 30 15:18:38.335047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1193/2382] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:37 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1681 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:38.436040 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-ddb055ba-b804-4ee9-a996-17630ff89030 req-7f9e913a-e50d-440a-9963-9f7bfcc235ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f3327fd-09b4-4774-a642-4536e8e856ce", "tag": "a601c9e3-c68b-4e16-9f98-1e1c89bffd76"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:18:38.445853 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ddb055ba-b804-4ee9-a996-17630ff89030 req-7f9e913a-e50d-440a-9963-9f7bfcc235ed service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:38.446429 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ddb055ba-b804-4ee9-a996-17630ff89030 req-7f9e913a-e50d-440a-9963-9f7bfcc235ed service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:38.446920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ddb055ba-b804-4ee9-a996-17630ff89030 req-7f9e913a-e50d-440a-9963-9f7bfcc235ed service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:38.459470 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-ddb055ba-b804-4ee9-a996-17630ff89030 req-7f9e913a-e50d-440a-9963-9f7bfcc235ed service nova] Creating event network-changed:a601c9e3-c68b-4e16-9f98-1e1c89bffd76 for instance 0f3327fd-09b4-4774-a642-4536e8e856ce on hv-cinder-82880 Aug 30 15:18:38.464958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-ddb055ba-b804-4ee9-a996-17630ff89030 req-7f9e913a-e50d-440a-9963-9f7bfcc235ed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190106 Aug 30 15:18:38.469026 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1190/2383] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 15:18:39.143320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-09a61942-a1b7-4f6f-8b34-c67600a7f4f2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:39.143946 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-09a61942-a1b7-4f6f-8b34-c67600a7f4f2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:39.150560 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-09a61942-a1b7-4f6f-8b34-c67600a7f4f2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:39.151048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-09a61942-a1b7-4f6f-8b34-c67600a7f4f2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:39.152052 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-09a61942-a1b7-4f6f-8b34-c67600a7f4f2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:39.152760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-09a61942-a1b7-4f6f-8b34-c67600a7f4f2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:39.153220 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-09a61942-a1b7-4f6f-8b34-c67600a7f4f2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:39.153647 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-09a61942-a1b7-4f6f-8b34-c67600a7f4f2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:39.290005 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-09a61942-a1b7-4f6f-8b34-c67600a7f4f2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:39.298533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-09a61942-a1b7-4f6f-8b34-c67600a7f4f2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.159174 Aug 30 15:18:39.299102 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1194/2384] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:39 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:39.357420 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9a356681-0afb-46cb-8250-94f394dbd31b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:39.358125 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9a356681-0afb-46cb-8250-94f394dbd31b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:39.364607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a356681-0afb-46cb-8250-94f394dbd31b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:39.365198 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a356681-0afb-46cb-8250-94f394dbd31b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:39.365638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a356681-0afb-46cb-8250-94f394dbd31b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:39.366394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a356681-0afb-46cb-8250-94f394dbd31b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:39.366851 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a356681-0afb-46cb-8250-94f394dbd31b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:39.367387 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a356681-0afb-46cb-8250-94f394dbd31b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:39.547969 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9a356681-0afb-46cb-8250-94f394dbd31b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:39.556244 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9a356681-0afb-46cb-8250-94f394dbd31b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1681 microversion: 2.1 time: 0.204256 Aug 30 15:18:39.561621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1191/2385] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:39 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:40.325011 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-873e7d1a-dd4b-4d7a-97d9-8db93958dac7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:40.326225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-873e7d1a-dd4b-4d7a-97d9-8db93958dac7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:40.333333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-873e7d1a-dd4b-4d7a-97d9-8db93958dac7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:40.333825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-873e7d1a-dd4b-4d7a-97d9-8db93958dac7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:40.334262 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-873e7d1a-dd4b-4d7a-97d9-8db93958dac7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:40.334973 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-873e7d1a-dd4b-4d7a-97d9-8db93958dac7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:40.335495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-873e7d1a-dd4b-4d7a-97d9-8db93958dac7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:40.335923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-873e7d1a-dd4b-4d7a-97d9-8db93958dac7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:40.471312 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-873e7d1a-dd4b-4d7a-97d9-8db93958dac7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:40.479976 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-873e7d1a-dd4b-4d7a-97d9-8db93958dac7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.163206 Aug 30 15:18:40.480555 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1195/2386] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:40 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:40.580262 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d3541197-9077-44d7-b592-b8caba2ecaac tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:40.581513 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d3541197-9077-44d7-b592-b8caba2ecaac tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:40.588081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3541197-9077-44d7-b592-b8caba2ecaac tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:40.589075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3541197-9077-44d7-b592-b8caba2ecaac tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:40.589503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3541197-9077-44d7-b592-b8caba2ecaac tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:40.590327 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3541197-9077-44d7-b592-b8caba2ecaac tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:40.590774 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3541197-9077-44d7-b592-b8caba2ecaac tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:40.591184 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3541197-9077-44d7-b592-b8caba2ecaac tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:40.734312 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d3541197-9077-44d7-b592-b8caba2ecaac tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:40.742742 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d3541197-9077-44d7-b592-b8caba2ecaac tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1681 microversion: 2.1 time: 0.168105 Aug 30 15:18:40.757372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1192/2387] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:40 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:41.501436 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-380c975d-0a10-4996-b00f-f5fa3287e678 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:41.502060 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-380c975d-0a10-4996-b00f-f5fa3287e678 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:41.508833 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-380c975d-0a10-4996-b00f-f5fa3287e678 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:41.509329 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-380c975d-0a10-4996-b00f-f5fa3287e678 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:41.509764 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-380c975d-0a10-4996-b00f-f5fa3287e678 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:41.510998 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-380c975d-0a10-4996-b00f-f5fa3287e678 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:41.511606 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-380c975d-0a10-4996-b00f-f5fa3287e678 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:41.512033 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-380c975d-0a10-4996-b00f-f5fa3287e678 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:41.653885 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-380c975d-0a10-4996-b00f-f5fa3287e678 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:41.662985 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-380c975d-0a10-4996-b00f-f5fa3287e678 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.165513 Aug 30 15:18:41.663904 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1196/2388] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:41 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:18:41.766631 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-07be4a8c-8960-405f-8f68-4274594ae23d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:41.767249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-07be4a8c-8960-405f-8f68-4274594ae23d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:41.773581 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07be4a8c-8960-405f-8f68-4274594ae23d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:41.774048 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07be4a8c-8960-405f-8f68-4274594ae23d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:41.774471 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07be4a8c-8960-405f-8f68-4274594ae23d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:41.775146 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07be4a8c-8960-405f-8f68-4274594ae23d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:41.775613 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07be4a8c-8960-405f-8f68-4274594ae23d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:41.777805 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-07be4a8c-8960-405f-8f68-4274594ae23d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:41.925008 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-07be4a8c-8960-405f-8f68-4274594ae23d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:41.933361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-07be4a8c-8960-405f-8f68-4274594ae23d tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1681 microversion: 2.1 time: 0.170575 Aug 30 15:18:41.933933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1193/2389] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:41 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:42.687075 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8c9a52b1-0e7f-46d5-ade4-fff7288a18bb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:42.688810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8c9a52b1-0e7f-46d5-ade4-fff7288a18bb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:42.700710 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c9a52b1-0e7f-46d5-ade4-fff7288a18bb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:42.701201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c9a52b1-0e7f-46d5-ade4-fff7288a18bb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:42.701680 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c9a52b1-0e7f-46d5-ade4-fff7288a18bb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:42.702428 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c9a52b1-0e7f-46d5-ade4-fff7288a18bb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:42.702883 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c9a52b1-0e7f-46d5-ade4-fff7288a18bb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:42.703431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8c9a52b1-0e7f-46d5-ade4-fff7288a18bb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:42.857836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8c9a52b1-0e7f-46d5-ade4-fff7288a18bb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:42.865657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8c9a52b1-0e7f-46d5-ade4-fff7288a18bb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.185197 Aug 30 15:18:42.866244 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1197/2390] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:42 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:42.954490 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-35f47c84-cf18-4d0a-85eb-830917500d1c tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:42.955029 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-35f47c84-cf18-4d0a-85eb-830917500d1c tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:42.961755 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35f47c84-cf18-4d0a-85eb-830917500d1c tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:42.962240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35f47c84-cf18-4d0a-85eb-830917500d1c tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:42.962680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35f47c84-cf18-4d0a-85eb-830917500d1c tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:42.963405 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35f47c84-cf18-4d0a-85eb-830917500d1c tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:42.963906 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35f47c84-cf18-4d0a-85eb-830917500d1c tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:42.964509 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35f47c84-cf18-4d0a-85eb-830917500d1c tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:43.121243 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-35f47c84-cf18-4d0a-85eb-830917500d1c tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:43.130806 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-35f47c84-cf18-4d0a-85eb-830917500d1c tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1681 microversion: 2.1 time: 0.180198 Aug 30 15:18:43.131483 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1194/2391] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:42 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:43.889909 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-86180a3d-4dc5-46ca-b96c-e71f508425c1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:43.892063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-86180a3d-4dc5-46ca-b96c-e71f508425c1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:43.898810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86180a3d-4dc5-46ca-b96c-e71f508425c1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:43.899430 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86180a3d-4dc5-46ca-b96c-e71f508425c1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:43.899958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86180a3d-4dc5-46ca-b96c-e71f508425c1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:43.900737 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86180a3d-4dc5-46ca-b96c-e71f508425c1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:43.901912 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86180a3d-4dc5-46ca-b96c-e71f508425c1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:43.902401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-86180a3d-4dc5-46ca-b96c-e71f508425c1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:44.067925 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-86180a3d-4dc5-46ca-b96c-e71f508425c1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:44.071864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:18:44.080769 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-86180a3d-4dc5-46ca-b96c-e71f508425c1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.198609 Aug 30 15:18:44.081501 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1198/2392] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:43 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:44.152611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b770ada2-4a87-4fa7-b43c-de4ca08a4206 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:44.153439 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b770ada2-4a87-4fa7-b43c-de4ca08a4206 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:44.160897 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b770ada2-4a87-4fa7-b43c-de4ca08a4206 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:44.161693 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b770ada2-4a87-4fa7-b43c-de4ca08a4206 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:44.162224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b770ada2-4a87-4fa7-b43c-de4ca08a4206 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:44.162909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b770ada2-4a87-4fa7-b43c-de4ca08a4206 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:44.163383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b770ada2-4a87-4fa7-b43c-de4ca08a4206 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:44.163877 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b770ada2-4a87-4fa7-b43c-de4ca08a4206 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:44.328921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b770ada2-4a87-4fa7-b43c-de4ca08a4206 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:44.339650 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b770ada2-4a87-4fa7-b43c-de4ca08a4206 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1681 microversion: 2.1 time: 0.190668 Aug 30 15:18:44.340313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1195/2393] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:44 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:45.102281 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9439314d-109c-400b-8162-1add38f89978 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:45.103133 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9439314d-109c-400b-8162-1add38f89978 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:45.110997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9439314d-109c-400b-8162-1add38f89978 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:45.111509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9439314d-109c-400b-8162-1add38f89978 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:45.112169 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9439314d-109c-400b-8162-1add38f89978 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:45.112887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9439314d-109c-400b-8162-1add38f89978 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:45.113339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9439314d-109c-400b-8162-1add38f89978 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:45.113750 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9439314d-109c-400b-8162-1add38f89978 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:45.263487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9439314d-109c-400b-8162-1add38f89978 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:45.274899 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9439314d-109c-400b-8162-1add38f89978 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.176733 Aug 30 15:18:45.275747 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1199/2394] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:45 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:45.363941 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b771d042-e6a0-49c3-a1c4-2fa43e48bf68 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:45.365182 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b771d042-e6a0-49c3-a1c4-2fa43e48bf68 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:45.372463 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b771d042-e6a0-49c3-a1c4-2fa43e48bf68 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:45.372970 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b771d042-e6a0-49c3-a1c4-2fa43e48bf68 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:45.373399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b771d042-e6a0-49c3-a1c4-2fa43e48bf68 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:45.374088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b771d042-e6a0-49c3-a1c4-2fa43e48bf68 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:45.374573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b771d042-e6a0-49c3-a1c4-2fa43e48bf68 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:45.375054 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b771d042-e6a0-49c3-a1c4-2fa43e48bf68 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:45.514064 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b771d042-e6a0-49c3-a1c4-2fa43e48bf68 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:45.521894 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b771d042-e6a0-49c3-a1c4-2fa43e48bf68 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1681 microversion: 2.1 time: 0.161958 Aug 30 15:18:45.531383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1196/2395] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:45 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:46.297749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-43ccd62a-e9f0-45ab-9d03-75ba78626c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:46.298393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-43ccd62a-e9f0-45ab-9d03-75ba78626c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:46.300266 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:18:46.301416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=10 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:18:46.309195 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-43ccd62a-e9f0-45ab-9d03-75ba78626c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:46.309798 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-43ccd62a-e9f0-45ab-9d03-75ba78626c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:46.310319 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-43ccd62a-e9f0-45ab-9d03-75ba78626c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:46.311895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-43ccd62a-e9f0-45ab-9d03-75ba78626c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:46.312348 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-43ccd62a-e9f0-45ab-9d03-75ba78626c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:46.312766 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-43ccd62a-e9f0-45ab-9d03-75ba78626c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:46.451850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-43ccd62a-e9f0-45ab-9d03-75ba78626c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:46.459422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-43ccd62a-e9f0-45ab-9d03-75ba78626c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.166256 Aug 30 15:18:46.459990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1200/2396] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:46 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:46.544211 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ca16a9cf-5623-4253-bc80-3cf9453e26b9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:46.545545 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ca16a9cf-5623-4253-bc80-3cf9453e26b9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:46.547905 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:18:46.554117 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca16a9cf-5623-4253-bc80-3cf9453e26b9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:46.554603 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca16a9cf-5623-4253-bc80-3cf9453e26b9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:46.555068 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca16a9cf-5623-4253-bc80-3cf9453e26b9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:46.555784 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca16a9cf-5623-4253-bc80-3cf9453e26b9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:46.556261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca16a9cf-5623-4253-bc80-3cf9453e26b9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:46.556689 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca16a9cf-5623-4253-bc80-3cf9453e26b9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:46.695741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ca16a9cf-5623-4253-bc80-3cf9453e26b9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:46.705548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ca16a9cf-5623-4253-bc80-3cf9453e26b9 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1681 microversion: 2.1 time: 0.164847 Aug 30 15:18:46.705726 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1197/2397] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:46 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:47.480595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-9412ec2c-d458-4669-88cd-9e2c240001b5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:47.481212 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-9412ec2c-d458-4669-88cd-9e2c240001b5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:47.487623 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9412ec2c-d458-4669-88cd-9e2c240001b5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:47.488103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9412ec2c-d458-4669-88cd-9e2c240001b5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:47.488534 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9412ec2c-d458-4669-88cd-9e2c240001b5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:47.489217 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9412ec2c-d458-4669-88cd-9e2c240001b5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:47.489687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9412ec2c-d458-4669-88cd-9e2c240001b5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:47.490090 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-9412ec2c-d458-4669-88cd-9e2c240001b5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:47.621658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-9412ec2c-d458-4669-88cd-9e2c240001b5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:47.629164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-9412ec2c-d458-4669-88cd-9e2c240001b5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.153073 Aug 30 15:18:47.629735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1201/2398] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:47 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:47.726950 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e9a9b493-0ac4-4869-9881-8b8d805c0c31 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:47.727594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e9a9b493-0ac4-4869-9881-8b8d805c0c31 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:47.734609 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9a9b493-0ac4-4869-9881-8b8d805c0c31 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:47.735093 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9a9b493-0ac4-4869-9881-8b8d805c0c31 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:47.735560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9a9b493-0ac4-4869-9881-8b8d805c0c31 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:47.736242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9a9b493-0ac4-4869-9881-8b8d805c0c31 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:47.736687 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9a9b493-0ac4-4869-9881-8b8d805c0c31 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:47.737104 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9a9b493-0ac4-4869-9881-8b8d805c0c31 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:47.865487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e9a9b493-0ac4-4869-9881-8b8d805c0c31 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:47.874174 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e9a9b493-0ac4-4869-9881-8b8d805c0c31 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1681 microversion: 2.1 time: 0.151005 Aug 30 15:18:47.874758 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1198/2399] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:47 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:48.649974 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-83f65b99-60e2-4f6b-8109-db3467f1376b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:48.650656 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-83f65b99-60e2-4f6b-8109-db3467f1376b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:48.658103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83f65b99-60e2-4f6b-8109-db3467f1376b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:48.658815 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83f65b99-60e2-4f6b-8109-db3467f1376b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:48.659541 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83f65b99-60e2-4f6b-8109-db3467f1376b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:48.660309 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83f65b99-60e2-4f6b-8109-db3467f1376b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:48.660836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83f65b99-60e2-4f6b-8109-db3467f1376b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:48.661321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-83f65b99-60e2-4f6b-8109-db3467f1376b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:48.897994 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f9a1ad76-d9bc-4060-867a-0255ee112c8b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:48.899998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f9a1ad76-d9bc-4060-867a-0255ee112c8b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:48.905335 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:18:48.915840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9a1ad76-d9bc-4060-867a-0255ee112c8b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:48.917051 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9a1ad76-d9bc-4060-867a-0255ee112c8b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:48.918122 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9a1ad76-d9bc-4060-867a-0255ee112c8b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:48.918959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9a1ad76-d9bc-4060-867a-0255ee112c8b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:48.919574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9a1ad76-d9bc-4060-867a-0255ee112c8b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:48.920092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9a1ad76-d9bc-4060-867a-0255ee112c8b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:48.937419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-83f65b99-60e2-4f6b-8109-db3467f1376b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:48.952249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-83f65b99-60e2-4f6b-8109-db3467f1376b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.303030 Aug 30 15:18:48.952976 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1202/2400] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:48 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:49.236924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f9a1ad76-d9bc-4060-867a-0255ee112c8b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecec9a5a18b24ae7ab055c37ea85ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1827feb276a945bb86a2f853126dfb20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:49.246240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f9a1ad76-d9bc-4060-867a-0255ee112c8b tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 200 len: 1681 microversion: 2.1 time: 0.352722 Aug 30 15:18:49.247306 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1199/2401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:48 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 1681 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:49.377842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-a2babf80-1bc4-4696-8269-b2fe9d648263 req-ebeb0a94-2420-4eee-a4be-8b3ae1669ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d580a6e1-4d83-4f3d-a9a2-9760bb114e5c", "tag": "45797295-84d5-44d0-9f67-1a93953c8e34"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:18:49.386714 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:18:49.388836 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-a2babf80-1bc4-4696-8269-b2fe9d648263 req-ebeb0a94-2420-4eee-a4be-8b3ae1669ffa service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:49.389496 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-a2babf80-1bc4-4696-8269-b2fe9d648263 req-ebeb0a94-2420-4eee-a4be-8b3ae1669ffa service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:49.390074 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-a2babf80-1bc4-4696-8269-b2fe9d648263 req-ebeb0a94-2420-4eee-a4be-8b3ae1669ffa service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:49.407745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-a2babf80-1bc4-4696-8269-b2fe9d648263 req-ebeb0a94-2420-4eee-a4be-8b3ae1669ffa service nova] Creating event network-changed:45797295-84d5-44d0-9f67-1a93953c8e34 for instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c on hv-cinder-82880 Aug 30 15:18:49.414011 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-a2babf80-1bc4-4696-8269-b2fe9d648263 req-ebeb0a94-2420-4eee-a4be-8b3ae1669ffa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040416 Aug 30 15:18:49.414842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1203/2402] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:18:49.507995 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-8252ac0f-a8cb-4028-826c-772ab3c2ec4c req-cbf77c2a-6a82-4c86-94d0-e4594a6088f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd", "name": "network-vif-deleted", "tag": "2055d908-1b44-4384-b9fb-af15852ac4f9"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:18:49.524372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-8252ac0f-a8cb-4028-826c-772ab3c2ec4c req-cbf77c2a-6a82-4c86-94d0-e4594a6088f0 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:49.524868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-8252ac0f-a8cb-4028-826c-772ab3c2ec4c req-cbf77c2a-6a82-4c86-94d0-e4594a6088f0 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:49.525652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-8252ac0f-a8cb-4028-826c-772ab3c2ec4c req-cbf77c2a-6a82-4c86-94d0-e4594a6088f0 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:49.543155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-8252ac0f-a8cb-4028-826c-772ab3c2ec4c req-cbf77c2a-6a82-4c86-94d0-e4594a6088f0 service nova] Creating event network-vif-deleted:2055d908-1b44-4384-b9fb-af15852ac4f9 for instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd on hv-cinder-82880 Aug 30 15:18:49.551011 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-8252ac0f-a8cb-4028-826c-772ab3c2ec4c req-cbf77c2a-6a82-4c86-94d0-e4594a6088f0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048880 Aug 30 15:18:49.552349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1200/2403] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:18:49.975250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-92548467-71e0-463c-9cd2-4568d209a08b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:49.975962 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-92548467-71e0-463c-9cd2-4568d209a08b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:49.982317 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-92548467-71e0-463c-9cd2-4568d209a08b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:49.982813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-92548467-71e0-463c-9cd2-4568d209a08b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:49.983267 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-92548467-71e0-463c-9cd2-4568d209a08b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:49.983961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-92548467-71e0-463c-9cd2-4568d209a08b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:49.984413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-92548467-71e0-463c-9cd2-4568d209a08b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:49.984838 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-92548467-71e0-463c-9cd2-4568d209a08b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:50.131271 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-92548467-71e0-463c-9cd2-4568d209a08b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:50.139801 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-92548467-71e0-463c-9cd2-4568d209a08b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.169959 Aug 30 15:18:50.140675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1204/2404] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:49 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:50.268650 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-40cdd9b8-fa04-411c-a5f4-43332fd7884a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:50.269351 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-40cdd9b8-fa04-411c-a5f4-43332fd7884a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:50.275850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40cdd9b8-fa04-411c-a5f4-43332fd7884a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:50.276340 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40cdd9b8-fa04-411c-a5f4-43332fd7884a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:50.276769 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40cdd9b8-fa04-411c-a5f4-43332fd7884a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:50.277477 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40cdd9b8-fa04-411c-a5f4-43332fd7884a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:50.277929 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40cdd9b8-fa04-411c-a5f4-43332fd7884a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:50.278351 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-40cdd9b8-fa04-411c-a5f4-43332fd7884a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:50.291793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-40cdd9b8-fa04-411c-a5f4-43332fd7884a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] HTTP exception thrown: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-40cdd9b8-fa04-411c-a5f4-43332fd7884a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Request method failure captured: Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd HTTP/1.1 Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDieu49-1IBQU-11Rv1n2aVKFlzupcDRd0e-qdS5lTtBm3AFS160p71qNjtlKv-ZoutszJEUmAQQIxfaRsQjOyObIUvmq7e_1m4qZxlfjtD3deDtEY4Dc0zEJnoDow1rMf7GXB4oIxBMME5qRDfUwsfPDIrkVpnbKiqdf_fi6sb3TugM Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:18:50.293421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:18:50.294800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1827feb276a945bb86a2f853126dfb20", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:18:50.294800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:50.294800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:18:50.294800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:50.294800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:18:50.294800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:18:50.294800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:18:50.294800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: ecec9a5a18b24ae7ab055c37ea85ca18 Aug 30 15:18:50.294800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:18:50.294800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:18:50.294800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. Aug 30 15:18:50.294800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': '1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd'} Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:18:50.295575 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. Aug 30 15:18:50.296636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:50.297526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-40cdd9b8-fa04-411c-a5f4-43332fd7884a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Returning 404 to user: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:18:50.297526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-40cdd9b8-fa04-411c-a5f4-43332fd7884a tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 404 len: 111 microversion: 2.1 time: 0.031015 Aug 30 15:18:50.297526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1201/2405] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:50 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:18:50.303733 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-89ae1744-3357-4814-8981-5f0b766b6fa1 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '.version_select at 0x7f5cbaa1fca0>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:50.325581 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-89ae1744-3357-4814-8981-5f0b766b6fa1 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1927656043" status: 202 len: 0 microversion: 2.1 time: 0.025619 Aug 30 15:18:50.326170 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1205/2406] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Aug 30 15:18:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1927656043 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 15:18:51.160430 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-959d7d22-392a-48d0-b64c-5d32cbae18e6 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:51.161089 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-959d7d22-392a-48d0-b64c-5d32cbae18e6 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:51.167720 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-959d7d22-392a-48d0-b64c-5d32cbae18e6 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:51.168294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-959d7d22-392a-48d0-b64c-5d32cbae18e6 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:51.168731 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-959d7d22-392a-48d0-b64c-5d32cbae18e6 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:51.169416 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-959d7d22-392a-48d0-b64c-5d32cbae18e6 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:51.169884 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-959d7d22-392a-48d0-b64c-5d32cbae18e6 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:51.170295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-959d7d22-392a-48d0-b64c-5d32cbae18e6 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:51.396612 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-959d7d22-392a-48d0-b64c-5d32cbae18e6 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:51.404417 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-959d7d22-392a-48d0-b64c-5d32cbae18e6 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.247873 Aug 30 15:18:51.405076 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1202/2407] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:51 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:52.063786 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d1c5b838-9a0d-47a3-990e-a568a82794bf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:52.064289 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d1c5b838-9a0d-47a3-990e-a568a82794bf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:52.070183 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1c5b838-9a0d-47a3-990e-a568a82794bf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:52.070667 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1c5b838-9a0d-47a3-990e-a568a82794bf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:52.071105 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1c5b838-9a0d-47a3-990e-a568a82794bf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:52.071823 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1c5b838-9a0d-47a3-990e-a568a82794bf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:52.072279 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1c5b838-9a0d-47a3-990e-a568a82794bf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:52.072854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d1c5b838-9a0d-47a3-990e-a568a82794bf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:52.086223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-d1c5b838-9a0d-47a3-990e-a568a82794bf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] HTTP exception thrown: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d1c5b838-9a0d-47a3-990e-a568a82794bf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Request method failure captured: Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: DELETE /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd HTTP/1.1 Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDieu49-1IBQU-11Rv1n2aVKFlzupcDRd0e-qdS5lTtBm3AFS160p71qNjtlKv-ZoutszJEUmAQQIxfaRsQjOyObIUvmq7e_1m4qZxlfjtD3deDtEY4Dc0zEJnoDow1rMf7GXB4oIxBMME5qRDfUwsfPDIrkVpnbKiqdf_fi6sb3TugM Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 15:18:52.087900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 15:18:52.089003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1827feb276a945bb86a2f853126dfb20", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:18:52.089003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:52.089003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:18:52.089003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:52.089003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:18:52.089003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 15:18:52.089003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 15:18:52.089003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: ecec9a5a18b24ae7ab055c37ea85ca18 Aug 30 15:18:52.089003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:18:52.089003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 15:18:52.089003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. Aug 30 15:18:52.089003 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': '1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd'} Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:18:52.089585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. Aug 30 15:18:52.090509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:18:52.091772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d1c5b838-9a0d-47a3-990e-a568a82794bf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Returning 404 to user: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:18:52.091772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d1c5b838-9a0d-47a3-990e-a568a82794bf tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 404 len: 111 microversion: 2.1 time: 0.029963 Aug 30 15:18:52.091772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1206/2408] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:18:52 2022] DELETE /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:18:52.097868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ada2bec9-a9e0-4294-abe6-0c8478433dad tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:52.098636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ada2bec9-a9e0-4294-abe6-0c8478433dad tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:52.105088 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ada2bec9-a9e0-4294-abe6-0c8478433dad tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:52.105564 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ada2bec9-a9e0-4294-abe6-0c8478433dad tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:52.105996 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ada2bec9-a9e0-4294-abe6-0c8478433dad tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:52.106677 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ada2bec9-a9e0-4294-abe6-0c8478433dad tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:52.107123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ada2bec9-a9e0-4294-abe6-0c8478433dad tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:52.107573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ada2bec9-a9e0-4294-abe6-0c8478433dad tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:52.122056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-ada2bec9-a9e0-4294-abe6-0c8478433dad tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] HTTP exception thrown: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ada2bec9-a9e0-4294-abe6-0c8478433dad tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Request method failure captured: Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd HTTP/1.1 Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDieu49-1IBQU-11Rv1n2aVKFlzupcDRd0e-qdS5lTtBm3AFS160p71qNjtlKv-ZoutszJEUmAQQIxfaRsQjOyObIUvmq7e_1m4qZxlfjtD3deDtEY4Dc0zEJnoDow1rMf7GXB4oIxBMME5qRDfUwsfPDIrkVpnbKiqdf_fi6sb3TugM Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:18:52.123621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:18:52.124881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1827feb276a945bb86a2f853126dfb20", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:18:52.124881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:52.124881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:18:52.124881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:52.124881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:18:52.124881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:18:52.124881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:18:52.124881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: ecec9a5a18b24ae7ab055c37ea85ca18 Aug 30 15:18:52.124881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:18:52.124881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:18:52.124881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. Aug 30 15:18:52.124881 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': '1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd'} Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:18:52.128594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. Aug 30 15:18:52.129762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:52.130800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ada2bec9-a9e0-4294-abe6-0c8478433dad tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Returning 404 to user: Instance 1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:18:52.130800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ada2bec9-a9e0-4294-abe6-0c8478433dad tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd" status: 404 len: 111 microversion: 2.1 time: 0.031150 Aug 30 15:18:52.130800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1203/2409] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:52 2022] GET /compute/v2.1/servers/1f2c8a7d-564c-4645-a1c9-7cb2dad8b9bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:18:52.425013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-249a4e87-220c-44e3-8f9c-cdddf334f378 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:52.425644 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-249a4e87-220c-44e3-8f9c-cdddf334f378 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:52.431437 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-249a4e87-220c-44e3-8f9c-cdddf334f378 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:52.431993 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-249a4e87-220c-44e3-8f9c-cdddf334f378 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:52.432511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-249a4e87-220c-44e3-8f9c-cdddf334f378 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:52.433211 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-249a4e87-220c-44e3-8f9c-cdddf334f378 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:52.433657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-249a4e87-220c-44e3-8f9c-cdddf334f378 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:52.434074 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-249a4e87-220c-44e3-8f9c-cdddf334f378 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:52.568540 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-249a4e87-220c-44e3-8f9c-cdddf334f378 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:52.576481 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-249a4e87-220c-44e3-8f9c-cdddf334f378 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.155412 Aug 30 15:18:52.577049 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1207/2410] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:52 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:53.262322 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ef70ea85-b9d1-4799-a238-22a51caab718 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:53.262802 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ef70ea85-b9d1-4799-a238-22a51caab718 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:53.269107 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef70ea85-b9d1-4799-a238-22a51caab718 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:53.269574 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef70ea85-b9d1-4799-a238-22a51caab718 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:53.269998 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef70ea85-b9d1-4799-a238-22a51caab718 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:53.270666 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef70ea85-b9d1-4799-a238-22a51caab718 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:53.271107 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef70ea85-b9d1-4799-a238-22a51caab718 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:53.271541 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef70ea85-b9d1-4799-a238-22a51caab718 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:53.284590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-ef70ea85-b9d1-4799-a238-22a51caab718 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] HTTP exception thrown: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ef70ea85-b9d1-4799-a238-22a51caab718 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Request method failure captured: Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 HTTP/1.1 Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDieu49-1IBQU-11Rv1n2aVKFlzupcDRd0e-qdS5lTtBm3AFS160p71qNjtlKv-ZoutszJEUmAQQIxfaRsQjOyObIUvmq7e_1m4qZxlfjtD3deDtEY4Dc0zEJnoDow1rMf7GXB4oIxBMME5qRDfUwsfPDIrkVpnbKiqdf_fi6sb3TugM Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:18:53.286128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:18:53.287389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1827feb276a945bb86a2f853126dfb20", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:18:53.287389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:53.287389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:18:53.287389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:53.287389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:18:53.287389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:18:53.287389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:18:53.287389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: ecec9a5a18b24ae7ab055c37ea85ca18 Aug 30 15:18:53.287389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:18:53.287389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:18:53.287389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. Aug 30 15:18:53.287389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': 'f7ba605d-0996-44eb-b52b-f024db242108'} Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:18:53.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. Aug 30 15:18:53.289204 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.290123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ef70ea85-b9d1-4799-a238-22a51caab718 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Returning 404 to user: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:18:53.290123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ef70ea85-b9d1-4799-a238-22a51caab718 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 404 len: 111 microversion: 2.1 time: 0.029710 Aug 30 15:18:53.290123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1204/2411] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:18:53 2022] DELETE /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:18:53.296037 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3d38beb6-9ec3-4e3e-96bd-258d6d7ca741 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:53.296652 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3d38beb6-9ec3-4e3e-96bd-258d6d7ca741 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: f7ba605d-0996-44eb-b52b-f024db242108] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:53.303005 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d38beb6-9ec3-4e3e-96bd-258d6d7ca741 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:53.303529 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d38beb6-9ec3-4e3e-96bd-258d6d7ca741 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:53.303961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d38beb6-9ec3-4e3e-96bd-258d6d7ca741 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:53.304643 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d38beb6-9ec3-4e3e-96bd-258d6d7ca741 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:53.305090 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d38beb6-9ec3-4e3e-96bd-258d6d7ca741 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:53.305510 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3d38beb6-9ec3-4e3e-96bd-258d6d7ca741 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:53.323705 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-3d38beb6-9ec3-4e3e-96bd-258d6d7ca741 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] HTTP exception thrown: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3d38beb6-9ec3-4e3e-96bd-258d6d7ca741 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Request method failure captured: Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 HTTP/1.1 Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDieu49-1IBQU-11Rv1n2aVKFlzupcDRd0e-qdS5lTtBm3AFS160p71qNjtlKv-ZoutszJEUmAQQIxfaRsQjOyObIUvmq7e_1m4qZxlfjtD3deDtEY4Dc0zEJnoDow1rMf7GXB4oIxBMME5qRDfUwsfPDIrkVpnbKiqdf_fi6sb3TugM Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 15:18:53.325505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 15:18:53.326776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1827feb276a945bb86a2f853126dfb20", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:18:53.326776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:53.326776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:18:53.326776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:53.326776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:18:53.326776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 15:18:53.326776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 15:18:53.326776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: ecec9a5a18b24ae7ab055c37ea85ca18 Aug 30 15:18:53.326776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:18:53.326776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 15:18:53.326776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. Aug 30 15:18:53.326776 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': 'f7ba605d-0996-44eb-b52b-f024db242108'} Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:18:53.327495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. Aug 30 15:18:53.328503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.329341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3d38beb6-9ec3-4e3e-96bd-258d6d7ca741 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Returning 404 to user: Instance f7ba605d-0996-44eb-b52b-f024db242108 could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:18:53.329341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3d38beb6-9ec3-4e3e-96bd-258d6d7ca741 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108" status: 404 len: 111 microversion: 2.1 time: 0.034730 Aug 30 15:18:53.329341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1208/2412] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:53 2022] GET /compute/v2.1/servers/f7ba605d-0996-44eb-b52b-f024db242108 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:18:53.335235 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-14cabb3d-f0b5-4c78-956c-42c35ac68673 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:53.335743 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-14cabb3d-f0b5-4c78-956c-42c35ac68673 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:53.341777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14cabb3d-f0b5-4c78-956c-42c35ac68673 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:53.342256 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14cabb3d-f0b5-4c78-956c-42c35ac68673 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:53.342691 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14cabb3d-f0b5-4c78-956c-42c35ac68673 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:53.343474 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14cabb3d-f0b5-4c78-956c-42c35ac68673 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:53.343928 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14cabb3d-f0b5-4c78-956c-42c35ac68673 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:53.344350 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14cabb3d-f0b5-4c78-956c-42c35ac68673 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:53.357548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-14cabb3d-f0b5-4c78-956c-42c35ac68673 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] HTTP exception thrown: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-14cabb3d-f0b5-4c78-956c-42c35ac68673 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Request method failure captured: Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e HTTP/1.1 Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDieu49-1IBQU-11Rv1n2aVKFlzupcDRd0e-qdS5lTtBm3AFS160p71qNjtlKv-ZoutszJEUmAQQIxfaRsQjOyObIUvmq7e_1m4qZxlfjtD3deDtEY4Dc0zEJnoDow1rMf7GXB4oIxBMME5qRDfUwsfPDIrkVpnbKiqdf_fi6sb3TugM Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:18:53.359061 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:18:53.360373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1827feb276a945bb86a2f853126dfb20", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:18:53.360373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:53.360373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:18:53.360373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:53.360373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:18:53.360373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:18:53.360373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:18:53.360373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: ecec9a5a18b24ae7ab055c37ea85ca18 Aug 30 15:18:53.360373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:18:53.360373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:18:53.360373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. Aug 30 15:18:53.360373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': '39aba1ac-3d8a-4a6d-b897-2447e6e5137e'} Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:18:53.361232 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. Aug 30 15:18:53.362440 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.363629 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-14cabb3d-f0b5-4c78-956c-42c35ac68673 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Returning 404 to user: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:18:53.363629 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-14cabb3d-f0b5-4c78-956c-42c35ac68673 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "DELETE /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 404 len: 111 microversion: 2.1 time: 0.029065 Aug 30 15:18:53.363629 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1205/2413] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:18:53 2022] DELETE /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:18:53.368970 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-596d98ea-ac48-4d73-baad-dc09c3053410 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:53.370104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-596d98ea-ac48-4d73-baad-dc09c3053410 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] [instance: 39aba1ac-3d8a-4a6d-b897-2447e6e5137e] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:53.376013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-596d98ea-ac48-4d73-baad-dc09c3053410 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:53.376492 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-596d98ea-ac48-4d73-baad-dc09c3053410 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:53.376923 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-596d98ea-ac48-4d73-baad-dc09c3053410 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:53.377604 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-596d98ea-ac48-4d73-baad-dc09c3053410 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:53.378053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-596d98ea-ac48-4d73-baad-dc09c3053410 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:53.378472 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-596d98ea-ac48-4d73-baad-dc09c3053410 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:53.392058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-596d98ea-ac48-4d73-baad-dc09c3053410 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] HTTP exception thrown: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-596d98ea-ac48-4d73-baad-dc09c3053410 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Request method failure captured: Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e HTTP/1.1 Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDieu49-1IBQU-11Rv1n2aVKFlzupcDRd0e-qdS5lTtBm3AFS160p71qNjtlKv-ZoutszJEUmAQQIxfaRsQjOyObIUvmq7e_1m4qZxlfjtD3deDtEY4Dc0zEJnoDow1rMf7GXB4oIxBMME5qRDfUwsfPDIrkVpnbKiqdf_fi6sb3TugM Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 15:18:53.393551 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 15:18:53.394864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_1827feb276a945bb86a2f853126dfb20", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/1827feb276a945bb86a2f853126dfb20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:18:53.394864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:53.394864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: 1827feb276a945bb86a2f853126dfb20 Aug 30 15:18:53.394864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-15072782 Aug 30 15:18:53.394864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:18:53.394864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 15:18:53.394864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 15:18:53.394864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: ecec9a5a18b24ae7ab055c37ea85ca18 Aug 30 15:18:53.394864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-AttachVolumeNegativeTest-15072782-project Aug 30 15:18:53.394864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 15:18:53.394864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. Aug 30 15:18:53.394864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': '39aba1ac-3d8a-4a6d-b897-2447e6e5137e'} Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:18:53.395749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. Aug 30 15:18:53.396956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:18:53.398031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-596d98ea-ac48-4d73-baad-dc09c3053410 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] Returning 404 to user: Instance 39aba1ac-3d8a-4a6d-b897-2447e6e5137e could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:18:53.398031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-596d98ea-ac48-4d73-baad-dc09c3053410 tempest-AttachVolumeNegativeTest-15072782 tempest-AttachVolumeNegativeTest-15072782-project] 10.222.0.30 "GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e" status: 404 len: 111 microversion: 2.1 time: 0.029751 Aug 30 15:18:53.398031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1209/2414] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:53 2022] GET /compute/v2.1/servers/39aba1ac-3d8a-4a6d-b897-2447e6e5137e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:18:53.596462 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-97774fb7-926e-4b97-aae5-0e2298b8265d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:53.597069 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-97774fb7-926e-4b97-aae5-0e2298b8265d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:53.603389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97774fb7-926e-4b97-aae5-0e2298b8265d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:53.604451 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97774fb7-926e-4b97-aae5-0e2298b8265d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:53.604952 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97774fb7-926e-4b97-aae5-0e2298b8265d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:53.605712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97774fb7-926e-4b97-aae5-0e2298b8265d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:53.606264 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97774fb7-926e-4b97-aae5-0e2298b8265d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:53.606752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97774fb7-926e-4b97-aae5-0e2298b8265d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:53.819892 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-97774fb7-926e-4b97-aae5-0e2298b8265d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:53.827777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-97774fb7-926e-4b97-aae5-0e2298b8265d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.235125 Aug 30 15:18:53.828345 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1206/2415] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:53 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:54.848835 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5fbff626-12d7-4ec7-b781-6c82632d388f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:54.849460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5fbff626-12d7-4ec7-b781-6c82632d388f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:54.855943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fbff626-12d7-4ec7-b781-6c82632d388f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:54.856436 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fbff626-12d7-4ec7-b781-6c82632d388f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:54.856874 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fbff626-12d7-4ec7-b781-6c82632d388f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:54.857573 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fbff626-12d7-4ec7-b781-6c82632d388f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:54.858027 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fbff626-12d7-4ec7-b781-6c82632d388f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:54.858456 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fbff626-12d7-4ec7-b781-6c82632d388f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:54.989958 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5fbff626-12d7-4ec7-b781-6c82632d388f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:54.998467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5fbff626-12d7-4ec7-b781-6c82632d388f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.153476 Aug 30 15:18:54.999036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1210/2416] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:54 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:18:55.983741 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-8b0b4b70-7a42-4ec8-aa7b-6ac0fe70c37d req-f3c7f9d0-74ec-47b5-8d30-20ae457a69af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d580a6e1-4d83-4f3d-a9a2-9760bb114e5c", "name": "network-vif-plugged", "status": "completed", "tag": "45797295-84d5-44d0-9f67-1a93953c8e34"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:18:55.996519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-8b0b4b70-7a42-4ec8-aa7b-6ac0fe70c37d req-f3c7f9d0-74ec-47b5-8d30-20ae457a69af service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:55.999236 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-8b0b4b70-7a42-4ec8-aa7b-6ac0fe70c37d req-f3c7f9d0-74ec-47b5-8d30-20ae457a69af service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:55.999680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-8b0b4b70-7a42-4ec8-aa7b-6ac0fe70c37d req-f3c7f9d0-74ec-47b5-8d30-20ae457a69af service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:56.013543 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-8b0b4b70-7a42-4ec8-aa7b-6ac0fe70c37d req-f3c7f9d0-74ec-47b5-8d30-20ae457a69af service nova] Creating event network-vif-plugged:45797295-84d5-44d0-9f67-1a93953c8e34 for instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c on hv-cinder-82880 Aug 30 15:18:56.018508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5c3860f8-2750-41d0-996e-e3d5850e56ee tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:56.019132 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-8b0b4b70-7a42-4ec8-aa7b-6ac0fe70c37d req-f3c7f9d0-74ec-47b5-8d30-20ae457a69af service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039222 Aug 30 15:18:56.019695 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1207/2417] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:18:56.020548 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5c3860f8-2750-41d0-996e-e3d5850e56ee tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:56.028998 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c3860f8-2750-41d0-996e-e3d5850e56ee tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:56.029739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c3860f8-2750-41d0-996e-e3d5850e56ee tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:56.030178 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c3860f8-2750-41d0-996e-e3d5850e56ee tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:56.030881 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c3860f8-2750-41d0-996e-e3d5850e56ee tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:56.031352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c3860f8-2750-41d0-996e-e3d5850e56ee tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:56.031771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c3860f8-2750-41d0-996e-e3d5850e56ee tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:56.178236 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5c3860f8-2750-41d0-996e-e3d5850e56ee tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:56.186825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5c3860f8-2750-41d0-996e-e3d5850e56ee tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.172519 Aug 30 15:18:56.187365 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1211/2418] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:56 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:57.209535 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8284a4fa-0384-4068-9517-0aeba6be2fbb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:57.211050 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8284a4fa-0384-4068-9517-0aeba6be2fbb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:57.220073 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8284a4fa-0384-4068-9517-0aeba6be2fbb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:57.220704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8284a4fa-0384-4068-9517-0aeba6be2fbb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:57.221137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8284a4fa-0384-4068-9517-0aeba6be2fbb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:57.221833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8284a4fa-0384-4068-9517-0aeba6be2fbb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:57.222281 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8284a4fa-0384-4068-9517-0aeba6be2fbb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:57.222701 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8284a4fa-0384-4068-9517-0aeba6be2fbb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:57.358456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8284a4fa-0384-4068-9517-0aeba6be2fbb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:57.370237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8284a4fa-0384-4068-9517-0aeba6be2fbb tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1357 microversion: 2.1 time: 0.164972 Aug 30 15:18:57.371105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1208/2419] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:57 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:58.392096 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bc9e2e5a-f65e-46df-9264-1c90c4366784 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:58.392712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bc9e2e5a-f65e-46df-9264-1c90c4366784 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:58.399247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc9e2e5a-f65e-46df-9264-1c90c4366784 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:58.399724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc9e2e5a-f65e-46df-9264-1c90c4366784 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:58.400157 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc9e2e5a-f65e-46df-9264-1c90c4366784 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:58.401097 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc9e2e5a-f65e-46df-9264-1c90c4366784 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:58.401472 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc9e2e5a-f65e-46df-9264-1c90c4366784 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:58.401922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bc9e2e5a-f65e-46df-9264-1c90c4366784 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:58.539702 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bc9e2e5a-f65e-46df-9264-1c90c4366784 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:58.547984 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bc9e2e5a-f65e-46df-9264-1c90c4366784 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1547 microversion: 2.1 time: 0.160370 Aug 30 15:18:58.548636 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1212/2420] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:58 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:58.568652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-60544f62-992e-475c-8a66-75a7e768c65c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:58.569491 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-60544f62-992e-475c-8a66-75a7e768c65c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:58.578749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60544f62-992e-475c-8a66-75a7e768c65c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:58.579325 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60544f62-992e-475c-8a66-75a7e768c65c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:58.579789 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60544f62-992e-475c-8a66-75a7e768c65c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:58.580479 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60544f62-992e-475c-8a66-75a7e768c65c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:58.580933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60544f62-992e-475c-8a66-75a7e768c65c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:58.581356 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60544f62-992e-475c-8a66-75a7e768c65c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:58.719191 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-60544f62-992e-475c-8a66-75a7e768c65c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:58.726826 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-60544f62-992e-475c-8a66-75a7e768c65c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1547 microversion: 2.1 time: 0.162214 Aug 30 15:18:58.727446 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1209/2421] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:58 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:18:58.747369 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0cbfa2ab-6630-4bf4-b87d-d8feb4fe72c9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:58.752167 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0cbfa2ab-6630-4bf4-b87d-d8feb4fe72c9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:58.752944 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0cbfa2ab-6630-4bf4-b87d-d8feb4fe72c9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Searching by: {'deleted': False, 'project_id': '4edd140cb317483e8e7e3f04cdee048c'} {{(pid=127089) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 15:18:58.759431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0cbfa2ab-6630-4bf4-b87d-d8feb4fe72c9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:58.760082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0cbfa2ab-6630-4bf4-b87d-d8feb4fe72c9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:58.760750 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0cbfa2ab-6630-4bf4-b87d-d8feb4fe72c9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:58.761471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0cbfa2ab-6630-4bf4-b87d-d8feb4fe72c9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:58.761920 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0cbfa2ab-6630-4bf4-b87d-d8feb4fe72c9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:58.762342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0cbfa2ab-6630-4bf4-b87d-d8feb4fe72c9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:58.853356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.multi_cell_list [None req-0cbfa2ab-6630-4bf4-b87d-d8feb4fe72c9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127089) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 15:18:58.952907 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0cbfa2ab-6630-4bf4-b87d-d8feb4fe72c9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209963 Aug 30 15:18:58.953494 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1213/2422] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 30 15:18:58 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:18:58.965101 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9d8af585-b40f-4d10-bc54-2f5d3411f0e5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:18:58.965785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9d8af585-b40f-4d10-bc54-2f5d3411f0e5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:18:58.971748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d8af585-b40f-4d10-bc54-2f5d3411f0e5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:58.972250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d8af585-b40f-4d10-bc54-2f5d3411f0e5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:58.972833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d8af585-b40f-4d10-bc54-2f5d3411f0e5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:58.973505 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d8af585-b40f-4d10-bc54-2f5d3411f0e5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:18:58.974100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d8af585-b40f-4d10-bc54-2f5d3411f0e5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:18:58.974515 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d8af585-b40f-4d10-bc54-2f5d3411f0e5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:18:59.105876 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9d8af585-b40f-4d10-bc54-2f5d3411f0e5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:18:59.109365 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:18:59.114588 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9d8af585-b40f-4d10-bc54-2f5d3411f0e5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1547 microversion: 2.1 time: 0.154003 Aug 30 15:18:59.115167 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1210/2423] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:18:58 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:19:00.693778 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-08de5eaf-8b72-453c-9053-7d0593cb711f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b33b4670-8478-4769-8d90-3b34edd0a006"}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:19:00.696185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-08de5eaf-8b72-453c-9053-7d0593cb711f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:00.704091 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08de5eaf-8b72-453c-9053-7d0593cb711f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:00.704569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08de5eaf-8b72-453c-9053-7d0593cb711f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:00.705008 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08de5eaf-8b72-453c-9053-7d0593cb711f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:00.705749 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08de5eaf-8b72-453c-9053-7d0593cb711f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:00.706146 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08de5eaf-8b72-453c-9053-7d0593cb711f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:00.706631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-08de5eaf-8b72-453c-9053-7d0593cb711f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:00.967858 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-08de5eaf-8b72-453c-9053-7d0593cb711f tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "POST /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278089 Aug 30 15:19:00.968401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1214/2424] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 30 15:19:00 2022] POST /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:19:11.707475 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9a187bef-63dd-4fd7-8cef-4b573ecf524c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:19:11.708081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9a187bef-63dd-4fd7-8cef-4b573ecf524c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:11.711194 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=23 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:19:11.716975 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a187bef-63dd-4fd7-8cef-4b573ecf524c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:11.717456 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a187bef-63dd-4fd7-8cef-4b573ecf524c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:11.717880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a187bef-63dd-4fd7-8cef-4b573ecf524c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:11.718566 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a187bef-63dd-4fd7-8cef-4b573ecf524c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:11.719177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a187bef-63dd-4fd7-8cef-4b573ecf524c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:11.719680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9a187bef-63dd-4fd7-8cef-4b573ecf524c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:11.852089 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9a187bef-63dd-4fd7-8cef-4b573ecf524c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:19:11.860847 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9a187bef-63dd-4fd7-8cef-4b573ecf524c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1593 microversion: 2.1 time: 0.157448 Aug 30 15:19:11.861412 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1211/2425] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:19:11 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1593 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:19:13.576393 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-0d11d44c-0a63-41b2-a2ed-da1c8ec50aff req-608e8949-5494-42c1-9ce6-66231699403e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d580a6e1-4d83-4f3d-a9a2-9760bb114e5c", "tag": "45797295-84d5-44d0-9f67-1a93953c8e34"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:19:13.615174 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:19:13.616362 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:19:13.617460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:19:13.624394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-0d11d44c-0a63-41b2-a2ed-da1c8ec50aff req-608e8949-5494-42c1-9ce6-66231699403e service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:13.625149 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-0d11d44c-0a63-41b2-a2ed-da1c8ec50aff req-608e8949-5494-42c1-9ce6-66231699403e service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:13.625899 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-0d11d44c-0a63-41b2-a2ed-da1c8ec50aff req-608e8949-5494-42c1-9ce6-66231699403e service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:13.639327 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-0d11d44c-0a63-41b2-a2ed-da1c8ec50aff req-608e8949-5494-42c1-9ce6-66231699403e service nova] Creating event network-changed:45797295-84d5-44d0-9f67-1a93953c8e34 for instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c on hv-cinder-82880 Aug 30 15:19:13.644458 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-0d11d44c-0a63-41b2-a2ed-da1c8ec50aff req-608e8949-5494-42c1-9ce6-66231699403e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091390 Aug 30 15:19:13.645298 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1215/2426] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:19:14.630216 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-329938a9-7c87-4ed7-a702-d3189b48e3b0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1509235791"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:19:14.630745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-329938a9-7c87-4ed7-a702-d3189b48e3b0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:14.637745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-329938a9-7c87-4ed7-a702-d3189b48e3b0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:14.638247 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-329938a9-7c87-4ed7-a702-d3189b48e3b0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:14.638679 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-329938a9-7c87-4ed7-a702-d3189b48e3b0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:14.639413 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-329938a9-7c87-4ed7-a702-d3189b48e3b0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:14.639860 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-329938a9-7c87-4ed7-a702-d3189b48e3b0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:14.640287 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-329938a9-7c87-4ed7-a702-d3189b48e3b0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:14.767041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.network.security_group_api [None req-329938a9-7c87-4ed7-a702-d3189b48e3b0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Adding security group 24016956-150a-45ae-a8e7-5cae7177de9f to port 45797295-84d5-44d0-9f67-1a93953c8e34 Aug 30 15:19:15.091415 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-329938a9-7c87-4ed7-a702-d3189b48e3b0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "POST /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/action" status: 202 len: 0 microversion: 2.1 time: 0.465008 Aug 30 15:19:15.092110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1212/2427] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 15:19:14 2022] POST /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 15:19:15.100664 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0f3b01f8-67dc-4d91-b7fc-477ae245fca8 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:19:15.101613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0f3b01f8-67dc-4d91-b7fc-477ae245fca8 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:15.110530 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f3b01f8-67dc-4d91-b7fc-477ae245fca8 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:15.111089 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f3b01f8-67dc-4d91-b7fc-477ae245fca8 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:15.111621 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f3b01f8-67dc-4d91-b7fc-477ae245fca8 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:15.112376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f3b01f8-67dc-4d91-b7fc-477ae245fca8 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:15.112892 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f3b01f8-67dc-4d91-b7fc-477ae245fca8 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:15.113374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f3b01f8-67dc-4d91-b7fc-477ae245fca8 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:15.279062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0f3b01f8-67dc-4d91-b7fc-477ae245fca8 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:19:15.287407 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0f3b01f8-67dc-4d91-b7fc-477ae245fca8 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1759 microversion: 2.1 time: 0.190905 Aug 30 15:19:15.288097 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1216/2428] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:19:15 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1759 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:19:15.660842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-360cf91d-b673-4702-bc6e-640f16ad14bd req-601814aa-8557-4942-8970-9d197f7cb735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d580a6e1-4d83-4f3d-a9a2-9760bb114e5c", "tag": "45797295-84d5-44d0-9f67-1a93953c8e34"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:19:15.670339 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-360cf91d-b673-4702-bc6e-640f16ad14bd req-601814aa-8557-4942-8970-9d197f7cb735 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:15.670815 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-360cf91d-b673-4702-bc6e-640f16ad14bd req-601814aa-8557-4942-8970-9d197f7cb735 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:15.671261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-360cf91d-b673-4702-bc6e-640f16ad14bd req-601814aa-8557-4942-8970-9d197f7cb735 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:15.683633 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-360cf91d-b673-4702-bc6e-640f16ad14bd req-601814aa-8557-4942-8970-9d197f7cb735 service nova] Creating event network-changed:45797295-84d5-44d0-9f67-1a93953c8e34 for instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c on hv-cinder-82880 Aug 30 15:19:15.689178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-360cf91d-b673-4702-bc6e-640f16ad14bd req-601814aa-8557-4942-8970-9d197f7cb735 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032237 Aug 30 15:19:15.689778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1213/2429] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:19:41.029196 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-2d30acaf-0cdf-48c2-ae91-6a1b8b79727e tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:19:41.031969 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-2d30acaf-0cdf-48c2-ae91-6a1b8b79727e tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:41.034418 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=4 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:19:41.035508 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=8 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:19:41.040953 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d30acaf-0cdf-48c2-ae91-6a1b8b79727e tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:41.041444 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d30acaf-0cdf-48c2-ae91-6a1b8b79727e tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:41.041870 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d30acaf-0cdf-48c2-ae91-6a1b8b79727e tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:41.042560 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d30acaf-0cdf-48c2-ae91-6a1b8b79727e tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:41.043002 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d30acaf-0cdf-48c2-ae91-6a1b8b79727e tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:41.043451 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-2d30acaf-0cdf-48c2-ae91-6a1b8b79727e tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:41.116060 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-2d30acaf-0cdf-48c2-ae91-6a1b8b79727e tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "POST /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/action" status: 202 len: 0 microversion: 2.1 time: 0.091866 Aug 30 15:19:41.120645 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1217/2430] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 15:19:41 2022] POST /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 15:19:41.128203 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5ad9283a-0ae0-40da-8b67-49a145cb1dfa tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:19:41.128825 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5ad9283a-0ae0-40da-8b67-49a145cb1dfa tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:41.132391 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:19:41.133279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=12 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:19:41.142059 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ad9283a-0ae0-40da-8b67-49a145cb1dfa tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:41.142557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ad9283a-0ae0-40da-8b67-49a145cb1dfa tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:41.142993 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ad9283a-0ae0-40da-8b67-49a145cb1dfa tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:41.143874 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ad9283a-0ae0-40da-8b67-49a145cb1dfa tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:41.144333 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ad9283a-0ae0-40da-8b67-49a145cb1dfa tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:41.144755 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ad9283a-0ae0-40da-8b67-49a145cb1dfa tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:41.562826 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5ad9283a-0ae0-40da-8b67-49a145cb1dfa tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:19:41.577134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5ad9283a-0ae0-40da-8b67-49a145cb1dfa tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1751 microversion: 2.1 time: 0.453722 Aug 30 15:19:41.577932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1214/2431] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:19:41 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1751 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:19:42.599171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6904d15d-dee5-4021-b0a5-cc026afc723d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:19:42.599896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6904d15d-dee5-4021-b0a5-cc026afc723d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:42.606137 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6904d15d-dee5-4021-b0a5-cc026afc723d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:42.606618 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6904d15d-dee5-4021-b0a5-cc026afc723d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:42.607053 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6904d15d-dee5-4021-b0a5-cc026afc723d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:42.607781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6904d15d-dee5-4021-b0a5-cc026afc723d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:42.608230 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6904d15d-dee5-4021-b0a5-cc026afc723d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:42.608648 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-6904d15d-dee5-4021-b0a5-cc026afc723d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:42.771126 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6904d15d-dee5-4021-b0a5-cc026afc723d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:19:42.779505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6904d15d-dee5-4021-b0a5-cc026afc723d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1756 microversion: 2.1 time: 0.184989 Aug 30 15:19:42.780073 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1218/2432] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:19:42 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:19:43.800500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-99c03e67-a44f-4479-957b-6778298c10b2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:19:43.801100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-99c03e67-a44f-4479-957b-6778298c10b2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:43.807668 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99c03e67-a44f-4479-957b-6778298c10b2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:43.808141 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99c03e67-a44f-4479-957b-6778298c10b2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:43.808571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99c03e67-a44f-4479-957b-6778298c10b2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:43.809241 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99c03e67-a44f-4479-957b-6778298c10b2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:43.809682 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99c03e67-a44f-4479-957b-6778298c10b2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:43.810095 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-99c03e67-a44f-4479-957b-6778298c10b2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:43.955373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-99c03e67-a44f-4479-957b-6778298c10b2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:19:43.964179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-99c03e67-a44f-4479-957b-6778298c10b2 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1756 microversion: 2.1 time: 0.167526 Aug 30 15:19:43.964740 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1215/2433] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:19:43 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:19:44.985540 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-27322041-92d3-4dae-9844-2fbcdbe992c5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:19:44.986394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-27322041-92d3-4dae-9844-2fbcdbe992c5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:44.993878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-27322041-92d3-4dae-9844-2fbcdbe992c5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:44.994517 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-27322041-92d3-4dae-9844-2fbcdbe992c5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:44.994959 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-27322041-92d3-4dae-9844-2fbcdbe992c5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:44.995692 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-27322041-92d3-4dae-9844-2fbcdbe992c5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:44.996144 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-27322041-92d3-4dae-9844-2fbcdbe992c5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:44.996565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-27322041-92d3-4dae-9844-2fbcdbe992c5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:45.162471 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-27322041-92d3-4dae-9844-2fbcdbe992c5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:19:45.173957 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-27322041-92d3-4dae-9844-2fbcdbe992c5 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1756 microversion: 2.1 time: 0.192847 Aug 30 15:19:45.174842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1219/2434] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:19:44 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:19:46.195622 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ae46ea50-080c-4084-9261-4b61e1d498b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:19:46.196411 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ae46ea50-080c-4084-9261-4b61e1d498b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:46.206982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae46ea50-080c-4084-9261-4b61e1d498b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:46.206982 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae46ea50-080c-4084-9261-4b61e1d498b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:46.207365 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae46ea50-080c-4084-9261-4b61e1d498b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:46.207897 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae46ea50-080c-4084-9261-4b61e1d498b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:46.208358 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae46ea50-080c-4084-9261-4b61e1d498b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:46.208897 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae46ea50-080c-4084-9261-4b61e1d498b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:46.350730 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ae46ea50-080c-4084-9261-4b61e1d498b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:19:46.359763 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ae46ea50-080c-4084-9261-4b61e1d498b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1756 microversion: 2.1 time: 0.168272 Aug 30 15:19:46.360373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1216/2435] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:19:46 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:19:47.380898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8f4604e7-e3ca-4177-a5d6-4628c7323d23 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:19:47.381581 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8f4604e7-e3ca-4177-a5d6-4628c7323d23 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:47.388576 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f4604e7-e3ca-4177-a5d6-4628c7323d23 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:47.389045 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f4604e7-e3ca-4177-a5d6-4628c7323d23 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:47.389470 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f4604e7-e3ca-4177-a5d6-4628c7323d23 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:47.390141 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f4604e7-e3ca-4177-a5d6-4628c7323d23 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:47.390605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f4604e7-e3ca-4177-a5d6-4628c7323d23 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:47.391017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8f4604e7-e3ca-4177-a5d6-4628c7323d23 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:47.540040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8f4604e7-e3ca-4177-a5d6-4628c7323d23 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:19:47.548640 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8f4604e7-e3ca-4177-a5d6-4628c7323d23 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1756 microversion: 2.1 time: 0.171539 Aug 30 15:19:47.549205 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1220/2436] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:19:47 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:19:48.570153 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f706da6c-eec0-4bd9-8c32-e3cbb573a811 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:19:48.570766 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f706da6c-eec0-4bd9-8c32-e3cbb573a811 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:48.579833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f706da6c-eec0-4bd9-8c32-e3cbb573a811 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:48.580318 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f706da6c-eec0-4bd9-8c32-e3cbb573a811 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:48.580755 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f706da6c-eec0-4bd9-8c32-e3cbb573a811 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:48.581449 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f706da6c-eec0-4bd9-8c32-e3cbb573a811 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:48.581898 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f706da6c-eec0-4bd9-8c32-e3cbb573a811 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:48.582320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f706da6c-eec0-4bd9-8c32-e3cbb573a811 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:48.722400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f706da6c-eec0-4bd9-8c32-e3cbb573a811 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:19:48.730959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f706da6c-eec0-4bd9-8c32-e3cbb573a811 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1756 microversion: 2.1 time: 0.164702 Aug 30 15:19:48.731571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1217/2437] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:19:48 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:19:49.754278 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7450e2d9-c791-4f63-9a4d-73525859e2b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:19:49.755056 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7450e2d9-c791-4f63-9a4d-73525859e2b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:49.762223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7450e2d9-c791-4f63-9a4d-73525859e2b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:49.762715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7450e2d9-c791-4f63-9a4d-73525859e2b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:49.763155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7450e2d9-c791-4f63-9a4d-73525859e2b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:49.763887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7450e2d9-c791-4f63-9a4d-73525859e2b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:49.764341 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7450e2d9-c791-4f63-9a4d-73525859e2b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:49.764770 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7450e2d9-c791-4f63-9a4d-73525859e2b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:49.907136 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7450e2d9-c791-4f63-9a4d-73525859e2b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:19:49.915272 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7450e2d9-c791-4f63-9a4d-73525859e2b9 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1756 microversion: 2.1 time: 0.165624 Aug 30 15:19:49.916356 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1221/2438] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:19:49 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:19:50.938043 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3a431ce3-eb83-498e-94f3-7f5663e247c7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:19:50.938651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3a431ce3-eb83-498e-94f3-7f5663e247c7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:50.945149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a431ce3-eb83-498e-94f3-7f5663e247c7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:50.945624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a431ce3-eb83-498e-94f3-7f5663e247c7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:50.946056 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a431ce3-eb83-498e-94f3-7f5663e247c7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:50.947594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a431ce3-eb83-498e-94f3-7f5663e247c7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:50.948055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a431ce3-eb83-498e-94f3-7f5663e247c7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:50.948472 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3a431ce3-eb83-498e-94f3-7f5663e247c7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:51.396549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3a431ce3-eb83-498e-94f3-7f5663e247c7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:19:51.404722 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3a431ce3-eb83-498e-94f3-7f5663e247c7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1756 microversion: 2.1 time: 0.470536 Aug 30 15:19:51.405306 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1218/2439] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:19:50 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1756 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:19:52.426006 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-20340730-a39f-410b-9d35-361e276db963 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:19:52.426559 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-20340730-a39f-410b-9d35-361e276db963 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:52.433207 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20340730-a39f-410b-9d35-361e276db963 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:52.433688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20340730-a39f-410b-9d35-361e276db963 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:52.434129 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20340730-a39f-410b-9d35-361e276db963 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:52.434815 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20340730-a39f-410b-9d35-361e276db963 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:52.435288 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20340730-a39f-410b-9d35-361e276db963 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:52.435718 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20340730-a39f-410b-9d35-361e276db963 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:52.586829 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-20340730-a39f-410b-9d35-361e276db963 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:19:52.595017 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-20340730-a39f-410b-9d35-361e276db963 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1756 microversion: 2.1 time: 0.173001 Aug 30 15:19:52.595799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1222/2440] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:19:52 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:19:53.616064 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-49708cc0-7816-4b1e-98ca-6a66d090f18a tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:19:53.616696 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-49708cc0-7816-4b1e-98ca-6a66d090f18a tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:19:53.622740 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49708cc0-7816-4b1e-98ca-6a66d090f18a tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:53.623228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49708cc0-7816-4b1e-98ca-6a66d090f18a tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:53.623687 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49708cc0-7816-4b1e-98ca-6a66d090f18a tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:53.624360 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49708cc0-7816-4b1e-98ca-6a66d090f18a tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:19:53.624809 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49708cc0-7816-4b1e-98ca-6a66d090f18a tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:19:53.625227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49708cc0-7816-4b1e-98ca-6a66d090f18a tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:19:53.767585 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-49708cc0-7816-4b1e-98ca-6a66d090f18a tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:19:53.776209 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-49708cc0-7816-4b1e-98ca-6a66d090f18a tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1759 microversion: 2.1 time: 0.164002 Aug 30 15:19:53.776776 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1219/2441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:19:53 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:25.169813 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=12 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:20:25.170559 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:20:25.336727 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-43573037-c958-4726-8173-8aee3ff4d11f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Action: 'create', calling method: .version_select at 0x7f5cbe082940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-634593545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHJbGeYOGPFfgjznvchkegKVmhZKrNds86YQ2Bz9C0v+nsAgiC3dTH25Pqy5jYbocxMdGzvhmfzIl8ZaifdsmpJvwcR6xWvc1DwymMQ185GhAnuFd3ea6Z1HRqNljgY2Q=="}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:20:25.352569 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-43573037-c958-4726-8173-8aee3ff4d11f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Getting quotas for project b45f3223ea9541f38831d425cb35dbb3. Resources: {'key_pairs'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:20:25.356999 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-43573037-c958-4726-8173-8aee3ff4d11f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Getting quotas for user 2dc2d1a5bde44defae89c15d60172d4b and project b45f3223ea9541f38831d425cb35dbb3. Resources: {'key_pairs'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:20:25.379732 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-43573037-c958-4726-8173-8aee3ff4d11f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.215570 Aug 30 15:20:25.380368 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1223/2442] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 30 15:20:25 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:20:26.088586 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-88dc94c9-1d0f-4f5c-a77d-880af59e7fd1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1509235791"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:20:26.089794 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-88dc94c9-1d0f-4f5c-a77d-880af59e7fd1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:26.093039 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=12 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:20:26.093780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=36 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:20:26.097864 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88dc94c9-1d0f-4f5c-a77d-880af59e7fd1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:26.098346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88dc94c9-1d0f-4f5c-a77d-880af59e7fd1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:26.098777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88dc94c9-1d0f-4f5c-a77d-880af59e7fd1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:26.099518 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88dc94c9-1d0f-4f5c-a77d-880af59e7fd1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:26.099957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88dc94c9-1d0f-4f5c-a77d-880af59e7fd1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:26.100380 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88dc94c9-1d0f-4f5c-a77d-880af59e7fd1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:26.269034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.network.security_group_api [None req-88dc94c9-1d0f-4f5c-a77d-880af59e7fd1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Removing security group 24016956-150a-45ae-a8e7-5cae7177de9f from port 45797295-84d5-44d0-9f67-1a93953c8e34 Aug 30 15:20:26.632340 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-88dc94c9-1d0f-4f5c-a77d-880af59e7fd1 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "POST /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/action" status: 202 len: 0 microversion: 2.1 time: 0.548084 Aug 30 15:20:26.633412 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1220/2443] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 15:20:26 2022] POST /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 15:20:26.691790 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-9f13376d-3943-4edb-a1de-e87bbd0cd4cf req-81ad7228-73cc-4853-aed1-efe71a56e53d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d580a6e1-4d83-4f3d-a9a2-9760bb114e5c", "tag": "45797295-84d5-44d0-9f67-1a93953c8e34"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:20:26.708860 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-9f13376d-3943-4edb-a1de-e87bbd0cd4cf req-81ad7228-73cc-4853-aed1-efe71a56e53d service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:26.709339 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-9f13376d-3943-4edb-a1de-e87bbd0cd4cf req-81ad7228-73cc-4853-aed1-efe71a56e53d service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:26.712431 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-9f13376d-3943-4edb-a1de-e87bbd0cd4cf req-81ad7228-73cc-4853-aed1-efe71a56e53d service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:26.726913 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-9f13376d-3943-4edb-a1de-e87bbd0cd4cf req-81ad7228-73cc-4853-aed1-efe71a56e53d service nova] Creating event network-changed:45797295-84d5-44d0-9f67-1a93953c8e34 for instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c on hv-cinder-82880 Aug 30 15:20:26.748351 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-9f13376d-3943-4edb-a1de-e87bbd0cd4cf req-81ad7228-73cc-4853-aed1-efe71a56e53d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061643 Aug 30 15:20:26.752928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1224/2444] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 15:20:27.833573 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e9d67c90-fa80-46a1-8625-8488492e1c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:27.837113 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e9d67c90-fa80-46a1-8625-8488492e1c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:27.838455 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-1eae58fa-e223-4e43-8b5c-cde5600159d5 req-93eb777c-0498-425a-97db-95486043b247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d580a6e1-4d83-4f3d-a9a2-9760bb114e5c", "tag": "45797295-84d5-44d0-9f67-1a93953c8e34"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:20:27.846169 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9d67c90-fa80-46a1-8625-8488492e1c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:27.846818 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9d67c90-fa80-46a1-8625-8488492e1c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:27.847504 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9d67c90-fa80-46a1-8625-8488492e1c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:27.848332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9d67c90-fa80-46a1-8625-8488492e1c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:27.848960 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9d67c90-fa80-46a1-8625-8488492e1c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:27.849472 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e9d67c90-fa80-46a1-8625-8488492e1c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:27.861084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-1eae58fa-e223-4e43-8b5c-cde5600159d5 req-93eb777c-0498-425a-97db-95486043b247 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:27.861782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-1eae58fa-e223-4e43-8b5c-cde5600159d5 req-93eb777c-0498-425a-97db-95486043b247 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:27.862587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-1eae58fa-e223-4e43-8b5c-cde5600159d5 req-93eb777c-0498-425a-97db-95486043b247 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:27.877081 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-1eae58fa-e223-4e43-8b5c-cde5600159d5 req-93eb777c-0498-425a-97db-95486043b247 service nova] Creating event network-changed:45797295-84d5-44d0-9f67-1a93953c8e34 for instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c on hv-cinder-82880 Aug 30 15:20:27.883372 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-1eae58fa-e223-4e43-8b5c-cde5600159d5 req-93eb777c-0498-425a-97db-95486043b247 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050474 Aug 30 15:20:27.889048 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1225/2445] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:20:27.954746 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-e9d67c90-fa80-46a1-8625-8488492e1c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lazy-loading 'services' on Instance uuid d580a6e1-4d83-4f3d-a9a2-9760bb114e5c {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 15:20:28.081773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e9d67c90-fa80-46a1-8625-8488492e1c86 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/os-volume_attachments/b33b4670-8478-4769-8d90-3b34edd0a006" status: 202 len: 0 microversion: 2.1 time: 0.253502 Aug 30 15:20:28.083940 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1221/2446] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 15:20:27 2022] DELETE /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/os-volume_attachments/b33b4670-8478-4769-8d90-3b34edd0a006 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 15:20:28.092726 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a853ef56-7a2c-4bac-ae4a-d5d6df4f41ac tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:28.095745 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a853ef56-7a2c-4bac-ae4a-d5d6df4f41ac tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:28.111690 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a853ef56-7a2c-4bac-ae4a-d5d6df4f41ac tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:28.114550 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a853ef56-7a2c-4bac-ae4a-d5d6df4f41ac tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:28.115307 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a853ef56-7a2c-4bac-ae4a-d5d6df4f41ac tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:28.116141 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a853ef56-7a2c-4bac-ae4a-d5d6df4f41ac tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:28.117448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a853ef56-7a2c-4bac-ae4a-d5d6df4f41ac tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:28.120009 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a853ef56-7a2c-4bac-ae4a-d5d6df4f41ac tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:28.198432 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a853ef56-7a2c-4bac-ae4a-d5d6df4f41ac tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110530 Aug 30 15:20:28.199281 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1226/2447] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 15:20:28 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:20:29.217107 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a7883981-0662-4e28-8363-4b7fae1cad3b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:29.224116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a7883981-0662-4e28-8363-4b7fae1cad3b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:29.233755 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7883981-0662-4e28-8363-4b7fae1cad3b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:29.234240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7883981-0662-4e28-8363-4b7fae1cad3b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:29.234700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7883981-0662-4e28-8363-4b7fae1cad3b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:29.235419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7883981-0662-4e28-8363-4b7fae1cad3b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:29.235859 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7883981-0662-4e28-8363-4b7fae1cad3b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:29.236274 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7883981-0662-4e28-8363-4b7fae1cad3b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:29.268904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a7883981-0662-4e28-8363-4b7fae1cad3b tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057047 Aug 30 15:20:29.269487 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1222/2448] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 30 15:20:29 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 15:20:29.280903 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3a478d85-fc4b-4c3e-a1a5-43e4ca48cf2d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:29.281416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3a478d85-fc4b-4c3e-a1a5-43e4ca48cf2d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:29.288132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a478d85-fc4b-4c3e-a1a5-43e4ca48cf2d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:29.288617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a478d85-fc4b-4c3e-a1a5-43e4ca48cf2d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:29.289080 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a478d85-fc4b-4c3e-a1a5-43e4ca48cf2d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:29.289846 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a478d85-fc4b-4c3e-a1a5-43e4ca48cf2d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:29.291539 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a478d85-fc4b-4c3e-a1a5-43e4ca48cf2d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:29.291993 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3a478d85-fc4b-4c3e-a1a5-43e4ca48cf2d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:29.382581 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-3a478d85-fc4b-4c3e-a1a5-43e4ca48cf2d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] HTTP exception thrown: Instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c is not attached to volume b33b4670-8478-4769-8d90-3b34edd0a006 Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3a478d85-fc4b-4c3e-a1a5-43e4ca48cf2d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Request method failure captured: Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: DELETE /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/os-volume_attachments/b33b4670-8478-4769-8d90-3b34edd0a006 HTTP/1.1 Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDio72jKg-xynLWbuldCoGJUXpKWyqt8w3GA8ip-Cs6IuGCSJAZ6BtomJtdH1_wVuXfRxmjDmiNc_kF90S-hiqtgtLnAExk7U2R6XSj-049kmPLgQMO1Ela86Tsd_bDeu3c2E0Wiwul2eYXrIhfhsYzCOCtFCsD3JGQVgXvYngc_ef4Q Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: 4edd140cb317483e8e7e3f04cdee048c Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-TestMinimumBasicScenario-341561519 Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 15:20:29.384977 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 15:20:29.386380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4edd140cb317483e8e7e3f04cdee048c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4edd140cb317483e8e7e3f04cdee048c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4edd140cb317483e8e7e3f04cdee048c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4edd140cb317483e8e7e3f04cdee048c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:20:29.386380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-TestMinimumBasicScenario-341561519 Aug 30 15:20:29.386380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: 4edd140cb317483e8e7e3f04cdee048c Aug 30 15:20:29.386380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-TestMinimumBasicScenario-341561519 Aug 30 15:20:29.386380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-TestMinimumBasicScenario-341561519-project Aug 30 15:20:29.386380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 15:20:29.386380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 15:20:29.386380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: 93a00d9af55a42fa8d5628fa81dcae80 Aug 30 15:20:29.386380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-TestMinimumBasicScenario-341561519-project Aug 30 15:20:29.386380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 15:20:29.386380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c is not attached to volume b33b4670-8478-4769-8d90-3b34edd0a006 Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'server_id': 'd580a6e1-4d83-4f3d-a9a2-9760bb114e5c', 'id': 'b33b4670-8478-4769-8d90-3b34edd0a006'} Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b33b4670-8478-4769-8d90-3b34edd0a006. Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:20:29.387394 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:20:29.388826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 15:20:29.388826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 15:20:29.388826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c is not attached to volume b33b4670-8478-4769-8d90-3b34edd0a006 Aug 30 15:20:29.388826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:20:29.388826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:20:29.388826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:20:29.388826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:20:29.388826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:20:29.388826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:20:29.388826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:20:29.388826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:20:29.388826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c is not attached to volume b33b4670-8478-4769-8d90-3b34edd0a006 Aug 30 15:20:29.388826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:20:29.388826 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3a478d85-fc4b-4c3e-a1a5-43e4ca48cf2d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Returning 404 to user: Instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c is not attached to volume b33b4670-8478-4769-8d90-3b34edd0a006 {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:20:29.389718 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3a478d85-fc4b-4c3e-a1a5-43e4ca48cf2d tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/os-volume_attachments/b33b4670-8478-4769-8d90-3b34edd0a006" status: 404 len: 154 microversion: 2.1 time: 0.109537 Aug 30 15:20:29.389718 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1227/2449] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 30 15:20:29 2022] DELETE /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c/os-volume_attachments/b33b4670-8478-4769-8d90-3b34edd0a006 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:20:30.530313 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-78fe4e11-5a10-45da-bdd3-d9bff8018287 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:30.530812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-78fe4e11-5a10-45da-bdd3-d9bff8018287 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:30.537126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-78fe4e11-5a10-45da-bdd3-d9bff8018287 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:30.537600 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-78fe4e11-5a10-45da-bdd3-d9bff8018287 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:30.538036 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-78fe4e11-5a10-45da-bdd3-d9bff8018287 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:30.538719 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-78fe4e11-5a10-45da-bdd3-d9bff8018287 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:30.539168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-78fe4e11-5a10-45da-bdd3-d9bff8018287 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:30.539623 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-78fe4e11-5a10-45da-bdd3-d9bff8018287 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:30.565402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-78fe4e11-5a10-45da-bdd3-d9bff8018287 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 15:20:30.640723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-78fe4e11-5a10-45da-bdd3-d9bff8018287 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 204 len: 0 microversion: 2.1 time: 0.113912 Aug 30 15:20:30.641317 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1223/2450] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:20:30 2022] DELETE /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 15:20:30.650254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-89bfcb99-3911-4a19-a92a-1df0ebb1f9a0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:30.650929 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-89bfcb99-3911-4a19-a92a-1df0ebb1f9a0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:30.657955 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89bfcb99-3911-4a19-a92a-1df0ebb1f9a0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:30.658433 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89bfcb99-3911-4a19-a92a-1df0ebb1f9a0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:30.658860 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89bfcb99-3911-4a19-a92a-1df0ebb1f9a0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:30.659626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89bfcb99-3911-4a19-a92a-1df0ebb1f9a0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:30.660072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89bfcb99-3911-4a19-a92a-1df0ebb1f9a0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:30.660485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89bfcb99-3911-4a19-a92a-1df0ebb1f9a0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:30.790595 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-89bfcb99-3911-4a19-a92a-1df0ebb1f9a0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:30.798668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-89bfcb99-3911-4a19-a92a-1df0ebb1f9a0 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1553 microversion: 2.1 time: 0.152376 Aug 30 15:20:30.799391 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1228/2451] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:30 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:20:31.820840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8f343bf4-3bde-4231-9679-dab19a64b16c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:31.821550 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8f343bf4-3bde-4231-9679-dab19a64b16c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:31.828320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f343bf4-3bde-4231-9679-dab19a64b16c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:31.828802 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f343bf4-3bde-4231-9679-dab19a64b16c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:31.829237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f343bf4-3bde-4231-9679-dab19a64b16c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:31.829922 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f343bf4-3bde-4231-9679-dab19a64b16c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:31.830377 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f343bf4-3bde-4231-9679-dab19a64b16c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:31.830800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f343bf4-3bde-4231-9679-dab19a64b16c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:31.965292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8f343bf4-3bde-4231-9679-dab19a64b16c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:31.973370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8f343bf4-3bde-4231-9679-dab19a64b16c tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1553 microversion: 2.1 time: 0.157921 Aug 30 15:20:31.973968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1224/2452] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:31 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:32.994546 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5423e493-8ee3-42a8-8125-eb6d24d37205 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:32.995170 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5423e493-8ee3-42a8-8125-eb6d24d37205 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:33.001604 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5423e493-8ee3-42a8-8125-eb6d24d37205 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:33.002094 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5423e493-8ee3-42a8-8125-eb6d24d37205 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:33.002533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5423e493-8ee3-42a8-8125-eb6d24d37205 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:33.003291 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5423e493-8ee3-42a8-8125-eb6d24d37205 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:33.003739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5423e493-8ee3-42a8-8125-eb6d24d37205 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:33.004163 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5423e493-8ee3-42a8-8125-eb6d24d37205 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:33.153967 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5423e493-8ee3-42a8-8125-eb6d24d37205 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93a00d9af55a42fa8d5628fa81dcae80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4edd140cb317483e8e7e3f04cdee048c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:33.166672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5423e493-8ee3-42a8-8125-eb6d24d37205 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 200 len: 1553 microversion: 2.1 time: 0.176495 Aug 30 15:20:33.167588 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1229/2453] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:32 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:33.228850 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-27455e5f-7046-4ca6-b4a4-beda38eead01 req-67c39ffb-c683-4f14-8afc-d11760d24d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d580a6e1-4d83-4f3d-a9a2-9760bb114e5c", "name": "network-vif-deleted", "tag": "45797295-84d5-44d0-9f67-1a93953c8e34"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:20:33.238953 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-27455e5f-7046-4ca6-b4a4-beda38eead01 req-67c39ffb-c683-4f14-8afc-d11760d24d8b service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:33.239473 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-27455e5f-7046-4ca6-b4a4-beda38eead01 req-67c39ffb-c683-4f14-8afc-d11760d24d8b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:33.239904 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-27455e5f-7046-4ca6-b4a4-beda38eead01 req-67c39ffb-c683-4f14-8afc-d11760d24d8b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:33.251327 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-27455e5f-7046-4ca6-b4a4-beda38eead01 req-67c39ffb-c683-4f14-8afc-d11760d24d8b service nova] Creating event network-vif-deleted:45797295-84d5-44d0-9f67-1a93953c8e34 for instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c on hv-cinder-82880 Aug 30 15:20:33.256597 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-27455e5f-7046-4ca6-b4a4-beda38eead01 req-67c39ffb-c683-4f14-8afc-d11760d24d8b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031973 Aug 30 15:20:33.257361 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1225/2454] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:20:34.190325 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4d9d2ef5-f754-41e5-9308-0c7806f758c3 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:34.191680 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-4d9d2ef5-f754-41e5-9308-0c7806f758c3 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [instance: d580a6e1-4d83-4f3d-a9a2-9760bb114e5c] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:34.199555 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d9d2ef5-f754-41e5-9308-0c7806f758c3 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:34.200308 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d9d2ef5-f754-41e5-9308-0c7806f758c3 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:34.200736 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d9d2ef5-f754-41e5-9308-0c7806f758c3 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:34.201462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d9d2ef5-f754-41e5-9308-0c7806f758c3 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:34.201904 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d9d2ef5-f754-41e5-9308-0c7806f758c3 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:34.202320 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-4d9d2ef5-f754-41e5-9308-0c7806f758c3 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:34.218043 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-4d9d2ef5-f754-41e5-9308-0c7806f758c3 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] HTTP exception thrown: Instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c could not be found. Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4d9d2ef5-f754-41e5-9308-0c7806f758c3 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Request method failure captured: Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c HTTP/1.1 Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDio72jKg-xynLWbuldCoGJUXpKWyqt8w3GA8ip-Cs6IuGCSJAZ6BtomJtdH1_wVuXfRxmjDmiNc_kF90S-hiqtgtLnAExk7U2R6XSj-049kmPLgQMO1Ela86Tsd_bDeu3c2E0Wiwul2eYXrIhfhsYzCOCtFCsD3JGQVgXvYngc_ef4Q Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: 4edd140cb317483e8e7e3f04cdee048c Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-TestMinimumBasicScenario-341561519 Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 15:20:34.219592 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 15:20:34.220949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4edd140cb317483e8e7e3f04cdee048c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_4edd140cb317483e8e7e3f04cdee048c", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/4edd140cb317483e8e7e3f04cdee048c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/4edd140cb317483e8e7e3f04cdee048c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:20:34.220949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-TestMinimumBasicScenario-341561519 Aug 30 15:20:34.220949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: 4edd140cb317483e8e7e3f04cdee048c Aug 30 15:20:34.220949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-TestMinimumBasicScenario-341561519 Aug 30 15:20:34.220949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-TestMinimumBasicScenario-341561519-project Aug 30 15:20:34.220949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 15:20:34.220949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 15:20:34.220949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: 93a00d9af55a42fa8d5628fa81dcae80 Aug 30 15:20:34.220949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-TestMinimumBasicScenario-341561519-project Aug 30 15:20:34.220949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 15:20:34.220949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c could not be found. Aug 30 15:20:34.220949 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': 'd580a6e1-4d83-4f3d-a9a2-9760bb114e5c'} Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c could not be found. Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:20:34.221760 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c could not be found. Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c could not be found. Aug 30 15:20:34.223251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:20:34.224422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-4d9d2ef5-f754-41e5-9308-0c7806f758c3 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Returning 404 to user: Instance d580a6e1-4d83-4f3d-a9a2-9760bb114e5c could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:20:34.224422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-4d9d2ef5-f754-41e5-9308-0c7806f758c3 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c" status: 404 len: 111 microversion: 2.1 time: 0.036755 Aug 30 15:20:34.224422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1230/2455] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:34 2022] GET /compute/v2.1/servers/d580a6e1-4d83-4f3d-a9a2-9760bb114e5c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:20:34.230354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cf8668e2-5362-4ded-a6b1-b7784b50a2e7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] Calling method '.version_select at 0x7f5cba834790>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:34.234771 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cf8668e2-5362-4ded-a6b1-b7784b50a2e7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [4f00d35e-562c-4bee-859b-48780596ec99] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 15:20:35.243643 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [None req-cf8668e2-5362-4ded-a6b1-b7784b50a2e7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] [4f00d35e-562c-4bee-859b-48780596ec99] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 34412. Aug 30 15:20:35.261771 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cf8668e2-5362-4ded-a6b1-b7784b50a2e7 tempest-TestMinimumBasicScenario-341561519 tempest-TestMinimumBasicScenario-341561519-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-511404298" status: 202 len: 0 microversion: 2.1 time: 1.035745 Aug 30 15:20:35.262482 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1226/2456] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 30 15:20:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-511404298 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 15:20:43.044832 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1853874617", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-634593545", "security_groups": [{"name": "tempest-secgroup-smoke-60335079"}], "block_device_mapping_v2": [{"uuid": "77e31c7c-5bbd-461d-ae74-7d3d10ebbc88", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "21a6900e-24a0-4216-bee4-bd763a4ab351"}]}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:20:43.057186 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=4 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:20:43.170277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.network.neutron [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] validate_networks() for [('21a6900e-24a0-4216-bee4-bd763a4ab351', None, None, None, None, None)] {{(pid=127089) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 15:20:43.569419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Flavor limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 15:20:43.569850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Image limits 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 15:20:43.570329 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Flavor pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 15:20:43.570740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Image pref 0:0:0 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 15:20:43.571250 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.virt.hardware [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127089) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 15:20:43.581382 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:43.581866 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:43.582302 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:43.583029 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:43.583503 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:43.583956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:43.601031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Getting quotas for project b45f3223ea9541f38831d425cb35dbb3. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:20:43.605600 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.quota [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Getting quotas for user 2dc2d1a5bde44defae89c15d60172d4b and project b45f3223ea9541f38831d425cb35dbb3. Resources: {'ram', 'cores', 'instances'} {{(pid=127089) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:20:43.663169 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Going to run 1 instances... {{(pid=127089) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 15:20:43.665668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77e31c7c-5bbd-461d-ae74-7d3d10ebbc88',volume_size=None,volume_type=None)] {{(pid=127089) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 15:20:43.790231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-a204f6f2-4485-4920-a836-f2604c886280 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.751064 Aug 30 15:20:43.790865 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1231/2457] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 15:20:43 2022] POST /compute/v2.1/servers => generated 404 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 15:20:43.801707 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9b98f252-e4f7-4c0f-81e8-310e513946d6 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:43.802435 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9b98f252-e4f7-4c0f-81e8-310e513946d6 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:43.805674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:20:43.867638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b98f252-e4f7-4c0f-81e8-310e513946d6 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:43.874630 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9b98f252-e4f7-4c0f-81e8-310e513946d6 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1094 microversion: 2.1 time: 0.076819 Aug 30 15:20:43.875192 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1227/2458] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:43 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:44.896937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-cee3a8d5-a431-4b9f-ba53-6b06c1423801 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:44.897680 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-cee3a8d5-a431-4b9f-ba53-6b06c1423801 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:44.904840 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cee3a8d5-a431-4b9f-ba53-6b06c1423801 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:44.905429 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cee3a8d5-a431-4b9f-ba53-6b06c1423801 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:44.905944 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cee3a8d5-a431-4b9f-ba53-6b06c1423801 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:44.906731 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cee3a8d5-a431-4b9f-ba53-6b06c1423801 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:44.907286 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cee3a8d5-a431-4b9f-ba53-6b06c1423801 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:44.907882 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-cee3a8d5-a431-4b9f-ba53-6b06c1423801 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:44.972060 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-cee3a8d5-a431-4b9f-ba53-6b06c1423801 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:44.980483 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-cee3a8d5-a431-4b9f-ba53-6b06c1423801 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1200 microversion: 2.1 time: 0.088204 Aug 30 15:20:44.981056 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1232/2459] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:44 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1200 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:46.001965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-03c159a2-4352-4057-9494-48faebf30cf4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:46.002729 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-03c159a2-4352-4057-9494-48faebf30cf4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:46.009997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-03c159a2-4352-4057-9494-48faebf30cf4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:46.010495 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-03c159a2-4352-4057-9494-48faebf30cf4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:46.010972 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-03c159a2-4352-4057-9494-48faebf30cf4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:46.011717 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-03c159a2-4352-4057-9494-48faebf30cf4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:46.012175 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-03c159a2-4352-4057-9494-48faebf30cf4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:46.012627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-03c159a2-4352-4057-9494-48faebf30cf4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:46.216110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-03c159a2-4352-4057-9494-48faebf30cf4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:46.223958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-03c159a2-4352-4057-9494-48faebf30cf4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1264 microversion: 2.1 time: 0.225863 Aug 30 15:20:46.224627 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1228/2460] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:45 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1264 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:46.292132 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-25017130-0a23-4093-b634-9025ef01656e req-62b3eec3-4aa5-4998-815f-c5b977246a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a338377-489e-4653-acad-565045328392", "tag": "0f3556ae-18d7-4e59-a521-56f703b8f91a"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:20:46.303712 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-25017130-0a23-4093-b634-9025ef01656e req-62b3eec3-4aa5-4998-815f-c5b977246a80 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:46.304280 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-25017130-0a23-4093-b634-9025ef01656e req-62b3eec3-4aa5-4998-815f-c5b977246a80 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:46.304624 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-25017130-0a23-4093-b634-9025ef01656e req-62b3eec3-4aa5-4998-815f-c5b977246a80 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:46.316062 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-25017130-0a23-4093-b634-9025ef01656e req-62b3eec3-4aa5-4998-815f-c5b977246a80 service nova] Creating event network-changed:0f3556ae-18d7-4e59-a521-56f703b8f91a for instance 5a338377-489e-4653-acad-565045328392 on hv-cinder-82880 Aug 30 15:20:46.323404 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-25017130-0a23-4093-b634-9025ef01656e req-62b3eec3-4aa5-4998-815f-c5b977246a80 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035710 Aug 30 15:20:46.324478 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1233/2461] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:20:47.246323 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c17d9ae7-a93a-47c9-9a4a-188675b52990 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:47.247084 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c17d9ae7-a93a-47c9-9a4a-188675b52990 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:47.253269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c17d9ae7-a93a-47c9-9a4a-188675b52990 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:47.253746 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c17d9ae7-a93a-47c9-9a4a-188675b52990 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:47.254177 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c17d9ae7-a93a-47c9-9a4a-188675b52990 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:47.254858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c17d9ae7-a93a-47c9-9a4a-188675b52990 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:47.255326 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c17d9ae7-a93a-47c9-9a4a-188675b52990 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:47.255749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c17d9ae7-a93a-47c9-9a4a-188675b52990 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:47.472197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c17d9ae7-a93a-47c9-9a4a-188675b52990 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:47.480425 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c17d9ae7-a93a-47c9-9a4a-188675b52990 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1264 microversion: 2.1 time: 0.238631 Aug 30 15:20:47.480994 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1229/2462] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:47 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1264 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:48.502632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-441e7c23-5565-4b3e-9774-663d9a40ee97 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:48.503291 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-441e7c23-5565-4b3e-9774-663d9a40ee97 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:48.510566 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-441e7c23-5565-4b3e-9774-663d9a40ee97 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:48.511044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-441e7c23-5565-4b3e-9774-663d9a40ee97 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:48.511510 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-441e7c23-5565-4b3e-9774-663d9a40ee97 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:48.512187 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-441e7c23-5565-4b3e-9774-663d9a40ee97 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:48.512632 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-441e7c23-5565-4b3e-9774-663d9a40ee97 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:48.513047 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-441e7c23-5565-4b3e-9774-663d9a40ee97 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:48.647765 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-441e7c23-5565-4b3e-9774-663d9a40ee97 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:48.655854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-441e7c23-5565-4b3e-9774-663d9a40ee97 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1264 microversion: 2.1 time: 0.157851 Aug 30 15:20:48.656434 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1234/2463] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:48 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:49.676316 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a6b75b07-ed04-41ae-a655-7a9cd3b52e0e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:49.676928 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a6b75b07-ed04-41ae-a655-7a9cd3b52e0e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:49.683840 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6b75b07-ed04-41ae-a655-7a9cd3b52e0e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:49.684341 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6b75b07-ed04-41ae-a655-7a9cd3b52e0e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:49.684758 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6b75b07-ed04-41ae-a655-7a9cd3b52e0e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:49.685442 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6b75b07-ed04-41ae-a655-7a9cd3b52e0e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:49.685893 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6b75b07-ed04-41ae-a655-7a9cd3b52e0e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:49.686320 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6b75b07-ed04-41ae-a655-7a9cd3b52e0e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:49.815910 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a6b75b07-ed04-41ae-a655-7a9cd3b52e0e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:49.824052 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a6b75b07-ed04-41ae-a655-7a9cd3b52e0e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1264 microversion: 2.1 time: 0.151570 Aug 30 15:20:49.824871 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1230/2464] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:49 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:50.845438 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-46669595-a325-4187-81c5-d3e8e9eed1dc tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:50.846054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-46669595-a325-4187-81c5-d3e8e9eed1dc tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:50.852959 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46669595-a325-4187-81c5-d3e8e9eed1dc tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:50.853485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46669595-a325-4187-81c5-d3e8e9eed1dc tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:50.853894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46669595-a325-4187-81c5-d3e8e9eed1dc tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:50.854582 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46669595-a325-4187-81c5-d3e8e9eed1dc tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:50.855038 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46669595-a325-4187-81c5-d3e8e9eed1dc tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:50.855491 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-46669595-a325-4187-81c5-d3e8e9eed1dc tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:50.983201 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-46669595-a325-4187-81c5-d3e8e9eed1dc tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:50.990684 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-46669595-a325-4187-81c5-d3e8e9eed1dc tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1264 microversion: 2.1 time: 0.149098 Aug 30 15:20:50.991256 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1235/2465] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:50 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:52.011465 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-706e96a4-4d99-4831-a171-c7e005b4e2be tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:52.012160 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-706e96a4-4d99-4831-a171-c7e005b4e2be tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:52.014726 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:20:52.014862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 15:20:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 (ip 10.222.0.30) !!! Aug 30 15:20:52.024166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-706e96a4-4d99-4831-a171-c7e005b4e2be tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:52.024711 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-706e96a4-4d99-4831-a171-c7e005b4e2be tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:52.025468 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-706e96a4-4d99-4831-a171-c7e005b4e2be tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:52.025782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-706e96a4-4d99-4831-a171-c7e005b4e2be tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:52.026704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-706e96a4-4d99-4831-a171-c7e005b4e2be tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:52.026704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-706e96a4-4d99-4831-a171-c7e005b4e2be tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:52.045310 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e652b3da-1327-4be4-8cd5-8ea1e766e900 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:20:52.045834 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e652b3da-1327-4be4-8cd5-8ea1e766e900 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:52.052217 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e652b3da-1327-4be4-8cd5-8ea1e766e900 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:52.052697 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e652b3da-1327-4be4-8cd5-8ea1e766e900 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:52.053127 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e652b3da-1327-4be4-8cd5-8ea1e766e900 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:52.053811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e652b3da-1327-4be4-8cd5-8ea1e766e900 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:52.054263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e652b3da-1327-4be4-8cd5-8ea1e766e900 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:52.054682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e652b3da-1327-4be4-8cd5-8ea1e766e900 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:52.078618 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.objects.instance [None req-e652b3da-1327-4be4-8cd5-8ea1e766e900 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lazy-loading 'flavor' on Instance uuid 0f3327fd-09b4-4774-a642-4536e8e856ce {{(pid=127089) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 15:20:52.155987 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e652b3da-1327-4be4-8cd5-8ea1e766e900 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "POST /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce/action" status: 202 len: 0 microversion: 2.1 time: 0.114341 Aug 30 15:20:52.156915 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1236/2466] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 15:20:52 2022] POST /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 15:20:52.163348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-706e96a4-4d99-4831-a171-c7e005b4e2be tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:52.165285 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f6ac9ddc-74cc-4ea2-98a2-e379f2f2c154 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:52.166141 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f6ac9ddc-74cc-4ea2-98a2-e379f2f2c154 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:52.172416 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f6ac9ddc-74cc-4ea2-98a2-e379f2f2c154 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:52.172900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f6ac9ddc-74cc-4ea2-98a2-e379f2f2c154 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:52.173222 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-706e96a4-4d99-4831-a171-c7e005b4e2be tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1264 microversion: 2.1 time: 0.165856 Aug 30 15:20:52.173330 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f6ac9ddc-74cc-4ea2-98a2-e379f2f2c154 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:52.187427 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1231/2467] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:52 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:52.187637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f6ac9ddc-74cc-4ea2-98a2-e379f2f2c154 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:52.187637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f6ac9ddc-74cc-4ea2-98a2-e379f2f2c154 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:52.187637 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f6ac9ddc-74cc-4ea2-98a2-e379f2f2c154 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:52.312138 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f6ac9ddc-74cc-4ea2-98a2-e379f2f2c154 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:52.319816 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f6ac9ddc-74cc-4ea2-98a2-e379f2f2c154 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1567 microversion: 2.1 time: 0.158999 Aug 30 15:20:52.320374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1237/2468] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:52 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:20:53.196994 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-48aa616e-46ee-4a98-8080-81aed77d05ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:53.197589 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-48aa616e-46ee-4a98-8080-81aed77d05ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:53.204185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48aa616e-46ee-4a98-8080-81aed77d05ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:53.204710 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48aa616e-46ee-4a98-8080-81aed77d05ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:53.205118 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48aa616e-46ee-4a98-8080-81aed77d05ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:53.205793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48aa616e-46ee-4a98-8080-81aed77d05ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:53.206237 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48aa616e-46ee-4a98-8080-81aed77d05ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:53.206650 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48aa616e-46ee-4a98-8080-81aed77d05ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:53.334459 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-48aa616e-46ee-4a98-8080-81aed77d05ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:53.341323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-39f06826-a75d-40ea-85ab-ae870d9619ec tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:53.341965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-39f06826-a75d-40ea-85ab-ae870d9619ec tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:53.342210 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-48aa616e-46ee-4a98-8080-81aed77d05ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1264 microversion: 2.1 time: 0.149601 Aug 30 15:20:53.342778 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1232/2469] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:53 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:20:53.348283 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39f06826-a75d-40ea-85ab-ae870d9619ec tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:53.348762 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39f06826-a75d-40ea-85ab-ae870d9619ec tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:53.349191 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39f06826-a75d-40ea-85ab-ae870d9619ec tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:53.349876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39f06826-a75d-40ea-85ab-ae870d9619ec tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:53.350324 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39f06826-a75d-40ea-85ab-ae870d9619ec tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:53.350744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-39f06826-a75d-40ea-85ab-ae870d9619ec tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:53.480694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-39f06826-a75d-40ea-85ab-ae870d9619ec tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:53.488422 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-39f06826-a75d-40ea-85ab-ae870d9619ec tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1567 microversion: 2.1 time: 0.150993 Aug 30 15:20:53.488994 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1238/2470] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:53 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:20:54.363397 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ba1e8d42-21f4-4510-b11a-d4abf85e060c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:54.364013 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ba1e8d42-21f4-4510-b11a-d4abf85e060c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:54.365919 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:20:54.371895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba1e8d42-21f4-4510-b11a-d4abf85e060c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:54.372381 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba1e8d42-21f4-4510-b11a-d4abf85e060c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:54.372815 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba1e8d42-21f4-4510-b11a-d4abf85e060c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:54.373499 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba1e8d42-21f4-4510-b11a-d4abf85e060c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:54.373980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba1e8d42-21f4-4510-b11a-d4abf85e060c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:54.374403 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba1e8d42-21f4-4510-b11a-d4abf85e060c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:54.508977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ba1e8d42-21f4-4510-b11a-d4abf85e060c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:54.509825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fa155120-4110-4d62-8aac-71103d02a442 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:54.510455 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fa155120-4110-4d62-8aac-71103d02a442 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:54.512621 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:20:54.513376 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=6 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:20:54.518370 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ba1e8d42-21f4-4510-b11a-d4abf85e060c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1264 microversion: 2.1 time: 0.158766 Aug 30 15:20:54.518954 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1233/2471] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:54 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:54.519901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa155120-4110-4d62-8aac-71103d02a442 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:54.520388 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa155120-4110-4d62-8aac-71103d02a442 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:54.520825 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa155120-4110-4d62-8aac-71103d02a442 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:54.521525 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa155120-4110-4d62-8aac-71103d02a442 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:54.521979 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa155120-4110-4d62-8aac-71103d02a442 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:54.522404 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fa155120-4110-4d62-8aac-71103d02a442 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:54.652454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fa155120-4110-4d62-8aac-71103d02a442 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:54.660111 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fa155120-4110-4d62-8aac-71103d02a442 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1567 microversion: 2.1 time: 0.154709 Aug 30 15:20:54.660684 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1239/2472] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:54 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:20:55.539265 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7418bf44-5c39-4c62-a4d8-d9d50ac15c4c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:55.540571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7418bf44-5c39-4c62-a4d8-d9d50ac15c4c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:55.546833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7418bf44-5c39-4c62-a4d8-d9d50ac15c4c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:55.547352 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7418bf44-5c39-4c62-a4d8-d9d50ac15c4c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:55.547787 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7418bf44-5c39-4c62-a4d8-d9d50ac15c4c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:55.548462 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7418bf44-5c39-4c62-a4d8-d9d50ac15c4c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:55.548907 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7418bf44-5c39-4c62-a4d8-d9d50ac15c4c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:55.549325 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7418bf44-5c39-4c62-a4d8-d9d50ac15c4c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:55.680722 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7418bf44-5c39-4c62-a4d8-d9d50ac15c4c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:55.681483 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-00b2dce5-4907-4494-98f9-e39a25aab25d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:55.682139 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-00b2dce5-4907-4494-98f9-e39a25aab25d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:55.684555 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:20:55.689555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7418bf44-5c39-4c62-a4d8-d9d50ac15c4c tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1264 microversion: 2.1 time: 0.154042 Aug 30 15:20:55.690250 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1234/2473] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:55 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:55.702887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00b2dce5-4907-4494-98f9-e39a25aab25d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:55.702887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00b2dce5-4907-4494-98f9-e39a25aab25d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:55.702887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00b2dce5-4907-4494-98f9-e39a25aab25d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:55.702887 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00b2dce5-4907-4494-98f9-e39a25aab25d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:55.703277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00b2dce5-4907-4494-98f9-e39a25aab25d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:55.703277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-00b2dce5-4907-4494-98f9-e39a25aab25d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:55.703277 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:20:55.832664 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-00b2dce5-4907-4494-98f9-e39a25aab25d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:55.841247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-00b2dce5-4907-4494-98f9-e39a25aab25d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1567 microversion: 2.1 time: 0.163833 Aug 30 15:20:55.841818 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1240/2474] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:55 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:20:56.443560 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-9f105ae6-40ea-4eba-b86b-a71125e9813e req-063caf88-987a-4572-b97a-29688cba434a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a338377-489e-4653-acad-565045328392", "name": "network-vif-plugged", "status": "completed", "tag": "0f3556ae-18d7-4e59-a521-56f703b8f91a"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:20:56.448945 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:20:56.454833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-9f105ae6-40ea-4eba-b86b-a71125e9813e req-063caf88-987a-4572-b97a-29688cba434a service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:56.455359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-9f105ae6-40ea-4eba-b86b-a71125e9813e req-063caf88-987a-4572-b97a-29688cba434a service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:56.455796 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-9f105ae6-40ea-4eba-b86b-a71125e9813e req-063caf88-987a-4572-b97a-29688cba434a service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:56.468634 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-9f105ae6-40ea-4eba-b86b-a71125e9813e req-063caf88-987a-4572-b97a-29688cba434a service nova] Creating event network-vif-plugged:0f3556ae-18d7-4e59-a521-56f703b8f91a for instance 5a338377-489e-4653-acad-565045328392 on hv-cinder-82880 Aug 30 15:20:56.473557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-9f105ae6-40ea-4eba-b86b-a71125e9813e req-063caf88-987a-4572-b97a-29688cba434a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033681 Aug 30 15:20:56.474172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1235/2475] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:20:56.711103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-f63bfeed-7a61-4cdf-8911-c2e369a752e8 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:56.712672 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-f63bfeed-7a61-4cdf-8911-c2e369a752e8 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:56.719545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f63bfeed-7a61-4cdf-8911-c2e369a752e8 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:56.720032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f63bfeed-7a61-4cdf-8911-c2e369a752e8 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:56.720470 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f63bfeed-7a61-4cdf-8911-c2e369a752e8 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:56.721329 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f63bfeed-7a61-4cdf-8911-c2e369a752e8 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:56.721783 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f63bfeed-7a61-4cdf-8911-c2e369a752e8 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:56.722210 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-f63bfeed-7a61-4cdf-8911-c2e369a752e8 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:56.855574 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-f63bfeed-7a61-4cdf-8911-c2e369a752e8 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:56.863186 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c19bbb09-7548-4617-8466-2e772b1d069f tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:56.863757 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-f63bfeed-7a61-4cdf-8911-c2e369a752e8 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1264 microversion: 2.1 time: 0.156175 Aug 30 15:20:56.864046 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1241/2476] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:56 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:56.864333 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c19bbb09-7548-4617-8466-2e772b1d069f tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:56.871978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c19bbb09-7548-4617-8466-2e772b1d069f tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:56.872653 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c19bbb09-7548-4617-8466-2e772b1d069f tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:56.873431 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c19bbb09-7548-4617-8466-2e772b1d069f tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:56.874273 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c19bbb09-7548-4617-8466-2e772b1d069f tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:56.874826 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c19bbb09-7548-4617-8466-2e772b1d069f tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:56.875403 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c19bbb09-7548-4617-8466-2e772b1d069f tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:57.021341 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c19bbb09-7548-4617-8466-2e772b1d069f tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:57.029540 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c19bbb09-7548-4617-8466-2e772b1d069f tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1567 microversion: 2.1 time: 0.171445 Aug 30 15:20:57.030105 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1236/2477] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:56 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:20:57.885847 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bdb035d1-7c55-4ed6-8317-29eb18dc3b96 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:57.886460 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bdb035d1-7c55-4ed6-8317-29eb18dc3b96 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:57.892895 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdb035d1-7c55-4ed6-8317-29eb18dc3b96 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:57.893380 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdb035d1-7c55-4ed6-8317-29eb18dc3b96 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:57.893815 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdb035d1-7c55-4ed6-8317-29eb18dc3b96 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:57.894505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdb035d1-7c55-4ed6-8317-29eb18dc3b96 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:57.894960 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdb035d1-7c55-4ed6-8317-29eb18dc3b96 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:57.895421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bdb035d1-7c55-4ed6-8317-29eb18dc3b96 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:58.027485 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bdb035d1-7c55-4ed6-8317-29eb18dc3b96 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:58.035361 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bdb035d1-7c55-4ed6-8317-29eb18dc3b96 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1264 microversion: 2.1 time: 0.154082 Aug 30 15:20:58.035928 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1242/2478] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:57 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:58.051359 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-beb1b482-b68d-4068-a08b-72944ea35992 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:58.051911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-beb1b482-b68d-4068-a08b-72944ea35992 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:58.058227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-beb1b482-b68d-4068-a08b-72944ea35992 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:58.058734 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-beb1b482-b68d-4068-a08b-72944ea35992 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:58.059166 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-beb1b482-b68d-4068-a08b-72944ea35992 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:58.059868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-beb1b482-b68d-4068-a08b-72944ea35992 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:58.060319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-beb1b482-b68d-4068-a08b-72944ea35992 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:58.060749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-beb1b482-b68d-4068-a08b-72944ea35992 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:58.190219 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-beb1b482-b68d-4068-a08b-72944ea35992 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:58.198321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-beb1b482-b68d-4068-a08b-72944ea35992 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1567 microversion: 2.1 time: 0.150860 Aug 30 15:20:58.198884 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1237/2479] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:58 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:59.056247 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5a70144f-2e08-49d2-b71a-fe3268ad364a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:59.056837 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5a70144f-2e08-49d2-b71a-fe3268ad364a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:59.063426 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a70144f-2e08-49d2-b71a-fe3268ad364a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:59.063905 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a70144f-2e08-49d2-b71a-fe3268ad364a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:59.064338 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a70144f-2e08-49d2-b71a-fe3268ad364a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:59.065025 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a70144f-2e08-49d2-b71a-fe3268ad364a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:59.065475 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a70144f-2e08-49d2-b71a-fe3268ad364a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:59.065896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5a70144f-2e08-49d2-b71a-fe3268ad364a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:59.194145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5a70144f-2e08-49d2-b71a-fe3268ad364a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:59.203743 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5a70144f-2e08-49d2-b71a-fe3268ad364a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1450 microversion: 2.1 time: 0.151381 Aug 30 15:20:59.204318 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1243/2480] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:59 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1450 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:20:59.220089 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-459d66de-f12b-4c1a-91ff-88d525ffe365 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:59.221258 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-459d66de-f12b-4c1a-91ff-88d525ffe365 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:59.223930 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ef8e79df-f3d5-4363-a220-746ae478aaa4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:20:59.224554 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ef8e79df-f3d5-4363-a220-746ae478aaa4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:20:59.231156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef8e79df-f3d5-4363-a220-746ae478aaa4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:59.231695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef8e79df-f3d5-4363-a220-746ae478aaa4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:59.232122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef8e79df-f3d5-4363-a220-746ae478aaa4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:59.232806 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef8e79df-f3d5-4363-a220-746ae478aaa4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:59.233392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef8e79df-f3d5-4363-a220-746ae478aaa4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:59.233811 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ef8e79df-f3d5-4363-a220-746ae478aaa4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:59.234255 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-459d66de-f12b-4c1a-91ff-88d525ffe365 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:59.234739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-459d66de-f12b-4c1a-91ff-88d525ffe365 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:59.235165 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-459d66de-f12b-4c1a-91ff-88d525ffe365 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:59.236078 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-459d66de-f12b-4c1a-91ff-88d525ffe365 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:20:59.236526 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-459d66de-f12b-4c1a-91ff-88d525ffe365 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:20:59.236942 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-459d66de-f12b-4c1a-91ff-88d525ffe365 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:20:59.369827 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ef8e79df-f3d5-4363-a220-746ae478aaa4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:59.377961 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ef8e79df-f3d5-4363-a220-746ae478aaa4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1450 microversion: 2.1 time: 0.157856 Aug 30 15:20:59.380963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1244/2481] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:59 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:20:59.384292 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-459d66de-f12b-4c1a-91ff-88d525ffe365 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:20:59.392159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-459d66de-f12b-4c1a-91ff-88d525ffe365 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1567 microversion: 2.1 time: 0.176124 Aug 30 15:20:59.392785 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1238/2482] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:20:59 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:00.414078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-78409286-7f2b-4421-a1af-e0ff23f59e7d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:00.414803 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-78409286-7f2b-4421-a1af-e0ff23f59e7d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:00.421040 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-78409286-7f2b-4421-a1af-e0ff23f59e7d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:00.421515 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-78409286-7f2b-4421-a1af-e0ff23f59e7d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:00.421943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-78409286-7f2b-4421-a1af-e0ff23f59e7d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:00.422627 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-78409286-7f2b-4421-a1af-e0ff23f59e7d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:00.423155 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-78409286-7f2b-4421-a1af-e0ff23f59e7d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:00.423671 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-78409286-7f2b-4421-a1af-e0ff23f59e7d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:00.557674 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-78409286-7f2b-4421-a1af-e0ff23f59e7d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:00.572029 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-78409286-7f2b-4421-a1af-e0ff23f59e7d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1567 microversion: 2.1 time: 0.161935 Aug 30 15:21:00.573477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1245/2483] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:00 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:01.284083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-3b6a4b24-aad6-46ba-9840-a9e005be4f1f req-15faf65d-8bec-403f-87d2-e836923094af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a338377-489e-4653-acad-565045328392", "tag": "0f3556ae-18d7-4e59-a521-56f703b8f91a"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:21:01.293829 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-3b6a4b24-aad6-46ba-9840-a9e005be4f1f req-15faf65d-8bec-403f-87d2-e836923094af service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:01.294284 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-3b6a4b24-aad6-46ba-9840-a9e005be4f1f req-15faf65d-8bec-403f-87d2-e836923094af service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:01.294706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-3b6a4b24-aad6-46ba-9840-a9e005be4f1f req-15faf65d-8bec-403f-87d2-e836923094af service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:01.306382 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-3b6a4b24-aad6-46ba-9840-a9e005be4f1f req-15faf65d-8bec-403f-87d2-e836923094af service nova] Creating event network-changed:0f3556ae-18d7-4e59-a521-56f703b8f91a for instance 5a338377-489e-4653-acad-565045328392 on hv-cinder-82880 Aug 30 15:21:01.311758 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-3b6a4b24-aad6-46ba-9840-a9e005be4f1f req-15faf65d-8bec-403f-87d2-e836923094af service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031239 Aug 30 15:21:01.312571 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1239/2484] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:21:01.594530 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7d917f26-fc28-4c71-9496-1504cd68387d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:01.595176 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-7d917f26-fc28-4c71-9496-1504cd68387d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:01.602738 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7d917f26-fc28-4c71-9496-1504cd68387d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:01.603249 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7d917f26-fc28-4c71-9496-1504cd68387d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:01.603694 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7d917f26-fc28-4c71-9496-1504cd68387d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:01.604400 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7d917f26-fc28-4c71-9496-1504cd68387d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:01.604846 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7d917f26-fc28-4c71-9496-1504cd68387d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:01.605462 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-7d917f26-fc28-4c71-9496-1504cd68387d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:01.746021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-7d917f26-fc28-4c71-9496-1504cd68387d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:01.754014 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7d917f26-fc28-4c71-9496-1504cd68387d tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1567 microversion: 2.1 time: 0.163239 Aug 30 15:21:01.754830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1246/2485] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:01 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:02.777548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7be174fd-d2bc-4714-a490-4a12904945e5 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:02.778167 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7be174fd-d2bc-4714-a490-4a12904945e5 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:02.784295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7be174fd-d2bc-4714-a490-4a12904945e5 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:02.784773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7be174fd-d2bc-4714-a490-4a12904945e5 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:02.785205 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7be174fd-d2bc-4714-a490-4a12904945e5 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:02.785884 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7be174fd-d2bc-4714-a490-4a12904945e5 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:02.786332 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7be174fd-d2bc-4714-a490-4a12904945e5 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:02.786752 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7be174fd-d2bc-4714-a490-4a12904945e5 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:02.917739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7be174fd-d2bc-4714-a490-4a12904945e5 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:02.925556 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7be174fd-d2bc-4714-a490-4a12904945e5 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1567 microversion: 2.1 time: 0.153509 Aug 30 15:21:02.926116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1240/2486] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:02 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:03.947067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3126670a-5e18-463f-92f9-3c31ea776969 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:03.947727 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3126670a-5e18-463f-92f9-3c31ea776969 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:03.954396 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3126670a-5e18-463f-92f9-3c31ea776969 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:03.954876 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3126670a-5e18-463f-92f9-3c31ea776969 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:03.955344 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3126670a-5e18-463f-92f9-3c31ea776969 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:03.956032 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3126670a-5e18-463f-92f9-3c31ea776969 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:03.956480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3126670a-5e18-463f-92f9-3c31ea776969 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:03.956898 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3126670a-5e18-463f-92f9-3c31ea776969 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:04.088815 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3126670a-5e18-463f-92f9-3c31ea776969 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:04.096425 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3126670a-5e18-463f-92f9-3c31ea776969 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1567 microversion: 2.1 time: 0.153267 Aug 30 15:21:04.096990 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1247/2487] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:03 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:05.118280 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1d73f643-c630-4ba1-84fd-cd0d24be5b81 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:05.118883 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1d73f643-c630-4ba1-84fd-cd0d24be5b81 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:05.125294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d73f643-c630-4ba1-84fd-cd0d24be5b81 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:05.125765 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d73f643-c630-4ba1-84fd-cd0d24be5b81 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:05.126189 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d73f643-c630-4ba1-84fd-cd0d24be5b81 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:05.126858 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d73f643-c630-4ba1-84fd-cd0d24be5b81 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:05.127319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d73f643-c630-4ba1-84fd-cd0d24be5b81 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:05.127733 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d73f643-c630-4ba1-84fd-cd0d24be5b81 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:05.263038 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1d73f643-c630-4ba1-84fd-cd0d24be5b81 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:05.270662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1d73f643-c630-4ba1-84fd-cd0d24be5b81 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1567 microversion: 2.1 time: 0.156676 Aug 30 15:21:05.271233 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1241/2488] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:05 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:06.291150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-e86c2885-f190-4dfa-98a6-d80aba501882 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:06.291802 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-e86c2885-f190-4dfa-98a6-d80aba501882 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:06.298607 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e86c2885-f190-4dfa-98a6-d80aba501882 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:06.299104 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e86c2885-f190-4dfa-98a6-d80aba501882 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:06.299575 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e86c2885-f190-4dfa-98a6-d80aba501882 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:06.300272 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e86c2885-f190-4dfa-98a6-d80aba501882 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:06.300721 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e86c2885-f190-4dfa-98a6-d80aba501882 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:06.301140 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-e86c2885-f190-4dfa-98a6-d80aba501882 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:06.434321 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-e86c2885-f190-4dfa-98a6-d80aba501882 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:06.442388 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-e86c2885-f190-4dfa-98a6-d80aba501882 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1568 microversion: 2.1 time: 0.155245 Aug 30 15:21:06.442963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1248/2489] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:06 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:06.464261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3963240c-69cc-4f56-a7ec-11c05b8a8b04 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:21:06.464791 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3963240c-69cc-4f56-a7ec-11c05b8a8b04 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:06.471123 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3963240c-69cc-4f56-a7ec-11c05b8a8b04 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:06.471636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3963240c-69cc-4f56-a7ec-11c05b8a8b04 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:06.472070 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3963240c-69cc-4f56-a7ec-11c05b8a8b04 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:06.472745 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3963240c-69cc-4f56-a7ec-11c05b8a8b04 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:06.473197 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3963240c-69cc-4f56-a7ec-11c05b8a8b04 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:06.473615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3963240c-69cc-4f56-a7ec-11c05b8a8b04 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:06.513430 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3963240c-69cc-4f56-a7ec-11c05b8a8b04 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127088) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 15:21:06.581646 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3963240c-69cc-4f56-a7ec-11c05b8a8b04 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "POST /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce/action" status: 202 len: 0 microversion: 2.1 time: 0.122363 Aug 30 15:21:06.582262 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1242/2490] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 30 15:21:06 2022] POST /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 15:21:06.590505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-33092cec-54c1-41a6-9daf-1196a6909640 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:06.591237 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-33092cec-54c1-41a6-9daf-1196a6909640 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:06.597337 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-33092cec-54c1-41a6-9daf-1196a6909640 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:06.597821 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-33092cec-54c1-41a6-9daf-1196a6909640 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:06.598294 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-33092cec-54c1-41a6-9daf-1196a6909640 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:06.598984 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-33092cec-54c1-41a6-9daf-1196a6909640 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:06.599473 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-33092cec-54c1-41a6-9daf-1196a6909640 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:06.599900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-33092cec-54c1-41a6-9daf-1196a6909640 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:06.736148 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-33092cec-54c1-41a6-9daf-1196a6909640 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:06.744248 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-33092cec-54c1-41a6-9daf-1196a6909640 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1516 microversion: 2.1 time: 0.157715 Aug 30 15:21:06.744822 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1249/2491] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:06 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:07.765598 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b4621c28-43b6-43c5-9622-05520176727b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:07.766135 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b4621c28-43b6-43c5-9622-05520176727b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:07.772025 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4621c28-43b6-43c5-9622-05520176727b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:07.772503 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4621c28-43b6-43c5-9622-05520176727b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:07.772932 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4621c28-43b6-43c5-9622-05520176727b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:07.774182 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4621c28-43b6-43c5-9622-05520176727b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:07.774636 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4621c28-43b6-43c5-9622-05520176727b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:07.775051 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b4621c28-43b6-43c5-9622-05520176727b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:07.908065 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b4621c28-43b6-43c5-9622-05520176727b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:07.916152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b4621c28-43b6-43c5-9622-05520176727b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1518 microversion: 2.1 time: 0.155017 Aug 30 15:21:07.916966 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1243/2492] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:07 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:08.433894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-379ef319-0273-4823-9ac6-0d7b6f220678 req-fd0ac1c2-2deb-4dde-9a92-bf5e6039b73a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3327fd-09b4-4774-a642-4536e8e856ce", "name": "network-vif-unplugged", "status": "completed", "tag": "a601c9e3-c68b-4e16-9f98-1e1c89bffd76"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:21:08.444203 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-379ef319-0273-4823-9ac6-0d7b6f220678 req-fd0ac1c2-2deb-4dde-9a92-bf5e6039b73a service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:08.444682 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-379ef319-0273-4823-9ac6-0d7b6f220678 req-fd0ac1c2-2deb-4dde-9a92-bf5e6039b73a service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:08.445147 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-379ef319-0273-4823-9ac6-0d7b6f220678 req-fd0ac1c2-2deb-4dde-9a92-bf5e6039b73a service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:08.456971 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-379ef319-0273-4823-9ac6-0d7b6f220678 req-fd0ac1c2-2deb-4dde-9a92-bf5e6039b73a service nova] Creating event network-vif-unplugged:a601c9e3-c68b-4e16-9f98-1e1c89bffd76 for instance 0f3327fd-09b4-4774-a642-4536e8e856ce on hv-cinder-82880 Aug 30 15:21:08.461900 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-379ef319-0273-4823-9ac6-0d7b6f220678 req-fd0ac1c2-2deb-4dde-9a92-bf5e6039b73a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032505 Aug 30 15:21:08.462492 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1250/2493] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:21:08.938131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7a437653-1ca5-433d-8c6c-3652321572e7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:08.938749 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7a437653-1ca5-433d-8c6c-3652321572e7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:08.945383 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a437653-1ca5-433d-8c6c-3652321572e7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:08.945973 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a437653-1ca5-433d-8c6c-3652321572e7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:08.946406 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a437653-1ca5-433d-8c6c-3652321572e7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:08.947100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a437653-1ca5-433d-8c6c-3652321572e7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:08.947594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a437653-1ca5-433d-8c6c-3652321572e7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:08.948022 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a437653-1ca5-433d-8c6c-3652321572e7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:09.156868 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7a437653-1ca5-433d-8c6c-3652321572e7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:09.160426 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:21:09.166043 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7a437653-1ca5-433d-8c6c-3652321572e7 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1574 microversion: 2.1 time: 0.231763 Aug 30 15:21:09.166621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1244/2494] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:08 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1574 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:10.188059 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-686193c3-3646-4290-9113-5543a0f26645 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:10.188782 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-686193c3-3646-4290-9113-5543a0f26645 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:10.194775 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-686193c3-3646-4290-9113-5543a0f26645 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:10.195796 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-686193c3-3646-4290-9113-5543a0f26645 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:10.196258 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-686193c3-3646-4290-9113-5543a0f26645 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:10.196938 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-686193c3-3646-4290-9113-5543a0f26645 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:10.197386 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-686193c3-3646-4290-9113-5543a0f26645 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:10.197803 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-686193c3-3646-4290-9113-5543a0f26645 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:10.332401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-686193c3-3646-4290-9113-5543a0f26645 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:10.340937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-686193c3-3646-4290-9113-5543a0f26645 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1574 microversion: 2.1 time: 0.157579 Aug 30 15:21:10.341499 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1251/2495] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:10 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:11.362658 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d807c519-aad2-4184-8b1d-86977054242a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:11.363295 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d807c519-aad2-4184-8b1d-86977054242a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:11.371363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d807c519-aad2-4184-8b1d-86977054242a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:11.371839 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d807c519-aad2-4184-8b1d-86977054242a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:11.372272 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d807c519-aad2-4184-8b1d-86977054242a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:11.372946 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d807c519-aad2-4184-8b1d-86977054242a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:11.373389 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d807c519-aad2-4184-8b1d-86977054242a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:11.373833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d807c519-aad2-4184-8b1d-86977054242a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:11.507331 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d807c519-aad2-4184-8b1d-86977054242a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:11.514923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d807c519-aad2-4184-8b1d-86977054242a tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1574 microversion: 2.1 time: 0.156935 Aug 30 15:21:11.515548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1245/2496] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:11 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:12.535908 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-77ac5273-77f5-4728-8e09-0ba41c9e9c93 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:12.536519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-77ac5273-77f5-4728-8e09-0ba41c9e9c93 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:12.543138 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77ac5273-77f5-4728-8e09-0ba41c9e9c93 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:12.543649 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77ac5273-77f5-4728-8e09-0ba41c9e9c93 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:12.544076 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77ac5273-77f5-4728-8e09-0ba41c9e9c93 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:12.544755 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77ac5273-77f5-4728-8e09-0ba41c9e9c93 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:12.545200 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77ac5273-77f5-4728-8e09-0ba41c9e9c93 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:12.545617 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77ac5273-77f5-4728-8e09-0ba41c9e9c93 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:12.676448 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-77ac5273-77f5-4728-8e09-0ba41c9e9c93 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:12.684851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-77ac5273-77f5-4728-8e09-0ba41c9e9c93 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1574 microversion: 2.1 time: 0.153067 Aug 30 15:21:12.685420 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1252/2497] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:12 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:13.706287 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-380f6ee6-7666-4a10-a6b8-857e8a096844 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:13.706900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-380f6ee6-7666-4a10-a6b8-857e8a096844 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:13.714112 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-380f6ee6-7666-4a10-a6b8-857e8a096844 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:13.714594 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-380f6ee6-7666-4a10-a6b8-857e8a096844 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:13.715029 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-380f6ee6-7666-4a10-a6b8-857e8a096844 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:13.715742 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-380f6ee6-7666-4a10-a6b8-857e8a096844 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:13.716199 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-380f6ee6-7666-4a10-a6b8-857e8a096844 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:13.716621 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-380f6ee6-7666-4a10-a6b8-857e8a096844 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:13.844453 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-380f6ee6-7666-4a10-a6b8-857e8a096844 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:13.852200 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-380f6ee6-7666-4a10-a6b8-857e8a096844 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1574 microversion: 2.1 time: 0.149816 Aug 30 15:21:13.852757 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1246/2498] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:13 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:14.874386 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-8aff40c1-06a2-4bc3-aaa4-bb6c6834536c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:14.874983 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-8aff40c1-06a2-4bc3-aaa4-bb6c6834536c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:14.881421 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8aff40c1-06a2-4bc3-aaa4-bb6c6834536c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:14.881896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8aff40c1-06a2-4bc3-aaa4-bb6c6834536c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:14.882323 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8aff40c1-06a2-4bc3-aaa4-bb6c6834536c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:14.883009 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8aff40c1-06a2-4bc3-aaa4-bb6c6834536c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:14.883476 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8aff40c1-06a2-4bc3-aaa4-bb6c6834536c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:14.883896 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-8aff40c1-06a2-4bc3-aaa4-bb6c6834536c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:15.014654 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-8aff40c1-06a2-4bc3-aaa4-bb6c6834536c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:15.022229 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-8aff40c1-06a2-4bc3-aaa4-bb6c6834536c tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1574 microversion: 2.1 time: 0.151719 Aug 30 15:21:15.022789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1253/2499] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:14 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:16.044240 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4ea244ee-eaa3-45e8-8095-0a954a5c8b39 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:16.044854 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4ea244ee-eaa3-45e8-8095-0a954a5c8b39 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:16.051319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ea244ee-eaa3-45e8-8095-0a954a5c8b39 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:16.051817 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ea244ee-eaa3-45e8-8095-0a954a5c8b39 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:16.052230 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ea244ee-eaa3-45e8-8095-0a954a5c8b39 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:16.052912 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ea244ee-eaa3-45e8-8095-0a954a5c8b39 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:16.053363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ea244ee-eaa3-45e8-8095-0a954a5c8b39 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:16.053780 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ea244ee-eaa3-45e8-8095-0a954a5c8b39 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:16.186991 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4ea244ee-eaa3-45e8-8095-0a954a5c8b39 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:16.194534 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4ea244ee-eaa3-45e8-8095-0a954a5c8b39 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1574 microversion: 2.1 time: 0.154157 Aug 30 15:21:16.195102 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1247/2500] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:16 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:17.215763 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-1dc73717-a35f-4990-8af2-a582afcce152 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:17.216419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-1dc73717-a35f-4990-8af2-a582afcce152 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:17.223039 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1dc73717-a35f-4990-8af2-a582afcce152 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:17.223559 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1dc73717-a35f-4990-8af2-a582afcce152 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:17.223994 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1dc73717-a35f-4990-8af2-a582afcce152 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:17.224688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1dc73717-a35f-4990-8af2-a582afcce152 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:17.225141 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1dc73717-a35f-4990-8af2-a582afcce152 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:17.225562 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-1dc73717-a35f-4990-8af2-a582afcce152 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:17.359722 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-1dc73717-a35f-4990-8af2-a582afcce152 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:17.368012 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-1dc73717-a35f-4990-8af2-a582afcce152 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1574 microversion: 2.1 time: 0.156125 Aug 30 15:21:17.368605 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1254/2501] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:17 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:18.389476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b6a827b7-37c5-493b-9815-9a58a81784be tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:18.390081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b6a827b7-37c5-493b-9815-9a58a81784be tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:18.396649 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6a827b7-37c5-493b-9815-9a58a81784be tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:18.397126 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6a827b7-37c5-493b-9815-9a58a81784be tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:18.397546 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6a827b7-37c5-493b-9815-9a58a81784be tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:18.399044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6a827b7-37c5-493b-9815-9a58a81784be tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:18.399518 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6a827b7-37c5-493b-9815-9a58a81784be tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:18.399933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6a827b7-37c5-493b-9815-9a58a81784be tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:18.508856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-37107bf7-4aad-44ed-9670-7e4c1867070c req-8dca714c-ce67-42ad-a60d-4efed828b256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3327fd-09b4-4774-a642-4536e8e856ce", "name": "network-vif-plugged", "status": "completed", "tag": "a601c9e3-c68b-4e16-9f98-1e1c89bffd76"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:21:18.519088 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-37107bf7-4aad-44ed-9670-7e4c1867070c req-8dca714c-ce67-42ad-a60d-4efed828b256 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:18.519598 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-37107bf7-4aad-44ed-9670-7e4c1867070c req-8dca714c-ce67-42ad-a60d-4efed828b256 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:18.520031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-37107bf7-4aad-44ed-9670-7e4c1867070c req-8dca714c-ce67-42ad-a60d-4efed828b256 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:18.533153 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-37107bf7-4aad-44ed-9670-7e4c1867070c req-8dca714c-ce67-42ad-a60d-4efed828b256 service nova] Creating event network-vif-plugged:a601c9e3-c68b-4e16-9f98-1e1c89bffd76 for instance 0f3327fd-09b4-4774-a642-4536e8e856ce on hv-cinder-82880 Aug 30 15:21:18.535903 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b6a827b7-37c5-493b-9815-9a58a81784be tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:18.540859 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-37107bf7-4aad-44ed-9670-7e4c1867070c req-8dca714c-ce67-42ad-a60d-4efed828b256 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036031 Aug 30 15:21:18.541621 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1255/2502] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 15:21:18.545712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b6a827b7-37c5-493b-9815-9a58a81784be tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1574 microversion: 2.1 time: 0.160008 Aug 30 15:21:18.546261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1248/2503] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:18 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:19.567815 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-258f3b96-e50d-44d5-9dba-3155163759ba tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:19.568522 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-258f3b96-e50d-44d5-9dba-3155163759ba tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:19.574922 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-258f3b96-e50d-44d5-9dba-3155163759ba tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:19.575454 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-258f3b96-e50d-44d5-9dba-3155163759ba tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:19.575894 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-258f3b96-e50d-44d5-9dba-3155163759ba tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:19.576583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-258f3b96-e50d-44d5-9dba-3155163759ba tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:19.577069 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-258f3b96-e50d-44d5-9dba-3155163759ba tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:19.577502 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-258f3b96-e50d-44d5-9dba-3155163759ba tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:19.712646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-258f3b96-e50d-44d5-9dba-3155163759ba tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:19.720163 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-258f3b96-e50d-44d5-9dba-3155163759ba tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1574 microversion: 2.1 time: 0.157058 Aug 30 15:21:19.720725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1256/2504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:19 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:21:20.741348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-04b95cb5-2660-4091-a29c-5c28c377efa6 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:21:20.742820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-04b95cb5-2660-4091-a29c-5c28c377efa6 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:21:20.748966 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04b95cb5-2660-4091-a29c-5c28c377efa6 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:20.749443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04b95cb5-2660-4091-a29c-5c28c377efa6 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:20.749867 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04b95cb5-2660-4091-a29c-5c28c377efa6 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:20.750538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04b95cb5-2660-4091-a29c-5c28c377efa6 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:21:20.750978 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04b95cb5-2660-4091-a29c-5c28c377efa6 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:21:20.751441 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04b95cb5-2660-4091-a29c-5c28c377efa6 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:21:20.879363 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-04b95cb5-2660-4091-a29c-5c28c377efa6 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:21:20.887577 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-04b95cb5-2660-4091-a29c-5c28c377efa6 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1561 microversion: 2.1 time: 0.150095 Aug 30 15:21:20.888157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1249/2505] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:21:20 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:22:35.055078 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=33 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:22:35.056635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=93 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:22:35.057478 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:22:35.058651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=30 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:22:35.061664 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3bb732f8-18d6-419e-9543-504d0ada617e tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:22:35.062156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3bb732f8-18d6-419e-9543-504d0ada617e tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:22:35.064674 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-50485a90-a5a3-4ae9-bc7a-15aea8bb003a req-3d45aa6d-f74e-4257-9b64-aa32347bbb24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f3327fd-09b4-4774-a642-4536e8e856ce", "tag": "a601c9e3-c68b-4e16-9f98-1e1c89bffd76"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:22:35.069725 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3bb732f8-18d6-419e-9543-504d0ada617e tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:35.070212 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3bb732f8-18d6-419e-9543-504d0ada617e tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:35.070675 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3bb732f8-18d6-419e-9543-504d0ada617e tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:35.071720 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3bb732f8-18d6-419e-9543-504d0ada617e tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:35.071846 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3bb732f8-18d6-419e-9543-504d0ada617e tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:35.072251 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3bb732f8-18d6-419e-9543-504d0ada617e tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:35.076187 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-50485a90-a5a3-4ae9-bc7a-15aea8bb003a req-3d45aa6d-f74e-4257-9b64-aa32347bbb24 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:35.076648 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-50485a90-a5a3-4ae9-bc7a-15aea8bb003a req-3d45aa6d-f74e-4257-9b64-aa32347bbb24 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:35.077590 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-50485a90-a5a3-4ae9-bc7a-15aea8bb003a req-3d45aa6d-f74e-4257-9b64-aa32347bbb24 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:35.089623 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-50485a90-a5a3-4ae9-bc7a-15aea8bb003a req-3d45aa6d-f74e-4257-9b64-aa32347bbb24 service nova] Creating event network-changed:a601c9e3-c68b-4e16-9f98-1e1c89bffd76 for instance 0f3327fd-09b4-4774-a642-4536e8e856ce on hv-cinder-82880 Aug 30 15:22:35.094779 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-50485a90-a5a3-4ae9-bc7a-15aea8bb003a req-3d45aa6d-f74e-4257-9b64-aa32347bbb24 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039429 Aug 30 15:22:35.095624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1250/2506] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 15:22:35.098840 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3bb732f8-18d6-419e-9543-504d0ada617e tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Going to try to terminate instance {{(pid=127089) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 15:22:35.185364 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3bb732f8-18d6-419e-9543-504d0ada617e tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "DELETE /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 204 len: 0 microversion: 2.1 time: 0.131793 Aug 30 15:22:35.186336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1257/2507] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:22:35 2022] DELETE /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 15:22:35.194832 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-14c98530-3103-4add-9c6e-326a88768110 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:22:35.195619 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-14c98530-3103-4add-9c6e-326a88768110 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:22:35.203376 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14c98530-3103-4add-9c6e-326a88768110 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:35.203917 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14c98530-3103-4add-9c6e-326a88768110 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:35.204354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14c98530-3103-4add-9c6e-326a88768110 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:35.205045 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14c98530-3103-4add-9c6e-326a88768110 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:35.205934 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14c98530-3103-4add-9c6e-326a88768110 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:35.206549 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-14c98530-3103-4add-9c6e-326a88768110 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:35.342914 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-14c98530-3103-4add-9c6e-326a88768110 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:22:35.350618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-14c98530-3103-4add-9c6e-326a88768110 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1567 microversion: 2.1 time: 0.160121 Aug 30 15:22:35.351185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1251/2508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:22:35 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:22:36.373031 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5c716fbc-3345-4eab-ac00-e76d9da2e6a9 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:22:36.373711 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5c716fbc-3345-4eab-ac00-e76d9da2e6a9 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:22:36.380256 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c716fbc-3345-4eab-ac00-e76d9da2e6a9 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:36.380735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c716fbc-3345-4eab-ac00-e76d9da2e6a9 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:36.381170 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c716fbc-3345-4eab-ac00-e76d9da2e6a9 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:36.381848 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c716fbc-3345-4eab-ac00-e76d9da2e6a9 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:36.382297 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c716fbc-3345-4eab-ac00-e76d9da2e6a9 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:36.382715 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5c716fbc-3345-4eab-ac00-e76d9da2e6a9 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:36.573054 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5c716fbc-3345-4eab-ac00-e76d9da2e6a9 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:22:36.581007 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5c716fbc-3345-4eab-ac00-e76d9da2e6a9 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1567 microversion: 2.1 time: 0.213233 Aug 30 15:22:36.581565 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1258/2509] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:22:36 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:22:37.489528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-a4a73ea2-823a-4b46-a752-3020e13158cd req-ede9ff06-9eb9-415e-aad4-db3f756537a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3327fd-09b4-4774-a642-4536e8e856ce", "name": "network-vif-deleted", "tag": "a601c9e3-c68b-4e16-9f98-1e1c89bffd76"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:22:37.502712 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a4a73ea2-823a-4b46-a752-3020e13158cd req-ede9ff06-9eb9-415e-aad4-db3f756537a2 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:37.503245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a4a73ea2-823a-4b46-a752-3020e13158cd req-ede9ff06-9eb9-415e-aad4-db3f756537a2 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:37.503720 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a4a73ea2-823a-4b46-a752-3020e13158cd req-ede9ff06-9eb9-415e-aad4-db3f756537a2 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:37.519958 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-a4a73ea2-823a-4b46-a752-3020e13158cd req-ede9ff06-9eb9-415e-aad4-db3f756537a2 service nova] Creating event network-vif-deleted:a601c9e3-c68b-4e16-9f98-1e1c89bffd76 for instance 0f3327fd-09b4-4774-a642-4536e8e856ce on hv-cinder-82880 Aug 30 15:22:37.525764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-a4a73ea2-823a-4b46-a752-3020e13158cd req-ede9ff06-9eb9-415e-aad4-db3f756537a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040553 Aug 30 15:22:37.526467 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1252/2510] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:22:37.601716 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-853a96a1-0244-42b1-84ef-37d739f8e892 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:22:37.602482 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-853a96a1-0244-42b1-84ef-37d739f8e892 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:22:37.609115 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-853a96a1-0244-42b1-84ef-37d739f8e892 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:37.609598 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-853a96a1-0244-42b1-84ef-37d739f8e892 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:37.610030 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-853a96a1-0244-42b1-84ef-37d739f8e892 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:37.610719 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-853a96a1-0244-42b1-84ef-37d739f8e892 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:37.611169 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-853a96a1-0244-42b1-84ef-37d739f8e892 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:37.611613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-853a96a1-0244-42b1-84ef-37d739f8e892 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:37.675690 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-853a96a1-0244-42b1-84ef-37d739f8e892 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2905d19c05b4f53ba70e2bb3d165bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e8a9461846a7b08fe7328ecf7a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:22:37.684122 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-853a96a1-0244-42b1-84ef-37d739f8e892 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 200 len: 1219 microversion: 2.1 time: 0.086241 Aug 30 15:22:37.684690 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1259/2511] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:22:37 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:22:38.706994 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-449659a2-ff96-4c25-bf1d-8473351e6385 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:22:38.707639 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-449659a2-ff96-4c25-bf1d-8473351e6385 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] [instance: 0f3327fd-09b4-4774-a642-4536e8e856ce] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:22:38.714555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-449659a2-ff96-4c25-bf1d-8473351e6385 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:38.715031 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-449659a2-ff96-4c25-bf1d-8473351e6385 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:38.715495 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-449659a2-ff96-4c25-bf1d-8473351e6385 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:38.716178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-449659a2-ff96-4c25-bf1d-8473351e6385 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:38.716624 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-449659a2-ff96-4c25-bf1d-8473351e6385 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:38.717041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-449659a2-ff96-4c25-bf1d-8473351e6385 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:38.730259 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-449659a2-ff96-4c25-bf1d-8473351e6385 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] HTTP exception thrown: Instance 0f3327fd-09b4-4774-a642-4536e8e856ce could not be found. Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-449659a2-ff96-4c25-bf1d-8473351e6385 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Request method failure captured: Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce HTTP/1.1 Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDiogd4LGRbzBG9DYhbzFnA8KSd-25S-l7oo4PNkLU_9F4cUE4qr4se09wb88ExH3enSocAkSrz6E-mMlXa293tZDWzv3S0SoLa952r14W2tFQDUUnxmllIoWZBVCFcTKEARVtIhiD8E2FgZT6bJ1V_yJTOBQJMHntXB9GQdX6vZeV2Q Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: 7034e8a9461846a7b08fe7328ecf7a47 Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-TestShelveInstance-1421719349 Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:22:38.731918 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:22:38.733368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7034e8a9461846a7b08fe7328ecf7a47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7034e8a9461846a7b08fe7328ecf7a47", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7034e8a9461846a7b08fe7328ecf7a47"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7034e8a9461846a7b08fe7328ecf7a47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:22:38.733368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-TestShelveInstance-1421719349 Aug 30 15:22:38.733368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 7034e8a9461846a7b08fe7328ecf7a47 Aug 30 15:22:38.733368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-TestShelveInstance-1421719349 Aug 30 15:22:38.733368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-TestShelveInstance-1421719349-project Aug 30 15:22:38.733368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:22:38.733368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:22:38.733368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: b2905d19c05b4f53ba70e2bb3d165bc1 Aug 30 15:22:38.733368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-TestShelveInstance-1421719349-project Aug 30 15:22:38.733368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:22:38.733368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance 0f3327fd-09b4-4774-a642-4536e8e856ce could not be found. Aug 30 15:22:38.733368 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': '0f3327fd-09b4-4774-a642-4536e8e856ce'} Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f3327fd-09b4-4774-a642-4536e8e856ce could not be found. Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:22:38.734269 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f3327fd-09b4-4774-a642-4536e8e856ce could not be found. Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f3327fd-09b4-4774-a642-4536e8e856ce could not be found. Aug 30 15:22:38.735528 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:22:38.736500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-449659a2-ff96-4c25-bf1d-8473351e6385 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Returning 404 to user: Instance 0f3327fd-09b4-4774-a642-4536e8e856ce could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:22:38.736500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-449659a2-ff96-4c25-bf1d-8473351e6385 tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce" status: 404 len: 111 microversion: 2.1 time: 0.031530 Aug 30 15:22:38.736500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1253/2512] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:22:38 2022] GET /compute/v2.1/servers/0f3327fd-09b4-4774-a642-4536e8e856ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 15:22:38.891799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5e6f9b33-c5ec-496c-8d0e-3deb4734689b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] Calling method '.version_select at 0x7f5cba7a99d0>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:22:38.912100 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5e6f9b33-c5ec-496c-8d0e-3deb4734689b tempest-TestShelveInstance-1421719349 tempest-TestShelveInstance-1421719349-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-738696658" status: 202 len: 0 microversion: 2.1 time: 0.023978 Aug 30 15:22:38.912693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1260/2513] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 30 15:22:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-738696658 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 15:22:54.184620 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dc5a8465-9bf4-406f-84cc-695a5b1d9c7e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:22:54.185172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dc5a8465-9bf4-406f-84cc-695a5b1d9c7e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:22:54.187226 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=8 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:22:54.187980 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=12 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:22:54.193831 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dc5a8465-9bf4-406f-84cc-695a5b1d9c7e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:54.194306 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dc5a8465-9bf4-406f-84cc-695a5b1d9c7e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:54.194737 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dc5a8465-9bf4-406f-84cc-695a5b1d9c7e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:54.195447 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dc5a8465-9bf4-406f-84cc-695a5b1d9c7e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:54.195897 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dc5a8465-9bf4-406f-84cc-695a5b1d9c7e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:54.196314 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dc5a8465-9bf4-406f-84cc-695a5b1d9c7e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:54.222410 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dc5a8465-9bf4-406f-84cc-695a5b1d9c7e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 15:22:54.296445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dc5a8465-9bf4-406f-84cc-695a5b1d9c7e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 204 len: 0 microversion: 2.1 time: 0.115574 Aug 30 15:22:54.297153 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1254/2514] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:22:54 2022] DELETE /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 15:22:54.303168 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:22:54.304103 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:22:54.308939 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ee4bf057-5923-48ad-8fe0-8b67d51c28d1 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:22:54.309805 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ee4bf057-5923-48ad-8fe0-8b67d51c28d1 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:22:54.317954 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee4bf057-5923-48ad-8fe0-8b67d51c28d1 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:54.318493 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee4bf057-5923-48ad-8fe0-8b67d51c28d1 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:54.318926 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee4bf057-5923-48ad-8fe0-8b67d51c28d1 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:54.319642 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee4bf057-5923-48ad-8fe0-8b67d51c28d1 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:54.320091 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee4bf057-5923-48ad-8fe0-8b67d51c28d1 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:54.320535 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ee4bf057-5923-48ad-8fe0-8b67d51c28d1 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:54.458459 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ee4bf057-5923-48ad-8fe0-8b67d51c28d1 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:22:54.466044 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ee4bf057-5923-48ad-8fe0-8b67d51c28d1 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1573 microversion: 2.1 time: 0.164415 Aug 30 15:22:54.466604 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1261/2515] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:22:54 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:22:55.487637 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b77e3299-ed7e-4837-897e-d146e3995bc2 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:22:55.488329 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b77e3299-ed7e-4837-897e-d146e3995bc2 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:22:55.495202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b77e3299-ed7e-4837-897e-d146e3995bc2 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:55.495700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b77e3299-ed7e-4837-897e-d146e3995bc2 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:55.496134 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b77e3299-ed7e-4837-897e-d146e3995bc2 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:55.496804 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b77e3299-ed7e-4837-897e-d146e3995bc2 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:55.497245 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b77e3299-ed7e-4837-897e-d146e3995bc2 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:55.497657 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b77e3299-ed7e-4837-897e-d146e3995bc2 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:55.638185 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b77e3299-ed7e-4837-897e-d146e3995bc2 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:22:55.645986 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b77e3299-ed7e-4837-897e-d146e3995bc2 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1573 microversion: 2.1 time: 0.162652 Aug 30 15:22:55.646557 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1255/2516] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:22:55 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:22:56.667914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-14c89dfc-392d-4824-9bd5-8b197b10ad19 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:22:56.668688 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-14c89dfc-392d-4824-9bd5-8b197b10ad19 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:22:56.675182 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-14c89dfc-392d-4824-9bd5-8b197b10ad19 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:56.675716 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-14c89dfc-392d-4824-9bd5-8b197b10ad19 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:56.676145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-14c89dfc-392d-4824-9bd5-8b197b10ad19 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:56.676830 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-14c89dfc-392d-4824-9bd5-8b197b10ad19 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:56.677276 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-14c89dfc-392d-4824-9bd5-8b197b10ad19 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:56.677695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-14c89dfc-392d-4824-9bd5-8b197b10ad19 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:56.747589 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-14c89dfc-392d-4824-9bd5-8b197b10ad19 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:22:56.755154 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-14c89dfc-392d-4824-9bd5-8b197b10ad19 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 200 len: 1507 microversion: 2.1 time: 0.091742 Aug 30 15:22:56.755754 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1262/2517] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:22:56 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 1507 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:22:56.922063 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-bd49dabd-77b2-4a5a-9e01-3e6d02b6cc14 req-a2358f31-1e11-481d-a27a-5dce3486ab73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a338377-489e-4653-acad-565045328392", "name": "network-vif-deleted", "tag": "0f3556ae-18d7-4e59-a521-56f703b8f91a"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:22:56.934183 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bd49dabd-77b2-4a5a-9e01-3e6d02b6cc14 req-a2358f31-1e11-481d-a27a-5dce3486ab73 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:56.934662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bd49dabd-77b2-4a5a-9e01-3e6d02b6cc14 req-a2358f31-1e11-481d-a27a-5dce3486ab73 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:56.935086 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bd49dabd-77b2-4a5a-9e01-3e6d02b6cc14 req-a2358f31-1e11-481d-a27a-5dce3486ab73 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:56.946527 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-bd49dabd-77b2-4a5a-9e01-3e6d02b6cc14 req-a2358f31-1e11-481d-a27a-5dce3486ab73 service nova] Creating event network-vif-deleted:0f3556ae-18d7-4e59-a521-56f703b8f91a for instance 5a338377-489e-4653-acad-565045328392 on hv-cinder-82880 Aug 30 15:22:56.953172 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-bd49dabd-77b2-4a5a-9e01-3e6d02b6cc14 req-a2358f31-1e11-481d-a27a-5dce3486ab73 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034827 Aug 30 15:22:56.954261 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1256/2518] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:22:57.776781 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-89629601-c4c6-48fb-b365-9025171ce719 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:22:57.777464 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-89629601-c4c6-48fb-b365-9025171ce719 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:22:57.784424 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89629601-c4c6-48fb-b365-9025171ce719 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:57.785143 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89629601-c4c6-48fb-b365-9025171ce719 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:57.785751 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89629601-c4c6-48fb-b365-9025171ce719 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:57.786580 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89629601-c4c6-48fb-b365-9025171ce719 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:57.787082 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89629601-c4c6-48fb-b365-9025171ce719 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:57.787613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-89629601-c4c6-48fb-b365-9025171ce719 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:57.801740 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-89629601-c4c6-48fb-b365-9025171ce719 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] HTTP exception thrown: Instance 5a338377-489e-4653-acad-565045328392 could not be found. Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-89629601-c4c6-48fb-b365-9025171ce719 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Request method failure captured: Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 HTTP/1.1 Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiq03meZf34EHcP8TrH6VfJwFm7gmVw5fIgWF-6cgrpeS3kkwHvB1kq8NjLHYj4rTo31UGBtCs79SJcMCkmKoXEwaAL_cQDGEMkCfc6Kp_Ck-2vsnKuYrdAjWj2I8AyktRmffEIjTLERaafE1yssUPwtE857epffVEoPxGKmLki1rbU Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: b45f3223ea9541f38831d425cb35dbb3 Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-TestVolumeBootPattern-590827916 Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 15:22:57.803474 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 15:22:57.804937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b45f3223ea9541f38831d425cb35dbb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b45f3223ea9541f38831d425cb35dbb3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b45f3223ea9541f38831d425cb35dbb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b45f3223ea9541f38831d425cb35dbb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:22:57.804937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-TestVolumeBootPattern-590827916 Aug 30 15:22:57.804937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: b45f3223ea9541f38831d425cb35dbb3 Aug 30 15:22:57.804937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-TestVolumeBootPattern-590827916 Aug 30 15:22:57.804937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-TestVolumeBootPattern-590827916-project Aug 30 15:22:57.804937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 15:22:57.804937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 15:22:57.804937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: 2dc2d1a5bde44defae89c15d60172d4b Aug 30 15:22:57.804937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-TestVolumeBootPattern-590827916-project Aug 30 15:22:57.804937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 15:22:57.804937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance 5a338377-489e-4653-acad-565045328392 could not be found. Aug 30 15:22:57.804937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': '5a338377-489e-4653-acad-565045328392'} Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a338377-489e-4653-acad-565045328392 could not be found. Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:22:57.805902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a338377-489e-4653-acad-565045328392 could not be found. Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a338377-489e-4653-acad-565045328392 could not be found. Aug 30 15:22:57.807992 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:22:57.809005 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-89629601-c4c6-48fb-b365-9025171ce719 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Returning 404 to user: Instance 5a338377-489e-4653-acad-565045328392 could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:22:57.809005 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-89629601-c4c6-48fb-b365-9025171ce719 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 404 len: 111 microversion: 2.1 time: 0.032533 Aug 30 15:22:57.809005 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1263/2519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:22:57 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:22:57.907279 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1760733120", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-634593545", "security_groups": [{"name": "tempest-secgroup-smoke-60335079"}], "block_device_mapping_v2": [{"uuid": "77e31c7c-5bbd-461d-ae74-7d3d10ebbc88", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "21a6900e-24a0-4216-bee4-bd763a4ab351"}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:22:58.019480 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] validate_networks() for [('21a6900e-24a0-4216-bee4-bd763a4ab351', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 15:22:58.479202 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 15:22:58.479675 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 15:22:58.480140 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 15:22:58.480567 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 15:22:58.480968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 15:22:58.489512 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:58.489985 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:58.490408 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:58.491113 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:58.491591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:58.492003 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:58.508773 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Getting quotas for project b45f3223ea9541f38831d425cb35dbb3. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:22:58.512831 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Getting quotas for user 2dc2d1a5bde44defae89c15d60172d4b and project b45f3223ea9541f38831d425cb35dbb3. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:22:58.569161 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 15:22:58.571419 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77e31c7c-5bbd-461d-ae74-7d3d10ebbc88',volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 15:22:58.703683 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1acf9ec2-06a8-4a5c-8ccd-bf8a56129cd4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.800472 Aug 30 15:22:58.704337 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1257/2520] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 15:22:57 2022] POST /compute/v2.1/servers => generated 404 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 15:22:58.715495 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-6b6f3ec4-c64c-4efa-9fb5-67414e482613 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:22:58.716223 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-6b6f3ec4-c64c-4efa-9fb5-67414e482613 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:22:58.772123 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-6b6f3ec4-c64c-4efa-9fb5-67414e482613 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:22:58.779585 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-6b6f3ec4-c64c-4efa-9fb5-67414e482613 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1094 microversion: 2.1 time: 0.068405 Aug 30 15:22:58.780466 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1264/2521] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:22:58 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:22:59.800529 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6d96482c-6413-4b25-8f1d-6a62a85d9b31 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:22:59.801057 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6d96482c-6413-4b25-8f1d-6a62a85d9b31 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:22:59.808813 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d96482c-6413-4b25-8f1d-6a62a85d9b31 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:59.809304 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d96482c-6413-4b25-8f1d-6a62a85d9b31 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:59.809923 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d96482c-6413-4b25-8f1d-6a62a85d9b31 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:59.810654 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d96482c-6413-4b25-8f1d-6a62a85d9b31 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:22:59.811107 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d96482c-6413-4b25-8f1d-6a62a85d9b31 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:22:59.811559 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d96482c-6413-4b25-8f1d-6a62a85d9b31 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:22:59.875150 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6d96482c-6413-4b25-8f1d-6a62a85d9b31 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:22:59.882842 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6d96482c-6413-4b25-8f1d-6a62a85d9b31 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1200 microversion: 2.1 time: 0.086336 Aug 30 15:22:59.883443 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1258/2522] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:22:59 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1200 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:23:00.903897 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0afe2634-0bb9-4f7c-8a35-45f711247431 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:23:00.904511 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0afe2634-0bb9-4f7c-8a35-45f711247431 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:23:00.911878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0afe2634-0bb9-4f7c-8a35-45f711247431 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:00.912368 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0afe2634-0bb9-4f7c-8a35-45f711247431 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:00.912802 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0afe2634-0bb9-4f7c-8a35-45f711247431 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:00.913504 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0afe2634-0bb9-4f7c-8a35-45f711247431 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:00.913959 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0afe2634-0bb9-4f7c-8a35-45f711247431 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:00.914383 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0afe2634-0bb9-4f7c-8a35-45f711247431 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:01.158477 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0afe2634-0bb9-4f7c-8a35-45f711247431 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:23:01.166925 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0afe2634-0bb9-4f7c-8a35-45f711247431 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1264 microversion: 2.1 time: 0.266949 Aug 30 15:23:01.167505 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1265/2523] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:23:00 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1264 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:23:01.495034 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-02386c76-f097-4ca4-9cf3-d09a1f38953d req-1bb075bd-5938-42eb-8c57-c508fcdb64d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "690f9316-215d-43ed-bba4-1dab9ddf6720", "tag": "aba98a4b-afc5-4234-b2dc-bc6c19def4a5"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:23:01.505300 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-02386c76-f097-4ca4-9cf3-d09a1f38953d req-1bb075bd-5938-42eb-8c57-c508fcdb64d1 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:01.505911 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-02386c76-f097-4ca4-9cf3-d09a1f38953d req-1bb075bd-5938-42eb-8c57-c508fcdb64d1 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:01.506993 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-02386c76-f097-4ca4-9cf3-d09a1f38953d req-1bb075bd-5938-42eb-8c57-c508fcdb64d1 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:01.518519 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-02386c76-f097-4ca4-9cf3-d09a1f38953d req-1bb075bd-5938-42eb-8c57-c508fcdb64d1 service nova] Creating event network-changed:aba98a4b-afc5-4234-b2dc-bc6c19def4a5 for instance 690f9316-215d-43ed-bba4-1dab9ddf6720 on hv-cinder-82880 Aug 30 15:23:01.523472 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-02386c76-f097-4ca4-9cf3-d09a1f38953d req-1bb075bd-5938-42eb-8c57-c508fcdb64d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032723 Aug 30 15:23:01.524157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1259/2524] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:23:02.188064 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3f942723-d79f-46fc-8b12-b164a2569c60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:23:02.188681 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3f942723-d79f-46fc-8b12-b164a2569c60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:23:02.195114 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f942723-d79f-46fc-8b12-b164a2569c60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:02.195626 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f942723-d79f-46fc-8b12-b164a2569c60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:02.196058 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f942723-d79f-46fc-8b12-b164a2569c60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:02.196920 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f942723-d79f-46fc-8b12-b164a2569c60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:02.197467 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f942723-d79f-46fc-8b12-b164a2569c60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:02.197735 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3f942723-d79f-46fc-8b12-b164a2569c60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:02.406937 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3f942723-d79f-46fc-8b12-b164a2569c60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:23:02.414553 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3f942723-d79f-46fc-8b12-b164a2569c60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1264 microversion: 2.1 time: 0.230389 Aug 30 15:23:02.415128 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1266/2525] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:23:02 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:23:03.438115 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3f2c7cad-e4dd-4099-bd90-6d9c24a121b7 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:23:03.438811 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3f2c7cad-e4dd-4099-bd90-6d9c24a121b7 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:23:03.444880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f2c7cad-e4dd-4099-bd90-6d9c24a121b7 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:03.445354 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f2c7cad-e4dd-4099-bd90-6d9c24a121b7 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:03.445783 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f2c7cad-e4dd-4099-bd90-6d9c24a121b7 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:03.446459 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f2c7cad-e4dd-4099-bd90-6d9c24a121b7 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:03.446933 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f2c7cad-e4dd-4099-bd90-6d9c24a121b7 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:03.447373 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3f2c7cad-e4dd-4099-bd90-6d9c24a121b7 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:03.581218 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3f2c7cad-e4dd-4099-bd90-6d9c24a121b7 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:23:03.589333 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3f2c7cad-e4dd-4099-bd90-6d9c24a121b7 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1264 microversion: 2.1 time: 0.155599 Aug 30 15:23:03.590114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1260/2526] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:23:03 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:23:04.610133 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-ffba0e69-3d5e-4b18-8018-84788b327d57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:23:04.610854 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-ffba0e69-3d5e-4b18-8018-84788b327d57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:23:04.617284 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ffba0e69-3d5e-4b18-8018-84788b327d57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:04.617764 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ffba0e69-3d5e-4b18-8018-84788b327d57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:04.618196 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ffba0e69-3d5e-4b18-8018-84788b327d57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:04.618879 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ffba0e69-3d5e-4b18-8018-84788b327d57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:04.619360 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ffba0e69-3d5e-4b18-8018-84788b327d57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:04.619784 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-ffba0e69-3d5e-4b18-8018-84788b327d57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:04.746423 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-ffba0e69-3d5e-4b18-8018-84788b327d57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:23:04.753965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-ffba0e69-3d5e-4b18-8018-84788b327d57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1264 microversion: 2.1 time: 0.147713 Aug 30 15:23:04.754528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1267/2527] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:23:04 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:23:05.774949 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7424f80e-8d87-4b6a-8fc8-9eb062aec22e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:23:05.775630 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7424f80e-8d87-4b6a-8fc8-9eb062aec22e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:23:05.782042 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7424f80e-8d87-4b6a-8fc8-9eb062aec22e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:05.782520 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7424f80e-8d87-4b6a-8fc8-9eb062aec22e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:05.782950 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7424f80e-8d87-4b6a-8fc8-9eb062aec22e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:05.783662 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7424f80e-8d87-4b6a-8fc8-9eb062aec22e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:05.784110 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7424f80e-8d87-4b6a-8fc8-9eb062aec22e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:05.784530 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7424f80e-8d87-4b6a-8fc8-9eb062aec22e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:05.913178 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7424f80e-8d87-4b6a-8fc8-9eb062aec22e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:23:05.921336 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7424f80e-8d87-4b6a-8fc8-9eb062aec22e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1264 microversion: 2.1 time: 0.150478 Aug 30 15:23:05.921900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1261/2528] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:23:05 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:23:06.942552 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-3b539ec6-7138-4d56-b3cb-35eb085c1162 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:23:06.943163 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-3b539ec6-7138-4d56-b3cb-35eb085c1162 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:23:06.950587 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b539ec6-7138-4d56-b3cb-35eb085c1162 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:06.951067 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b539ec6-7138-4d56-b3cb-35eb085c1162 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:06.951545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b539ec6-7138-4d56-b3cb-35eb085c1162 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:06.952237 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b539ec6-7138-4d56-b3cb-35eb085c1162 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:06.952686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b539ec6-7138-4d56-b3cb-35eb085c1162 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:06.953106 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-3b539ec6-7138-4d56-b3cb-35eb085c1162 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:07.083724 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-3b539ec6-7138-4d56-b3cb-35eb085c1162 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:23:07.091815 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-3b539ec6-7138-4d56-b3cb-35eb085c1162 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1264 microversion: 2.1 time: 0.153249 Aug 30 15:23:07.092408 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1268/2529] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:23:06 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:23:08.113041 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-858a517e-576e-4749-9ce0-9c65bc4fda57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:23:08.113651 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-858a517e-576e-4749-9ce0-9c65bc4fda57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:23:08.120750 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-858a517e-576e-4749-9ce0-9c65bc4fda57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:08.121225 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-858a517e-576e-4749-9ce0-9c65bc4fda57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:08.121656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-858a517e-576e-4749-9ce0-9c65bc4fda57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:08.122335 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-858a517e-576e-4749-9ce0-9c65bc4fda57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:08.122782 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-858a517e-576e-4749-9ce0-9c65bc4fda57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:08.123221 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-858a517e-576e-4749-9ce0-9c65bc4fda57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:08.251656 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-858a517e-576e-4749-9ce0-9c65bc4fda57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:23:08.259448 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-858a517e-576e-4749-9ce0-9c65bc4fda57 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1264 microversion: 2.1 time: 0.150013 Aug 30 15:23:08.260075 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1262/2530] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:23:08 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:23:09.280164 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-5fd32bd6-3330-4b1f-9e66-00829d123636 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:23:09.280772 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-5fd32bd6-3330-4b1f-9e66-00829d123636 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:23:09.283055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:23:09.288771 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fd32bd6-3330-4b1f-9e66-00829d123636 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:09.289281 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fd32bd6-3330-4b1f-9e66-00829d123636 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:09.289707 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fd32bd6-3330-4b1f-9e66-00829d123636 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:09.291161 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fd32bd6-3330-4b1f-9e66-00829d123636 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:09.291631 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fd32bd6-3330-4b1f-9e66-00829d123636 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:09.292055 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-5fd32bd6-3330-4b1f-9e66-00829d123636 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:09.421519 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-5fd32bd6-3330-4b1f-9e66-00829d123636 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:23:09.429038 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-5fd32bd6-3330-4b1f-9e66-00829d123636 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1264 microversion: 2.1 time: 0.152726 Aug 30 15:23:09.429608 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1269/2531] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:23:09 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:23:10.450610 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-75b9af2a-9847-4df2-a415-6f496195767a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:23:10.451138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-75b9af2a-9847-4df2-a415-6f496195767a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:23:10.453096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:23:10.453748 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:23:10.460315 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75b9af2a-9847-4df2-a415-6f496195767a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:10.460791 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75b9af2a-9847-4df2-a415-6f496195767a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:10.461224 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75b9af2a-9847-4df2-a415-6f496195767a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:10.461921 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75b9af2a-9847-4df2-a415-6f496195767a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:10.462371 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75b9af2a-9847-4df2-a415-6f496195767a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:10.462795 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-75b9af2a-9847-4df2-a415-6f496195767a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:10.596233 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-75b9af2a-9847-4df2-a415-6f496195767a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:23:10.604421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-75b9af2a-9847-4df2-a415-6f496195767a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1264 microversion: 2.1 time: 0.158171 Aug 30 15:23:10.604984 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1263/2532] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:23:10 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:23:11.183555 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-df0b22ca-6efa-4ad9-b45b-eded9dbb161a req-d9cb761f-6813-492f-b949-2f549c3b48c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "690f9316-215d-43ed-bba4-1dab9ddf6720", "name": "network-vif-plugged", "status": "completed", "tag": "aba98a4b-afc5-4234-b2dc-bc6c19def4a5"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:23:11.193687 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-df0b22ca-6efa-4ad9-b45b-eded9dbb161a req-d9cb761f-6813-492f-b949-2f549c3b48c1 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:11.194152 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-df0b22ca-6efa-4ad9-b45b-eded9dbb161a req-d9cb761f-6813-492f-b949-2f549c3b48c1 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:11.194571 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-df0b22ca-6efa-4ad9-b45b-eded9dbb161a req-d9cb761f-6813-492f-b949-2f549c3b48c1 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:11.205877 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-df0b22ca-6efa-4ad9-b45b-eded9dbb161a req-d9cb761f-6813-492f-b949-2f549c3b48c1 service nova] Creating event network-vif-plugged:aba98a4b-afc5-4234-b2dc-bc6c19def4a5 for instance 690f9316-215d-43ed-bba4-1dab9ddf6720 on hv-cinder-82880 Aug 30 15:23:11.211007 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-df0b22ca-6efa-4ad9-b45b-eded9dbb161a req-d9cb761f-6813-492f-b949-2f549c3b48c1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166679 Aug 30 15:23:11.211851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1270/2533] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:23:11.625349 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2a3f99ab-3590-4b16-abe3-5d6d2cfaec2b tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:23:11.625956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2a3f99ab-3590-4b16-abe3-5d6d2cfaec2b tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:23:11.632330 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2a3f99ab-3590-4b16-abe3-5d6d2cfaec2b tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:11.632865 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2a3f99ab-3590-4b16-abe3-5d6d2cfaec2b tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:11.633299 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2a3f99ab-3590-4b16-abe3-5d6d2cfaec2b tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:11.634071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2a3f99ab-3590-4b16-abe3-5d6d2cfaec2b tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:11.634671 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2a3f99ab-3590-4b16-abe3-5d6d2cfaec2b tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:11.635092 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2a3f99ab-3590-4b16-abe3-5d6d2cfaec2b tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:11.763434 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2a3f99ab-3590-4b16-abe3-5d6d2cfaec2b tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:23:11.771044 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2a3f99ab-3590-4b16-abe3-5d6d2cfaec2b tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1264 microversion: 2.1 time: 0.149587 Aug 30 15:23:11.771652 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1264/2534] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:23:11 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:23:12.792646 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-022c0b2d-b9ab-4fbb-a364-e09754d54d4e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:23:12.793340 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-022c0b2d-b9ab-4fbb-a364-e09754d54d4e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:23:12.800419 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-022c0b2d-b9ab-4fbb-a364-e09754d54d4e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:12.800941 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-022c0b2d-b9ab-4fbb-a364-e09754d54d4e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:12.801381 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-022c0b2d-b9ab-4fbb-a364-e09754d54d4e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:12.802072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-022c0b2d-b9ab-4fbb-a364-e09754d54d4e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:12.802532 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-022c0b2d-b9ab-4fbb-a364-e09754d54d4e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:12.802957 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-022c0b2d-b9ab-4fbb-a364-e09754d54d4e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:12.940613 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-022c0b2d-b9ab-4fbb-a364-e09754d54d4e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:23:12.948999 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-022c0b2d-b9ab-4fbb-a364-e09754d54d4e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1451 microversion: 2.1 time: 0.161141 Aug 30 15:23:12.949567 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1271/2535] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:23:12 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:23:12.968555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-13e92ead-8701-4c30-9a33-08aeb941e6de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:23:12.969157 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-13e92ead-8701-4c30-9a33-08aeb941e6de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:23:12.975400 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13e92ead-8701-4c30-9a33-08aeb941e6de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:12.975875 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13e92ead-8701-4c30-9a33-08aeb941e6de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:12.976298 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13e92ead-8701-4c30-9a33-08aeb941e6de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:12.976968 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13e92ead-8701-4c30-9a33-08aeb941e6de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:12.977428 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13e92ead-8701-4c30-9a33-08aeb941e6de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:12.977952 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-13e92ead-8701-4c30-9a33-08aeb941e6de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:13.112294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-13e92ead-8701-4c30-9a33-08aeb941e6de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:23:13.120432 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-13e92ead-8701-4c30-9a33-08aeb941e6de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1451 microversion: 2.1 time: 0.155636 Aug 30 15:23:13.121001 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1265/2536] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:23:12 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:23:14.968657 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [req-0c4395c9-0ca6-4dc2-a3bf-854910708bfc req-109d29d5-d596-4a2f-ba87-c8e645e2b56d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "690f9316-215d-43ed-bba4-1dab9ddf6720", "tag": "aba98a4b-afc5-4234-b2dc-bc6c19def4a5"}]} {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:23:14.978401 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-0c4395c9-0ca6-4dc2-a3bf-854910708bfc req-109d29d5-d596-4a2f-ba87-c8e645e2b56d service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:23:14.978864 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-0c4395c9-0ca6-4dc2-a3bf-854910708bfc req-109d29d5-d596-4a2f-ba87-c8e645e2b56d service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:23:14.979309 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [req-0c4395c9-0ca6-4dc2-a3bf-854910708bfc req-109d29d5-d596-4a2f-ba87-c8e645e2b56d service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:23:14.989901 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.compute.server_external_events [req-0c4395c9-0ca6-4dc2-a3bf-854910708bfc req-109d29d5-d596-4a2f-ba87-c8e645e2b56d service nova] Creating event network-changed:aba98a4b-afc5-4234-b2dc-bc6c19def4a5 for instance 690f9316-215d-43ed-bba4-1dab9ddf6720 on hv-cinder-82880 Aug 30 15:23:14.995583 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [req-0c4395c9-0ca6-4dc2-a3bf-854910708bfc req-109d29d5-d596-4a2f-ba87-c8e645e2b56d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087322 Aug 30 15:23:14.996333 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1272/2537] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:24:52.912599 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:24:52.913340 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:24:52.915388 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 15:24:52.915669 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Tue Aug 30 15:24:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Aug 30 15:24:52.922706 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-905202090", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-634593545", "security_groups": [{"name": "tempest-secgroup-smoke-60335079"}], "block_device_mapping_v2": [{"uuid": "7a1058f9-68e9-4ba7-a65a-fd5099b44435", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "21a6900e-24a0-4216-bee4-bd763a4ab351"}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:24:53.188580 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] validate_networks() for [('21a6900e-24a0-4216-bee4-bd763a4ab351', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 15:24:53.564723 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 15:24:53.565141 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 15:24:53.565611 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 15:24:53.566015 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 15:24:53.566424 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 15:24:53.575421 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:24:53.576499 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:24:53.576930 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:24:53.577642 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:24:53.578090 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:24:53.578506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:24:53.594849 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Getting quotas for project b45f3223ea9541f38831d425cb35dbb3. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:24:53.599083 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Getting quotas for user 2dc2d1a5bde44defae89c15d60172d4b and project b45f3223ea9541f38831d425cb35dbb3. Resources: {'ram', 'cores', 'instances'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:24:53.655159 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 15:24:53.657263 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7a1058f9-68e9-4ba7-a65a-fd5099b44435',volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 15:24:53.789538 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1e1db734-8bf9-41ba-8b78-506d01388659 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.878683 Aug 30 15:24:53.790188 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1266/2538] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 30 15:24:52 2022] POST /compute/v2.1/servers => generated 404 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 15:24:53.799997 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=26 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:24:53.800744 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=54 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:24:53.801850 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:24:53.801976 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:24:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 (ip 10.222.0.30) !!! Aug 30 15:24:53.806739 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0ef47cfc-bd5d-46c5-a99b-a560577b2b55 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:24:53.807718 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0ef47cfc-bd5d-46c5-a99b-a560577b2b55 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:24:53.864668 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0ef47cfc-bd5d-46c5-a99b-a560577b2b55 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:24:53.871549 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0ef47cfc-bd5d-46c5-a99b-a560577b2b55 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1093 microversion: 2.1 time: 0.073595 Aug 30 15:24:53.872107 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1273/2539] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:24:53 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:24:54.892764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-19f23a5c-5063-4ae3-bb6d-76decb291501 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:24:54.893393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-19f23a5c-5063-4ae3-bb6d-76decb291501 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:24:54.900239 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19f23a5c-5063-4ae3-bb6d-76decb291501 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:24:54.900725 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19f23a5c-5063-4ae3-bb6d-76decb291501 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:24:54.901181 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19f23a5c-5063-4ae3-bb6d-76decb291501 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:24:54.901886 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19f23a5c-5063-4ae3-bb6d-76decb291501 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:24:54.902362 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19f23a5c-5063-4ae3-bb6d-76decb291501 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:24:54.902800 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-19f23a5c-5063-4ae3-bb6d-76decb291501 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:24:54.965207 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-19f23a5c-5063-4ae3-bb6d-76decb291501 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:24:54.974758 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-19f23a5c-5063-4ae3-bb6d-76decb291501 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1199 microversion: 2.1 time: 0.086411 Aug 30 15:24:54.975591 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1267/2540] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:24:54 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1199 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:24:55.996241 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-d82401c3-21da-419d-9c9a-467fcbd3952a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:24:55.996960 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-d82401c3-21da-419d-9c9a-467fcbd3952a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:24:56.004696 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d82401c3-21da-419d-9c9a-467fcbd3952a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:24:56.005492 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d82401c3-21da-419d-9c9a-467fcbd3952a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:24:56.006022 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d82401c3-21da-419d-9c9a-467fcbd3952a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:24:56.006792 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d82401c3-21da-419d-9c9a-467fcbd3952a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:24:56.007350 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d82401c3-21da-419d-9c9a-467fcbd3952a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:24:56.007842 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-d82401c3-21da-419d-9c9a-467fcbd3952a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:24:56.253151 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-d82401c3-21da-419d-9c9a-467fcbd3952a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:24:56.260686 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-d82401c3-21da-419d-9c9a-467fcbd3952a tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1263 microversion: 2.1 time: 0.268440 Aug 30 15:24:56.261263 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1274/2541] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:24:55 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1263 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:24:56.440759 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-12646d07-95e9-4874-850b-0e5ba475610d req-d2eefb87-9596-4349-a81b-24829bfe0476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb194411-8e31-4cfc-a88c-65d3cf272a40", "tag": "45724e03-028f-4ba4-b0d8-14a7edac8f50"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:24:56.451239 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-12646d07-95e9-4874-850b-0e5ba475610d req-d2eefb87-9596-4349-a81b-24829bfe0476 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:24:56.451715 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-12646d07-95e9-4874-850b-0e5ba475610d req-d2eefb87-9596-4349-a81b-24829bfe0476 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:24:56.452149 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-12646d07-95e9-4874-850b-0e5ba475610d req-d2eefb87-9596-4349-a81b-24829bfe0476 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:24:56.463100 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-12646d07-95e9-4874-850b-0e5ba475610d req-d2eefb87-9596-4349-a81b-24829bfe0476 service nova] Creating event network-changed:45724e03-028f-4ba4-b0d8-14a7edac8f50 for instance bb194411-8e31-4cfc-a88c-65d3cf272a40 on hv-cinder-82880 Aug 30 15:24:56.468152 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-12646d07-95e9-4874-850b-0e5ba475610d req-d2eefb87-9596-4349-a81b-24829bfe0476 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094539 Aug 30 15:24:56.468746 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1268/2542] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:24:57.282743 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-26b51f46-d03d-4edc-891e-ad1a2a4a54ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:24:57.283392 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-26b51f46-d03d-4edc-891e-ad1a2a4a54ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:24:57.290084 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-26b51f46-d03d-4edc-891e-ad1a2a4a54ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:24:57.290576 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-26b51f46-d03d-4edc-891e-ad1a2a4a54ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:24:57.291013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-26b51f46-d03d-4edc-891e-ad1a2a4a54ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:24:57.291808 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-26b51f46-d03d-4edc-891e-ad1a2a4a54ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:24:57.292199 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-26b51f46-d03d-4edc-891e-ad1a2a4a54ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:24:57.292629 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-26b51f46-d03d-4edc-891e-ad1a2a4a54ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:24:57.635112 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-26b51f46-d03d-4edc-891e-ad1a2a4a54ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:24:57.643591 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-26b51f46-d03d-4edc-891e-ad1a2a4a54ac tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1263 microversion: 2.1 time: 0.365228 Aug 30 15:24:57.644173 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1275/2543] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:24:57 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1263 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:24:58.666287 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0a24f8c5-a5e9-4365-ae89-89d2a8853ff5 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:24:58.666977 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0a24f8c5-a5e9-4365-ae89-89d2a8853ff5 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:24:58.673694 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a24f8c5-a5e9-4365-ae89-89d2a8853ff5 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:24:58.674168 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a24f8c5-a5e9-4365-ae89-89d2a8853ff5 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:24:58.674597 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a24f8c5-a5e9-4365-ae89-89d2a8853ff5 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:24:58.675290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a24f8c5-a5e9-4365-ae89-89d2a8853ff5 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:24:58.675739 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a24f8c5-a5e9-4365-ae89-89d2a8853ff5 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:24:58.676155 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a24f8c5-a5e9-4365-ae89-89d2a8853ff5 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:24:58.805096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0a24f8c5-a5e9-4365-ae89-89d2a8853ff5 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:24:58.812737 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0a24f8c5-a5e9-4365-ae89-89d2a8853ff5 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1263 microversion: 2.1 time: 0.151183 Aug 30 15:24:58.813307 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1269/2544] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:24:58 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:24:59.833530 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-80c60423-e042-433f-a817-84e3b7c1ae0f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:24:59.834143 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-80c60423-e042-433f-a817-84e3b7c1ae0f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:24:59.840533 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-80c60423-e042-433f-a817-84e3b7c1ae0f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:24:59.841019 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-80c60423-e042-433f-a817-84e3b7c1ae0f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:24:59.841610 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-80c60423-e042-433f-a817-84e3b7c1ae0f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:24:59.842373 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-80c60423-e042-433f-a817-84e3b7c1ae0f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:24:59.842827 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-80c60423-e042-433f-a817-84e3b7c1ae0f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:24:59.843273 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-80c60423-e042-433f-a817-84e3b7c1ae0f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:24:59.977983 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-80c60423-e042-433f-a817-84e3b7c1ae0f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:24:59.986267 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-80c60423-e042-433f-a817-84e3b7c1ae0f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1263 microversion: 2.1 time: 0.156564 Aug 30 15:24:59.986834 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1276/2545] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:24:59 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:25:01.007180 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d30a3406-284b-41ca-ad2a-a0959655eb10 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:25:01.007820 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d30a3406-284b-41ca-ad2a-a0959655eb10 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:25:01.014920 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d30a3406-284b-41ca-ad2a-a0959655eb10 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:01.015445 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d30a3406-284b-41ca-ad2a-a0959655eb10 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:01.015885 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d30a3406-284b-41ca-ad2a-a0959655eb10 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:01.016568 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d30a3406-284b-41ca-ad2a-a0959655eb10 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:01.017016 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d30a3406-284b-41ca-ad2a-a0959655eb10 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:01.017438 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d30a3406-284b-41ca-ad2a-a0959655eb10 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:01.148577 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d30a3406-284b-41ca-ad2a-a0959655eb10 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:25:01.156327 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d30a3406-284b-41ca-ad2a-a0959655eb10 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1263 microversion: 2.1 time: 0.153004 Aug 30 15:25:01.156896 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1270/2546] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:25:01 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:25:02.176773 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-bff56249-adf6-43b8-aa50-3b56e6b8ec60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:25:02.177387 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-bff56249-adf6-43b8-aa50-3b56e6b8ec60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:25:02.183856 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bff56249-adf6-43b8-aa50-3b56e6b8ec60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:02.184336 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bff56249-adf6-43b8-aa50-3b56e6b8ec60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:02.184851 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bff56249-adf6-43b8-aa50-3b56e6b8ec60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:02.185723 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bff56249-adf6-43b8-aa50-3b56e6b8ec60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:02.186178 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bff56249-adf6-43b8-aa50-3b56e6b8ec60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:02.186599 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-bff56249-adf6-43b8-aa50-3b56e6b8ec60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:02.313059 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-bff56249-adf6-43b8-aa50-3b56e6b8ec60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:25:02.320663 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-bff56249-adf6-43b8-aa50-3b56e6b8ec60 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1263 microversion: 2.1 time: 0.147758 Aug 30 15:25:02.321225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1277/2547] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:25:02 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:25:03.342837 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-21384d5e-7e22-4b76-bcb1-7efd4a59c5cf tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:25:03.343399 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-21384d5e-7e22-4b76-bcb1-7efd4a59c5cf tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:25:03.349717 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21384d5e-7e22-4b76-bcb1-7efd4a59c5cf tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:03.350190 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21384d5e-7e22-4b76-bcb1-7efd4a59c5cf tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:03.350615 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21384d5e-7e22-4b76-bcb1-7efd4a59c5cf tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:03.351319 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21384d5e-7e22-4b76-bcb1-7efd4a59c5cf tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:03.351765 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21384d5e-7e22-4b76-bcb1-7efd4a59c5cf tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:03.352207 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21384d5e-7e22-4b76-bcb1-7efd4a59c5cf tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:03.479957 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-21384d5e-7e22-4b76-bcb1-7efd4a59c5cf tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:25:03.488433 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-21384d5e-7e22-4b76-bcb1-7efd4a59c5cf tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1263 microversion: 2.1 time: 0.150422 Aug 30 15:25:03.488997 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1271/2548] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:25:03 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:25:04.509396 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-baaca062-634d-4aba-b034-7540603aee36 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:25:04.510072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-baaca062-634d-4aba-b034-7540603aee36 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:25:04.512480 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell0:SELECT=2 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:25:04.518524 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baaca062-634d-4aba-b034-7540603aee36 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:04.519002 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baaca062-634d-4aba-b034-7540603aee36 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:04.519463 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baaca062-634d-4aba-b034-7540603aee36 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:04.520145 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baaca062-634d-4aba-b034-7540603aee36 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:04.520588 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baaca062-634d-4aba-b034-7540603aee36 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:04.521002 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-baaca062-634d-4aba-b034-7540603aee36 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:04.748241 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-baaca062-634d-4aba-b034-7540603aee36 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:25:04.760487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-baaca062-634d-4aba-b034-7540603aee36 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1263 microversion: 2.1 time: 0.250750 Aug 30 15:25:04.774545 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1278/2549] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:25:04 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1263 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:25:05.776947 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c69b3bbd-e45c-4edc-bb4a-1e67d14a7c75 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:25:05.777555 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c69b3bbd-e45c-4edc-bb4a-1e67d14a7c75 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:25:05.780047 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:25:05.780700 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:25:05.787138 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c69b3bbd-e45c-4edc-bb4a-1e67d14a7c75 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:05.787650 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c69b3bbd-e45c-4edc-bb4a-1e67d14a7c75 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:05.788081 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c69b3bbd-e45c-4edc-bb4a-1e67d14a7c75 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:05.788765 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c69b3bbd-e45c-4edc-bb4a-1e67d14a7c75 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:05.789214 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c69b3bbd-e45c-4edc-bb4a-1e67d14a7c75 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:05.789664 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c69b3bbd-e45c-4edc-bb4a-1e67d14a7c75 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:05.919987 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c69b3bbd-e45c-4edc-bb4a-1e67d14a7c75 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:25:05.927833 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c69b3bbd-e45c-4edc-bb4a-1e67d14a7c75 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1263 microversion: 2.1 time: 0.154711 Aug 30 15:25:05.928402 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1272/2550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:25:05 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:25:06.948305 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-71471ec9-b6ac-499c-9935-4bfb4fe5b113 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:25:06.948918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-71471ec9-b6ac-499c-9935-4bfb4fe5b113 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:25:06.956427 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-71471ec9-b6ac-499c-9935-4bfb4fe5b113 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:06.956914 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-71471ec9-b6ac-499c-9935-4bfb4fe5b113 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:06.957352 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-71471ec9-b6ac-499c-9935-4bfb4fe5b113 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:06.958045 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-71471ec9-b6ac-499c-9935-4bfb4fe5b113 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:06.958528 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-71471ec9-b6ac-499c-9935-4bfb4fe5b113 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:06.958956 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-71471ec9-b6ac-499c-9935-4bfb4fe5b113 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:07.085572 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-71471ec9-b6ac-499c-9935-4bfb4fe5b113 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:25:07.093399 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-71471ec9-b6ac-499c-9935-4bfb4fe5b113 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1263 microversion: 2.1 time: 0.148926 Aug 30 15:25:07.093978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1279/2551] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:25:06 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:25:07.489826 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-1cb2ffbf-d14d-4b50-89fc-3ff1fbd70b52 req-78e04a30-8ea6-4d6f-910b-4f0fb68cfe6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb194411-8e31-4cfc-a88c-65d3cf272a40", "name": "network-vif-plugged", "status": "completed", "tag": "45724e03-028f-4ba4-b0d8-14a7edac8f50"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:25:07.499865 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-1cb2ffbf-d14d-4b50-89fc-3ff1fbd70b52 req-78e04a30-8ea6-4d6f-910b-4f0fb68cfe6f service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:07.500348 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-1cb2ffbf-d14d-4b50-89fc-3ff1fbd70b52 req-78e04a30-8ea6-4d6f-910b-4f0fb68cfe6f service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:07.500781 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-1cb2ffbf-d14d-4b50-89fc-3ff1fbd70b52 req-78e04a30-8ea6-4d6f-910b-4f0fb68cfe6f service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:07.514862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-1cb2ffbf-d14d-4b50-89fc-3ff1fbd70b52 req-78e04a30-8ea6-4d6f-910b-4f0fb68cfe6f service nova] Creating event network-vif-plugged:45724e03-028f-4ba4-b0d8-14a7edac8f50 for instance bb194411-8e31-4cfc-a88c-65d3cf272a40 on hv-cinder-82880 Aug 30 15:25:07.519845 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-1cb2ffbf-d14d-4b50-89fc-3ff1fbd70b52 req-78e04a30-8ea6-4d6f-910b-4f0fb68cfe6f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033577 Aug 30 15:25:07.520638 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1273/2552] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:25:08.113965 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-606907cb-897c-42b9-820d-534d3b6240a3 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:25:08.114578 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-606907cb-897c-42b9-820d-534d3b6240a3 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:25:08.120943 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-606907cb-897c-42b9-820d-534d3b6240a3 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:08.121428 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-606907cb-897c-42b9-820d-534d3b6240a3 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:08.121862 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-606907cb-897c-42b9-820d-534d3b6240a3 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:08.122890 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-606907cb-897c-42b9-820d-534d3b6240a3 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:08.123374 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-606907cb-897c-42b9-820d-534d3b6240a3 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:08.123799 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-606907cb-897c-42b9-820d-534d3b6240a3 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:08.254185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-606907cb-897c-42b9-820d-534d3b6240a3 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:25:08.261978 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-606907cb-897c-42b9-820d-534d3b6240a3 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1263 microversion: 2.1 time: 0.151869 Aug 30 15:25:08.263072 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1280/2553] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:25:08 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:25:09.284601 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fe13055d-4d38-4447-82a9-637cdd9bd78e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:25:09.285294 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fe13055d-4d38-4447-82a9-637cdd9bd78e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:25:09.291346 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe13055d-4d38-4447-82a9-637cdd9bd78e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:09.291821 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe13055d-4d38-4447-82a9-637cdd9bd78e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:09.292251 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe13055d-4d38-4447-82a9-637cdd9bd78e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:09.292924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe13055d-4d38-4447-82a9-637cdd9bd78e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:09.293369 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe13055d-4d38-4447-82a9-637cdd9bd78e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:09.293808 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fe13055d-4d38-4447-82a9-637cdd9bd78e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:09.426009 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fe13055d-4d38-4447-82a9-637cdd9bd78e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:25:09.433553 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fe13055d-4d38-4447-82a9-637cdd9bd78e tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1449 microversion: 2.1 time: 0.153604 Aug 30 15:25:09.434116 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1274/2554] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:25:09 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:25:09.453413 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-67c2a0a9-e4a3-4efc-81e9-fc9152ce6716 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:25:09.454024 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-67c2a0a9-e4a3-4efc-81e9-fc9152ce6716 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:25:09.460388 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-67c2a0a9-e4a3-4efc-81e9-fc9152ce6716 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:09.460809 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-67c2a0a9-e4a3-4efc-81e9-fc9152ce6716 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:09.461239 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-67c2a0a9-e4a3-4efc-81e9-fc9152ce6716 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:09.461917 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-67c2a0a9-e4a3-4efc-81e9-fc9152ce6716 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:09.462367 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-67c2a0a9-e4a3-4efc-81e9-fc9152ce6716 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:09.462789 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-67c2a0a9-e4a3-4efc-81e9-fc9152ce6716 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:09.594278 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-67c2a0a9-e4a3-4efc-81e9-fc9152ce6716 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:25:09.601919 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-67c2a0a9-e4a3-4efc-81e9-fc9152ce6716 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1449 microversion: 2.1 time: 0.152606 Aug 30 15:25:09.602487 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1281/2555] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:25:09 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1449 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:25:11.157054 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-0ea0d6c0-c8c2-4940-a454-b6df4e748e8f req-a3f7ba3c-adaa-43ed-9020-b7af2309757b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb194411-8e31-4cfc-a88c-65d3cf272a40", "tag": "45724e03-028f-4ba4-b0d8-14a7edac8f50"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:25:11.166816 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-0ea0d6c0-c8c2-4940-a454-b6df4e748e8f req-a3f7ba3c-adaa-43ed-9020-b7af2309757b service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:25:11.167334 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-0ea0d6c0-c8c2-4940-a454-b6df4e748e8f req-a3f7ba3c-adaa-43ed-9020-b7af2309757b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:25:11.167793 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-0ea0d6c0-c8c2-4940-a454-b6df4e748e8f req-a3f7ba3c-adaa-43ed-9020-b7af2309757b service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:25:11.179193 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-0ea0d6c0-c8c2-4940-a454-b6df4e748e8f req-a3f7ba3c-adaa-43ed-9020-b7af2309757b service nova] Creating event network-changed:45724e03-028f-4ba4-b0d8-14a7edac8f50 for instance bb194411-8e31-4cfc-a88c-65d3cf272a40 on hv-cinder-82880 Aug 30 15:25:11.184131 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-0ea0d6c0-c8c2-4940-a454-b6df4e748e8f req-a3f7ba3c-adaa-43ed-9020-b7af2309757b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031380 Aug 30 15:25:11.185273 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1275/2556] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:26:39.203395 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_api:SELECT=20 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:26:39.204234 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG dbcounter [-] [127089] Writing DB stats nova_cell1:SELECT=48 {{(pid=127089) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:26:39.205107 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:26:39.205379 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:26:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 (ip 10.222.0.30) !!! Aug 30 15:26:39.207492 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 15:26:39.207849 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Tue Aug 30 15:26:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 (ip 10.222.0.30) !!! Aug 30 15:26:39.212055 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:26:39.212959 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=44 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:26:39.219254 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-288f5a59-9963-4b13-97f3-e61995d28503 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:26:39.220390 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-a165aea5-8c7d-45b5-bf60-0a302a105476 req-d24d137e-deee-46cd-b87d-e41759cca49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb194411-8e31-4cfc-a88c-65d3cf272a40", "tag": "45724e03-028f-4ba4-b0d8-14a7edac8f50"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:26:39.221036 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-288f5a59-9963-4b13-97f3-e61995d28503 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:26:39.233437 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a165aea5-8c7d-45b5-bf60-0a302a105476 req-d24d137e-deee-46cd-b87d-e41759cca49a service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:39.233924 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a165aea5-8c7d-45b5-bf60-0a302a105476 req-d24d137e-deee-46cd-b87d-e41759cca49a service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:39.234394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-a165aea5-8c7d-45b5-bf60-0a302a105476 req-d24d137e-deee-46cd-b87d-e41759cca49a service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:39.238192 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-288f5a59-9963-4b13-97f3-e61995d28503 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:39.238936 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-288f5a59-9963-4b13-97f3-e61995d28503 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:39.239953 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-288f5a59-9963-4b13-97f3-e61995d28503 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:39.240963 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-288f5a59-9963-4b13-97f3-e61995d28503 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:39.241650 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-288f5a59-9963-4b13-97f3-e61995d28503 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:39.242310 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-288f5a59-9963-4b13-97f3-e61995d28503 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:39.248033 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-a165aea5-8c7d-45b5-bf60-0a302a105476 req-d24d137e-deee-46cd-b87d-e41759cca49a service nova] Creating event network-changed:45724e03-028f-4ba4-b0d8-14a7edac8f50 for instance bb194411-8e31-4cfc-a88c-65d3cf272a40 on hv-cinder-82880 Aug 30 15:26:39.255762 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-a165aea5-8c7d-45b5-bf60-0a302a105476 req-d24d137e-deee-46cd-b87d-e41759cca49a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050537 Aug 30 15:26:39.256733 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1276/2557] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:26:39.273156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-288f5a59-9963-4b13-97f3-e61995d28503 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Going to try to terminate instance {{(pid=127089) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 15:26:39.359414 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-288f5a59-9963-4b13-97f3-e61995d28503 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "DELETE /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 204 len: 0 microversion: 2.1 time: 0.157243 Aug 30 15:26:39.360564 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1282/2558] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:26:39 2022] DELETE /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 15:26:39.372727 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-afeb0c7c-7fd0-4bfb-b068-1fdef6c9fd22 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:26:39.373432 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-afeb0c7c-7fd0-4bfb-b068-1fdef6c9fd22 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:26:39.380227 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afeb0c7c-7fd0-4bfb-b068-1fdef6c9fd22 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:39.381176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afeb0c7c-7fd0-4bfb-b068-1fdef6c9fd22 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:39.381176 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afeb0c7c-7fd0-4bfb-b068-1fdef6c9fd22 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:39.381819 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afeb0c7c-7fd0-4bfb-b068-1fdef6c9fd22 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:39.382268 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afeb0c7c-7fd0-4bfb-b068-1fdef6c9fd22 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:39.382714 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afeb0c7c-7fd0-4bfb-b068-1fdef6c9fd22 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:39.521119 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-afeb0c7c-7fd0-4bfb-b068-1fdef6c9fd22 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:26:39.529066 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-afeb0c7c-7fd0-4bfb-b068-1fdef6c9fd22 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1574 microversion: 2.1 time: 0.162780 Aug 30 15:26:39.529631 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1277/2559] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:26:39 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:26:40.552509 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-77a38786-ef7c-4ab6-addb-bbe8905d0747 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:26:40.553216 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-77a38786-ef7c-4ab6-addb-bbe8905d0747 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:26:40.559655 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77a38786-ef7c-4ab6-addb-bbe8905d0747 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:40.560156 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77a38786-ef7c-4ab6-addb-bbe8905d0747 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:40.560590 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77a38786-ef7c-4ab6-addb-bbe8905d0747 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:40.561313 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77a38786-ef7c-4ab6-addb-bbe8905d0747 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:40.561767 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77a38786-ef7c-4ab6-addb-bbe8905d0747 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:40.562193 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-77a38786-ef7c-4ab6-addb-bbe8905d0747 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:40.694674 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-77a38786-ef7c-4ab6-addb-bbe8905d0747 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:26:40.702517 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-77a38786-ef7c-4ab6-addb-bbe8905d0747 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1574 microversion: 2.1 time: 0.154969 Aug 30 15:26:40.703063 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1283/2560] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:26:40 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:26:41.610124 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-6cf21ee2-63af-4828-85de-e0f7716387b7 req-9e273f71-886a-45e4-a7ce-53f7c169a233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb194411-8e31-4cfc-a88c-65d3cf272a40", "name": "network-vif-deleted", "tag": "45724e03-028f-4ba4-b0d8-14a7edac8f50"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:26:41.620618 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-6cf21ee2-63af-4828-85de-e0f7716387b7 req-9e273f71-886a-45e4-a7ce-53f7c169a233 service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:41.621096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-6cf21ee2-63af-4828-85de-e0f7716387b7 req-9e273f71-886a-45e4-a7ce-53f7c169a233 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:41.621525 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-6cf21ee2-63af-4828-85de-e0f7716387b7 req-9e273f71-886a-45e4-a7ce-53f7c169a233 service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:41.632894 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-6cf21ee2-63af-4828-85de-e0f7716387b7 req-9e273f71-886a-45e4-a7ce-53f7c169a233 service nova] Creating event network-vif-deleted:45724e03-028f-4ba4-b0d8-14a7edac8f50 for instance bb194411-8e31-4cfc-a88c-65d3cf272a40 on hv-cinder-82880 Aug 30 15:26:41.638372 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-6cf21ee2-63af-4828-85de-e0f7716387b7 req-9e273f71-886a-45e4-a7ce-53f7c169a233 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031817 Aug 30 15:26:41.639267 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1278/2561] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:26:41.724579 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-88b16bba-1c6a-4988-b717-4f216916ab76 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:26:41.725195 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-88b16bba-1c6a-4988-b717-4f216916ab76 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:26:41.733231 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-88b16bba-1c6a-4988-b717-4f216916ab76 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:41.733720 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-88b16bba-1c6a-4988-b717-4f216916ab76 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:41.734150 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-88b16bba-1c6a-4988-b717-4f216916ab76 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:41.734843 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-88b16bba-1c6a-4988-b717-4f216916ab76 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:41.735311 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-88b16bba-1c6a-4988-b717-4f216916ab76 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:41.735731 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-88b16bba-1c6a-4988-b717-4f216916ab76 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:41.801526 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-88b16bba-1c6a-4988-b717-4f216916ab76 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:26:41.809371 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-88b16bba-1c6a-4988-b717-4f216916ab76 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 200 len: 1224 microversion: 2.1 time: 0.089283 Aug 30 15:26:41.809942 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1284/2562] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:26:41 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:26:42.831179 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0e504fc1-aa01-4495-b336-6396876af999 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:26:42.831900 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0e504fc1-aa01-4495-b336-6396876af999 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: bb194411-8e31-4cfc-a88c-65d3cf272a40] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:26:42.838071 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e504fc1-aa01-4495-b336-6396876af999 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:42.838548 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e504fc1-aa01-4495-b336-6396876af999 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:42.838988 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e504fc1-aa01-4495-b336-6396876af999 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:42.839667 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e504fc1-aa01-4495-b336-6396876af999 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:42.840128 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e504fc1-aa01-4495-b336-6396876af999 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:42.840529 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e504fc1-aa01-4495-b336-6396876af999 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:42.853862 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-0e504fc1-aa01-4495-b336-6396876af999 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] HTTP exception thrown: Instance bb194411-8e31-4cfc-a88c-65d3cf272a40 could not be found. Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0e504fc1-aa01-4495-b336-6396876af999 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Request method failure captured: Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 HTTP/1.1 Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDiq03meZf34EHcP8TrH6VfJwFm7gmVw5fIgWF-6cgrpeS3kkwHvB1kq8NjLHYj4rTo31UGBtCs79SJcMCkmKoXEwaAL_cQDGEMkCfc6Kp_Ck-2vsnKuYrdAjWj2I8AyktRmffEIjTLERaafE1yssUPwtE857epffVEoPxGKmLki1rbU Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: b45f3223ea9541f38831d425cb35dbb3 Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-TestVolumeBootPattern-590827916 Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:26:42.855476 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:26:42.856866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b45f3223ea9541f38831d425cb35dbb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b45f3223ea9541f38831d425cb35dbb3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b45f3223ea9541f38831d425cb35dbb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b45f3223ea9541f38831d425cb35dbb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:26:42.856866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-TestVolumeBootPattern-590827916 Aug 30 15:26:42.856866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: b45f3223ea9541f38831d425cb35dbb3 Aug 30 15:26:42.856866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-TestVolumeBootPattern-590827916 Aug 30 15:26:42.856866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-TestVolumeBootPattern-590827916-project Aug 30 15:26:42.856866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:26:42.856866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:26:42.856866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: 2dc2d1a5bde44defae89c15d60172d4b Aug 30 15:26:42.856866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-TestVolumeBootPattern-590827916-project Aug 30 15:26:42.856866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:26:42.856866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance bb194411-8e31-4cfc-a88c-65d3cf272a40 could not be found. Aug 30 15:26:42.856866 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': 'bb194411-8e31-4cfc-a88c-65d3cf272a40'} Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb194411-8e31-4cfc-a88c-65d3cf272a40 could not be found. Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:26:42.857663 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb194411-8e31-4cfc-a88c-65d3cf272a40 could not be found. Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb194411-8e31-4cfc-a88c-65d3cf272a40 could not be found. Aug 30 15:26:42.858880 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:26:42.859895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0e504fc1-aa01-4495-b336-6396876af999 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Returning 404 to user: Instance bb194411-8e31-4cfc-a88c-65d3cf272a40 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:26:42.859895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0e504fc1-aa01-4495-b336-6396876af999 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40" status: 404 len: 111 microversion: 2.1 time: 0.030284 Aug 30 15:26:42.859895 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1279/2563] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:26:42 2022] GET /compute/v2.1/servers/bb194411-8e31-4cfc-a88c-65d3cf272a40 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:26:45.904602 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-36e7612a-75e2-4a2f-9b64-790ed2b44ea0 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:26:45.905221 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-36e7612a-75e2-4a2f-9b64-790ed2b44ea0 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:26:45.906266 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-45ab752e-bf6b-4f62-8fff-4d4839c85b72 req-9fbe15de-7b21-4b04-8ac9-c1e22cd346ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "690f9316-215d-43ed-bba4-1dab9ddf6720", "tag": "aba98a4b-afc5-4234-b2dc-bc6c19def4a5"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:26:45.912622 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36e7612a-75e2-4a2f-9b64-790ed2b44ea0 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:45.913346 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36e7612a-75e2-4a2f-9b64-790ed2b44ea0 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:45.913878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36e7612a-75e2-4a2f-9b64-790ed2b44ea0 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:45.914814 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36e7612a-75e2-4a2f-9b64-790ed2b44ea0 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:45.915397 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36e7612a-75e2-4a2f-9b64-790ed2b44ea0 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:45.915933 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-36e7612a-75e2-4a2f-9b64-790ed2b44ea0 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:45.916937 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-45ab752e-bf6b-4f62-8fff-4d4839c85b72 req-9fbe15de-7b21-4b04-8ac9-c1e22cd346ed service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:45.917587 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-45ab752e-bf6b-4f62-8fff-4d4839c85b72 req-9fbe15de-7b21-4b04-8ac9-c1e22cd346ed service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:45.918238 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-45ab752e-bf6b-4f62-8fff-4d4839c85b72 req-9fbe15de-7b21-4b04-8ac9-c1e22cd346ed service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:45.931355 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-45ab752e-bf6b-4f62-8fff-4d4839c85b72 req-9fbe15de-7b21-4b04-8ac9-c1e22cd346ed service nova] Creating event network-changed:aba98a4b-afc5-4234-b2dc-bc6c19def4a5 for instance 690f9316-215d-43ed-bba4-1dab9ddf6720 on hv-cinder-82880 Aug 30 15:26:45.937096 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-45ab752e-bf6b-4f62-8fff-4d4839c85b72 req-9fbe15de-7b21-4b04-8ac9-c1e22cd346ed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034388 Aug 30 15:26:45.939797 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1280/2564] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 15:26:45.945677 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-36e7612a-75e2-4a2f-9b64-790ed2b44ea0 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Going to try to terminate instance {{(pid=127089) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 15:26:46.026695 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-36e7612a-75e2-4a2f-9b64-790ed2b44ea0 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "DELETE /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 204 len: 0 microversion: 2.1 time: 0.125708 Aug 30 15:26:46.027574 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1285/2565] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:26:45 2022] DELETE /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 15:26:46.037764 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a994ad2a-403c-402b-8958-542e3f2fd4e9 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:26:46.038478 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a994ad2a-403c-402b-8958-542e3f2fd4e9 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:26:46.044680 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a994ad2a-403c-402b-8958-542e3f2fd4e9 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:46.045167 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a994ad2a-403c-402b-8958-542e3f2fd4e9 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:46.045704 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a994ad2a-403c-402b-8958-542e3f2fd4e9 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:46.046290 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a994ad2a-403c-402b-8958-542e3f2fd4e9 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:46.046765 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a994ad2a-403c-402b-8958-542e3f2fd4e9 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:46.047403 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a994ad2a-403c-402b-8958-542e3f2fd4e9 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:46.182500 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a994ad2a-403c-402b-8958-542e3f2fd4e9 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:26:46.190137 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a994ad2a-403c-402b-8958-542e3f2fd4e9 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1575 microversion: 2.1 time: 0.157713 Aug 30 15:26:46.190777 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1281/2566] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:26:46 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:26:47.212918 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-fb50af9b-e59b-4662-a1a4-6a130fe6901d tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:26:47.213633 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-fb50af9b-e59b-4662-a1a4-6a130fe6901d tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:26:47.220180 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb50af9b-e59b-4662-a1a4-6a130fe6901d tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:47.220673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb50af9b-e59b-4662-a1a4-6a130fe6901d tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:47.221110 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb50af9b-e59b-4662-a1a4-6a130fe6901d tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:47.221812 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb50af9b-e59b-4662-a1a4-6a130fe6901d tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:47.222268 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb50af9b-e59b-4662-a1a4-6a130fe6901d tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:47.222693 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-fb50af9b-e59b-4662-a1a4-6a130fe6901d tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:47.351662 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-fb50af9b-e59b-4662-a1a4-6a130fe6901d tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:26:47.359296 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-fb50af9b-e59b-4662-a1a4-6a130fe6901d tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1575 microversion: 2.1 time: 0.151014 Aug 30 15:26:47.359861 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1286/2567] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:26:47 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:26:48.171305 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-08b90a92-95bb-4901-94b6-b5e9dbb2bc4b req-be22c565-f25d-4b82-bf22-b9f8bdad51fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "690f9316-215d-43ed-bba4-1dab9ddf6720", "name": "network-vif-deleted", "tag": "aba98a4b-afc5-4234-b2dc-bc6c19def4a5"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:26:48.182021 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-08b90a92-95bb-4901-94b6-b5e9dbb2bc4b req-be22c565-f25d-4b82-bf22-b9f8bdad51fa service nova] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:48.182492 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-08b90a92-95bb-4901-94b6-b5e9dbb2bc4b req-be22c565-f25d-4b82-bf22-b9f8bdad51fa service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:48.182939 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-08b90a92-95bb-4901-94b6-b5e9dbb2bc4b req-be22c565-f25d-4b82-bf22-b9f8bdad51fa service nova] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:48.196058 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-08b90a92-95bb-4901-94b6-b5e9dbb2bc4b req-be22c565-f25d-4b82-bf22-b9f8bdad51fa service nova] Creating event network-vif-deleted:aba98a4b-afc5-4234-b2dc-bc6c19def4a5 for instance 690f9316-215d-43ed-bba4-1dab9ddf6720 on hv-cinder-82880 Aug 30 15:26:48.201228 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-08b90a92-95bb-4901-94b6-b5e9dbb2bc4b req-be22c565-f25d-4b82-bf22-b9f8bdad51fa service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033656 Aug 30 15:26:48.201838 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1282/2568] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 30 15:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:26:48.380225 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-0f8953d5-9700-4718-b06b-8713823f13de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:26:48.380878 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-0f8953d5-9700-4718-b06b-8713823f13de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:26:48.387283 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f8953d5-9700-4718-b06b-8713823f13de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:48.387770 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f8953d5-9700-4718-b06b-8713823f13de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:48.388207 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f8953d5-9700-4718-b06b-8713823f13de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:48.388902 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f8953d5-9700-4718-b06b-8713823f13de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:48.389357 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f8953d5-9700-4718-b06b-8713823f13de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:48.389810 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-0f8953d5-9700-4718-b06b-8713823f13de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:48.458975 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.policy [None req-0f8953d5-9700-4718-b06b-8713823f13de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc2d1a5bde44defae89c15d60172d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45f3223ea9541f38831d425cb35dbb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127089) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:26:48.467043 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-0f8953d5-9700-4718-b06b-8713823f13de tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 200 len: 1225 microversion: 2.1 time: 0.090742 Aug 30 15:26:48.467658 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1287/2569] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:26:48 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:26:49.491019 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9d4ab148-553d-4ff1-8c93-40d03cdab1d4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:26:49.491681 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9d4ab148-553d-4ff1-8c93-40d03cdab1d4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 690f9316-215d-43ed-bba4-1dab9ddf6720] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:26:49.497761 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d4ab148-553d-4ff1-8c93-40d03cdab1d4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:49.498242 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d4ab148-553d-4ff1-8c93-40d03cdab1d4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:49.498678 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d4ab148-553d-4ff1-8c93-40d03cdab1d4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:49.499394 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d4ab148-553d-4ff1-8c93-40d03cdab1d4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:49.499851 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d4ab148-553d-4ff1-8c93-40d03cdab1d4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:49.500276 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9d4ab148-553d-4ff1-8c93-40d03cdab1d4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:49.513351 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-9d4ab148-553d-4ff1-8c93-40d03cdab1d4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] HTTP exception thrown: Instance 690f9316-215d-43ed-bba4-1dab9ddf6720 could not be found. Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9d4ab148-553d-4ff1-8c93-40d03cdab1d4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Request method failure captured: Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 HTTP/1.1 Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDiq03meZf34EHcP8TrH6VfJwFm7gmVw5fIgWF-6cgrpeS3kkwHvB1kq8NjLHYj4rTo31UGBtCs79SJcMCkmKoXEwaAL_cQDGEMkCfc6Kp_Ck-2vsnKuYrdAjWj2I8AyktRmffEIjTLERaafE1yssUPwtE857epffVEoPxGKmLki1rbU Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: b45f3223ea9541f38831d425cb35dbb3 Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-TestVolumeBootPattern-590827916 Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:26:49.514956 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:26:49.516393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b45f3223ea9541f38831d425cb35dbb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b45f3223ea9541f38831d425cb35dbb3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b45f3223ea9541f38831d425cb35dbb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b45f3223ea9541f38831d425cb35dbb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:26:49.516393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-TestVolumeBootPattern-590827916 Aug 30 15:26:49.516393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: b45f3223ea9541f38831d425cb35dbb3 Aug 30 15:26:49.516393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-TestVolumeBootPattern-590827916 Aug 30 15:26:49.516393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-TestVolumeBootPattern-590827916-project Aug 30 15:26:49.516393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:26:49.516393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:26:49.516393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: 2dc2d1a5bde44defae89c15d60172d4b Aug 30 15:26:49.516393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-TestVolumeBootPattern-590827916-project Aug 30 15:26:49.516393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:26:49.516393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance 690f9316-215d-43ed-bba4-1dab9ddf6720 could not be found. Aug 30 15:26:49.516393 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': '690f9316-215d-43ed-bba4-1dab9ddf6720'} Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 690f9316-215d-43ed-bba4-1dab9ddf6720 could not be found. Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:26:49.517249 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 690f9316-215d-43ed-bba4-1dab9ddf6720 could not be found. Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 690f9316-215d-43ed-bba4-1dab9ddf6720 could not be found. Aug 30 15:26:49.518607 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:26:49.520144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9d4ab148-553d-4ff1-8c93-40d03cdab1d4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Returning 404 to user: Instance 690f9316-215d-43ed-bba4-1dab9ddf6720 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:26:49.520144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9d4ab148-553d-4ff1-8c93-40d03cdab1d4 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720" status: 404 len: 111 microversion: 2.1 time: 0.030995 Aug 30 15:26:49.520144 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1283/2570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:26:49 2022] GET /compute/v2.1/servers/690f9316-215d-43ed-bba4-1dab9ddf6720 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:26:49.954635 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-20ab78a5-0807-4f6b-a2cb-d6467aa7f912 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:26:49.955171 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.compute.api [None req-20ab78a5-0807-4f6b-a2cb-d6467aa7f912 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127089) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:26:49.962109 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20ab78a5-0807-4f6b-a2cb-d6467aa7f912 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:49.962586 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20ab78a5-0807-4f6b-a2cb-d6467aa7f912 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:49.963013 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20ab78a5-0807-4f6b-a2cb-d6467aa7f912 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:49.963720 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20ab78a5-0807-4f6b-a2cb-d6467aa7f912 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:49.964165 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20ab78a5-0807-4f6b-a2cb-d6467aa7f912 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:49.964601 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG oslo_concurrency.lockutils [None req-20ab78a5-0807-4f6b-a2cb-d6467aa7f912 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127089) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:49.980061 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.wsgi [None req-20ab78a5-0807-4f6b-a2cb-d6467aa7f912 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] HTTP exception thrown: Instance 5a338377-489e-4653-acad-565045328392 could not be found. Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-20ab78a5-0807-4f6b-a2cb-d6467aa7f912 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Request method failure captured: Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: request: DELETE /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 HTTP/1.1 Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept: application/json Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Accept-Encoding: identity Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Connection: close Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Length: 0 Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Content-Type: application/json Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Host: 10.222.0.30 Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: Openstack-System-Scope: None Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: User-Agent: python-urllib3/1.26.12 Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Auth-Token: gAAAAABjDiq03meZf34EHcP8TrH6VfJwFm7gmVw5fIgWF-6cgrpeS3kkwHvB1kq8NjLHYj4rTo31UGBtCs79SJcMCkmKoXEwaAL_cQDGEMkCfc6Kp_Ck-2vsnKuYrdAjWj2I8AyktRmffEIjTLERaafE1yssUPwtE857epffVEoPxGKmLki1rbU Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Id: None Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Domain-Name: None Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Identity-Status: Confirmed Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Is-Admin-Project: True Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Id: default Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Domain-Name: Default Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Id: b45f3223ea9541f38831d425cb35dbb3 Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Project-Name: tempest-TestVolumeBootPattern-590827916 Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Role: member,reader Aug 30 15:26:49.981673 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Roles: member,reader Aug 30 15:26:49.983185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b45f3223ea9541f38831d425cb35dbb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b45f3223ea9541f38831d425cb35dbb3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b45f3223ea9541f38831d425cb35dbb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b45f3223ea9541f38831d425cb35dbb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:26:49.983185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant: tempest-TestVolumeBootPattern-590827916 Aug 30 15:26:49.983185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Id: b45f3223ea9541f38831d425cb35dbb3 Aug 30 15:26:49.983185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-Tenant-Name: tempest-TestVolumeBootPattern-590827916 Aug 30 15:26:49.983185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User: tempest-TestVolumeBootPattern-590827916-project Aug 30 15:26:49.983185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Id: default Aug 30 15:26:49.983185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Domain-Name: Default Aug 30 15:26:49.983185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Id: 2dc2d1a5bde44defae89c15d60172d4b Aug 30 15:26:49.983185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: X-User-Name: tempest-TestVolumeBootPattern-590827916-project Aug 30 15:26:49.983185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: method: > Aug 30 15:26:49.983185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: exception: Instance 5a338377-489e-4653-acad-565045328392 could not be found. Aug 30 15:26:49.983185 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: action_args: {'id': '5a338377-489e-4653-acad-565045328392'} Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a338377-489e-4653-acad-565045328392 could not be found. Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:26:49.984021 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a338377-489e-4653-acad-565045328392 could not be found. Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a338377-489e-4653-acad-565045328392 could not be found. Aug 30 15:26:49.985385 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: ERROR nova.api.openstack.wsgi Aug 30 15:26:49.986753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-20ab78a5-0807-4f6b-a2cb-d6467aa7f912 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Returning 404 to user: Instance 5a338377-489e-4653-acad-565045328392 could not be found. {{(pid=127089) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:26:49.986753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-20ab78a5-0807-4f6b-a2cb-d6467aa7f912 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 404 len: 111 microversion: 2.1 time: 0.032281 Aug 30 15:26:49.986753 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1288/2571] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 30 15:26:49 2022] DELETE /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:26:49.991508 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-703b5ae4-de95-4f31-b1e0-0a2bb9b90676 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:26:49.992114 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-703b5ae4-de95-4f31-b1e0-0a2bb9b90676 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] [instance: 5a338377-489e-4653-acad-565045328392] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:26:49.997909 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-703b5ae4-de95-4f31-b1e0-0a2bb9b90676 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:49.998382 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-703b5ae4-de95-4f31-b1e0-0a2bb9b90676 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:49.998812 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-703b5ae4-de95-4f31-b1e0-0a2bb9b90676 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:49.999522 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-703b5ae4-de95-4f31-b1e0-0a2bb9b90676 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Acquiring lock "fe2fd645-a23d-4fcb-9457-49d884190a04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:26:49.999965 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-703b5ae4-de95-4f31-b1e0-0a2bb9b90676 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:26:50.000385 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-703b5ae4-de95-4f31-b1e0-0a2bb9b90676 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Lock "fe2fd645-a23d-4fcb-9457-49d884190a04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:26:50.013529 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-703b5ae4-de95-4f31-b1e0-0a2bb9b90676 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] HTTP exception thrown: Instance 5a338377-489e-4653-acad-565045328392 could not be found. Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-703b5ae4-de95-4f31-b1e0-0a2bb9b90676 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Request method failure captured: Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 HTTP/1.1 Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept: application/json Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Connection: close Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Length: 0 Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Content-Type: application/json Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Host: 10.222.0.30 Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjDiq03meZf34EHcP8TrH6VfJwFm7gmVw5fIgWF-6cgrpeS3kkwHvB1kq8NjLHYj4rTo31UGBtCs79SJcMCkmKoXEwaAL_cQDGEMkCfc6Kp_Ck-2vsnKuYrdAjWj2I8AyktRmffEIjTLERaafE1yssUPwtE857epffVEoPxGKmLki1rbU Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Id: b45f3223ea9541f38831d425cb35dbb3 Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-TestVolumeBootPattern-590827916 Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Role: member,reader Aug 30 15:26:50.015017 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Roles: member,reader Aug 30 15:26:50.016506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b45f3223ea9541f38831d425cb35dbb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b45f3223ea9541f38831d425cb35dbb3", "adminURL": "http://10.222.0.30:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b45f3223ea9541f38831d425cb35dbb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b45f3223ea9541f38831d425cb35dbb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}] Aug 30 15:26:50.016506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-TestVolumeBootPattern-590827916 Aug 30 15:26:50.016506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Id: b45f3223ea9541f38831d425cb35dbb3 Aug 30 15:26:50.016506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-TestVolumeBootPattern-590827916 Aug 30 15:26:50.016506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User: tempest-TestVolumeBootPattern-590827916-project Aug 30 15:26:50.016506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Aug 30 15:26:50.016506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Aug 30 15:26:50.016506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Id: 2dc2d1a5bde44defae89c15d60172d4b Aug 30 15:26:50.016506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-TestVolumeBootPattern-590827916-project Aug 30 15:26:50.016506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: method: > Aug 30 15:26:50.016506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: exception: Instance 5a338377-489e-4653-acad-565045328392 could not be found. Aug 30 15:26:50.016506 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: action_args: {'id': '5a338377-489e-4653-acad-565045328392'} Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a338377-489e-4653-acad-565045328392 could not be found. Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:26:50.017321 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a338377-489e-4653-acad-565045328392 could not be found. Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a338377-489e-4653-acad-565045328392 could not be found. Aug 30 15:26:50.018617 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Aug 30 15:26:50.019798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-703b5ae4-de95-4f31-b1e0-0a2bb9b90676 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Returning 404 to user: Instance 5a338377-489e-4653-acad-565045328392 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:26:50.019798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-703b5ae4-de95-4f31-b1e0-0a2bb9b90676 tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392" status: 404 len: 111 microversion: 2.1 time: 0.028713 Aug 30 15:26:50.019798 dv-cinder-828806-5-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1284/2572] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 30 15:26:49 2022] GET /compute/v2.1/servers/5a338377-489e-4653-acad-565045328392 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 15:26:51.303456 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: DEBUG nova.api.openstack.wsgi [None req-7e33276d-f1de-469c-894e-866332bc740f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] Calling method '.version_select at 0x7f5cbdfbedc0>' {{(pid=127089) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:26:51.326342 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: INFO nova.api.openstack.requestlog [None req-7e33276d-f1de-469c-894e-866332bc740f tempest-TestVolumeBootPattern-590827916 tempest-TestVolumeBootPattern-590827916-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-634593545" status: 202 len: 0 microversion: 2.1 time: 0.027362 Aug 30 15:26:51.327085 dv-cinder-828806-5-iscsi devstack@n-api.service[127089]: [pid: 127089|app: 0|req: 1289/2573] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Aug 30 15:26:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-634593545 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)